Machine vision lighting – Proven techniques to boost inspection accuracy and performance

Posted on

This month, we are discussing one of the main, and sometimes underutilised, elements of vision systems – lighting. Lighting in machine vision quality control is perhaps one of the most important aspects to get right. It’s critical because it enables the camera to see necessary details. In fact, poor lighting is one of the major causes of failure of machine vision system installations and poor yield performance of a vision system. Therefore, it should be a top priority in determining the correct lighting approach for a machine vision application. While the latest generation AI deep learning vision systems can compensate to some extent for fluctuations in lighting, nothing will replace the ability to light a product accurately to allow defective areas to be seen by the camera. Getting these fundamentals right makes the job of the software image processing much more manageable.

For every vision quality control application, there are common lighting goals:

  1. Maximising feature contrast of the part or object to be inspected.
  2. Minimising contrast on features not of interest.
  3. Removing distractions and variations to achieve consistency.

In this respect, the positioning and type of lighting are key to maximising the contrast of inspected features and minimising everything else. Think of how a manual operator would inspect a part for quality. Typically, they would turn it in front of the light while moving their head to see how the light reflects off of specific areas, slowly covering the whole part or necessary detail as required. Sometimes, even holding it up to the light to create a background to see contamination or features. A human does all this instinctively, but for a digital vision system, this somehow has to be replicated – and at high speed!

Lighting position

The first thing to consider is the lighting position. The position of the lighting will determine the brightness, shadowing, contrast, and what element of light will be seen by the camera system. The overall classification of machine vision lighting positions can be seen below.

Description Characteristics Features
Front illumination – the light is positioned on the same side as the camera/optics Useful for inspecting defects or features on the surface of an object
Back illumination – the object being illuminated blocks light on its way to the camera Useful for highlighting the object silhouette, measuring outline shape and detecting presence/absence of holes or gaps, as well as enhancing defects on transparent objects

Types of machine vision lighting

Within machine vision, the two most common types of lighting used are fibre optics and LED. Fibre optics allows the lighting source to be positioned away from the scene, with a fibre optic cable delivering the light to the vision system scene. This can also allow a higher lux light level to be concentrated into a smaller area.

Fibre Optic Deliver light from halogen, tungsten‐halogen or xenon source. Bright, shapeable & focused.
LED lights By far the most commonly used because:

  • High speed
  • Pulsing – Switched on and off in sequence, only using when necessary
  • Strobing useful for freezing the motion of fast moving objects, to eliminate ambient light influence
  • Flexible positioning into variety of shapes. Directional or diffused
  • Long lifetime
  • Higher Stable Output
  • Colours – Available in visible and non visible
Dome lights
  • Designed to provide illumination coming from virtually any direction
  • Avoid reflection and provide even light when inspecting surface features on an object with complex curved geometry
Telecentric lighting
  • Accurate edge detection and defect analysis through silhouette imaging
  • Reflective objects
  • High accuracy & precise measurement
Diffused light
  • Filters create contrast to lighten or darken object features
  • Avoid uneven illumination on reflective surfaces
Direct light
  • Delivers lighting on the same optical path as the camera

Other key elements to consider when designing lighting for a machine vision environment include the direction, brightness and colour/wavelength compared to the target’s colour.

Lighting angle/direction

The position and angle of the LEDs have a direct effect on the ability of the vision system camera to see contrast in certain areas. This allows lighting setups to be designed to provide the optimum lighting conditions to highlight key areas of the product. This makes the image processing of the machine vision system image more consistent and makes it easier to provide a robust solution. There are several different techniques to think about in this area.

Bright field – Light reflected by the object being illuminated is inside of the optics/camera range Brightfield front lighting – Light reflected by the flat object being illuminated is collected by the optics/camera. Produces dark characteristics on a bright background
Brightfield back lighting – light is either stopped or if the material is transparent or opaque it will be transmitted through the surface
Dark field – Light reflected by the object being illuminated is outside of the optics/camera range Dark field front lighting – reflected light is not collected by the optics/camera. Enhances the non-planar features of the surface as brighter characteristics on a dark background
Dark field backlighting – light transmitted by the object and scattered by non-flat features will be enhanced as bright on a dark background
Co-axial illumination – The front light is positioned to hit the object surface at 90° Can additionally be collimated so that rays are parallel to the optics/camera axis and is useful for achieving high levels of contrast when searching for
defects on highly reflective surfaces

Colour/wavelength

Another aspect to think about when designing machine vision lighting is the filters which can be deployed on the front of the lens. These typically screw onto the front of the lens. They can limit the transmission of specific wavelengths of light, allowing the image to be changed to suit a particular condition that is being identified in the machine vision process.

Filters
  • Create contrast to lighten or darken object features.
  • Like colour filters lighten (i.e. red light makes red features brighter) and opposite colour filters darken (i.e. red light makes green features darker).
  • Polarizers are types of filters used to reduce glare or hot spots. They enhance contrast, so entire objects can be recognised.

Of course, the parameters outlined in the preceding tables are used in varying combinations and are key to achieving the optimal lighting solution. However, we also need to consider the immediate inspection environment. In this respect, the choice of effective lighting solutions can be compromised by access to the part or object to be inspected. Ambient lighting such as factory lights or sunlight can also have a significant impact on the quality and reliability of inspection and must be factored into the ultimate solution.

Finally, the interaction between the lighting and the object to be inspected must be considered. The object’s shape, composition, geometry, reflectivity, topography and colour will all help determine how light is reflected to the camera and the subsequent impact on image acquisition, processing, and measurement.

Due to the obvious complexities, there is often no substitute other than to test various techniques and solutions. It is imperative to get the best lighting solution in place before starting the development of the image processing requirements in any machine vision quality control application.

The future of AI-powered vision systems in medical device and pharmaceutical inspection

Posted on

Quality control comes first in the highly regulated fields of medical device and pharmaceutical manufacture. Not only is it a question of efficiency; patient safety depends on every product meeting strict industry requirements. Long the backbone of quality control in this industry, traditional inspection techniques depend on human monitoring and standard rule-based vision systems. But the limits of traditional methods are clear as production sizes rise and manufacturing techniques get more complicated. Artificial intelligence’s inclusion into machine vision systems is changing the inspection scene and allowing more precise, flexible, effective quality control.

Vision systems driven by artificial intelligence are significantly altering how producers handle production efficiency, compliance verification, and defect discovery. Unlike rule-based systems, which run on pre-programmed criteria to find flaws, artificial intelligence models—especially those using deep learning—can spot minute, hitherto undetectable variations in items. In the medical and pharmaceutical sectors, where variances can be minute but nevertheless noteworthy enough to affect product integrity, this is extremely helpful.

Detecting discrepancies in high-volume manufacturing lines is one of the important domains where artificial intelligence-powered visual systems shine. Medical equipment including syringes, catheters, and surgical tools must to be exactly perfect; even small flaws can affect their efficacy. Conventional machine vision systems must be extensively manually programmed to distinguish between good and bad products. By means of large datasets of images, artificial intelligence models can be trained to identify acceptable deviations while indicating abnormalities that might have escaped attention under a rule-based approach. This guarantees that only really faulty goods are taken off the supply chain by greatly lowering false positives and negatives.

AI-enhanced vision technologies are proving absolutely essential is pharmaceutical packaging and labelling. Regulatory compliance depends critically on batch code verification, expiration date printing, and label placement precision. Although efficient, standard OCR (optical character recognition) techniques can have difficulty with variances in font clarity, small distortions, or package material. Even in demanding environments like curved surfaces or low-contrast printing, AI models educated on thousands of packaging samples may learn to spot mistakes with significantly more dependability. These systems’ self-learning character also helps them to adjust to new materials and packaging designs without calling for significant reprogramming.

Another area where visual inspection driven by artificial intelligence is making great progress is the sterility and integrity of medical packaging. Combining human inspectors with static rule-based visual checks has long been the basis for seal validation in blister packs, vials, and ampoules. These techniques can, however, have trouble with borderline situations such minor punctures compromising sterility or somewhat uneven heat sealing. Combining artificial intelligence-based vision inspection with hyperspectral imaging or X-ray analysis will help to identify hidden flaws missed by conventional techniques, therefore preventing the release of contaminated goods into use. In the pharmaceutical industry especially, where even little packaging flaws could cause contamination hazards, this is especially important.

The capacity of AI-powered vision systems to improve traceability and compliance with strict legal criteria adds still another benefit. Manufacturers of medical devices have to follow EU MDR, ISO 13485, and FDA 21 CFR Part 820 among other international guidelines. By means of factory execution systems (MES) and enterprise resource planning (ERP), AI vision systems can interact to generate real-time inspection data, therefore guaranteeing thorough documentation of quality control methods. For recalls and regulatory checks, this degree of traceability is absolutely helpful since it lets producers monitor and separate faulty batches with until unheard-of speed and accuracy.

Visual inspection is being used to lower industrial waste and increase productivity. Conservative flaw detection thresholds of traditional inspection techniques might cause too high rejection rates. With their capacity to recognise subtle differences in product quality, artificial intelligence models can separate between actual flaws and benign deviations. Over time, this lowers needless waste without sacrificing safety criteria, therefore saving significant costs. Moreover, vision systems driven by artificial intelligence function nonstop without tiredness, enabling constant inspection quality across protracted manufacturing cycles.

Extensive data training is one of the difficulties that artificial intelligence-based visual systems in pharmaceutical and medical production presents. Unlike rule-based systems, which may be used with specified criteria, artificial intelligence models need vast amounts of high-quality photos for training. To guarantee strong model performance, this entails selecting varied datasets considering changes in illumination, angles, and material qualities. Synthetic data creation and transfer learning, however, are solving these issues and increasing the viability of artificial intelligence implementation—even for companies with limited access to big datasets.

Another factor is how well current manufacturing infrastructure integrates. Many manufacturing plants run antiquated machinery not meant to fit vision systems driven by artificial intelligence. Modern artificial intelligence solutions, on the other hand, can be used as modular updates that complement current technology to improve its capacity instead of totally replacement. Emerging as a good alternative are cloud-based artificial intelligence vision systems, which let companies use strong computer capacity without making large on-site hardware purchases.

As artificial intelligence-powered vision systems develop, their possible uses in pharmaceutical and medical production will only grow. Real-time adaptive learning will probably be included into the future generation of vision technology so that systems may dynamically change their flaw detection models as they handle fresh input. Furthermore, predictive analytics driven by artificial intelligence can help companies foresee possible quality problems before they materialise, therefore transforming quality management from a reactive to a proactive activity.

Adoption of artificial intelligence-driven visual inspection in pharmaceutical and medical industry marks a basic change in quality control strategy. AI vision systems are redefining the sector by raising accuracy, cutting waste, boosting compliance, and raising efficiency. Although data needs and execution still present difficulties, the long-term advantages much exceed the initial outlay. Manufacturers trying to satisfy the highest standards of quality and safety in an increasingly complicated regulatory environment will find that as the technology develops an invaluable tool.

The Ultimate Guide to Operator Guidance Systems

Posted on

In today’s rapidly evolving manufacturing landscape, the role of operator guidance systems has taken centre stage. As businesses strive to enhance productivity, minimise errors, and maintain workforce engagement, innovative technologies such as augmented reality (AR) and digital work instructions are transforming the way operators interact with their tasks. This guide explores the pivotal elements of operator guidance, addressing common challenges and offering actionable insights to optimise manufacturing processes.

1. Understanding Operator Guidance

Operator guidance refers to the methods and tools designed to assist workers in executing their tasks with precision and efficiency. Whether through augmented reality, vision systems, digital instructions, or automated feedback systems, these tools aim to:

• Simplify complex tasks
• Reduce errors and rework
• Shorten training durations
• Enhance workforce versatility

The integration of such systems into manufacturing environments transforms workstations into interactive, digital ecosystems that support operators in real time. By offering real-time feedback, operators are less likely to make errors, ensuring consistency and quality throughout the manufacturing process. It also allows new operators to understand a task immediately.

Additionally, operator guidance systems improve communication on the shop floor. By aligning visual aids, auditory signals, and data analytics, they ensure that workers have access to clear and concise information. This holistic approach boosts efficiency and fosters a culture of continuous improvement.

2. The Shift Toward Digital Work Instructions

Digital work instructions have emerged as a game-changer in manufacturing, replacing traditional paper manuals with dynamic, interactive platforms. The benefits include:

• Cost Efficiency: Eliminating printing and distributing manuals saves resources while promoting sustainability.
• Real-Time Updates: Digital platforms ensure operators have access to the latest procedures, reducing the risk of outdated information causing errors.
• Interactive Learning: Multimedia elements such as videos and interactive checkpoints enhance comprehension and retention, shorten training times, and improve task accuracy.
• Streamlined Processes: Instructions tailored to specific tasks or product variants eliminate the need for manual searches, delivering the right information at the right time.

Companies adopting digital work instructions also benefit from seamless integration with Manufacturing Execution Systems (MES) and Enterprise Resource Planning (ERP) systems. This integration enables data-driven insights for continuous improvement and fosters transparency and adaptability, ensuring production goals are consistently met.

Digital work instructions are handy in high-mix, low-volume production environments where the need to adapt to new product lines quickly is critical. The ability to easily modify and distribute updated instructions enhances operational flexibility and reduces downtime.

3. Overcoming Challenges in Operator Guidance

3.1 Finding and Retaining Skilled Labour

The global shortage of skilled operators is a significant challenge for manufacturers. High turnover rates, coupled with extended training periods, can disrupt operations. Implementing operator guidance systems minimises the impact of these challenges by:

• Reducing the dependency on pre-existing expertise
• Accelerating onboarding with intuitive training modules
• Enabling lower-skilled workers to perform complex tasks effectively

By incorporating gamification elements into training modules, manufacturers can further engage employees. This approach improves learning outcomes and increases job satisfaction, reducing turnover rates. It allows work instructions to adapt to various languages automatically.

3.2 Adapting to Increased Demand

Fluctuations in customer demand often stress production capacities. Flexible guidance systems help manufacturers scale operations by:

• Training temporary workers swiftly
• Standardising processes to ensure consistent quality
• Allowing real-time adjustments based on workload variations

Advanced analytics integrated into guidance systems allow managers to predict and prepare for demand surges, optimising resource allocation.

3.3 Addressing Operator Resistance

Operator scepticism can hinder the adoption of new technologies. Concerns about micromanagement and loss of autonomy are common. To counter this, systems are designed with operator-centric features such as:

• Experience Level Functionality: Customisable instruction intensity based on operator proficiency
• Freedom in Task Execution: Allowing operators to perform tasks in their preferred sequence where feasible
• Error Prevention as Support: Real-time feedback focuses on preventing mistakes rather than penalising them

Involving operators in designing and implementing guidance systems can also mitigate resistance. By incorporating user feedback, organisations can ensure that the systems are perceived as tools for empowerment rather than oversight.

4. The Role of Augmented Reality in Operator Guidance

Augmented reality (AR) enhances operator guidance by overlaying digital information directly onto physical workspaces. This immersive approach offers:

• Real-Time Visual Feedback: Operators receive step-by-step instructions projected onto their workbench, ensuring clarity and precision.
• Reduced Cognitive Load: By focusing on one task at a time, operators can work more efficiently without memorising sequences.
• Error Prevention: AR systems, integrated with sensors and smart tools, provide immediate warnings if a task is performed incorrectly.

Types of AR Implementation:

• Wearables: AR glasses and headsets provide hands-free access to instructions but may cause discomfort during extended use.
• Handheld Devices: Tablets offer portability but interrupt workflow when operators need both hands.
• Projected AR: Systems that project instructions directly onto workspaces offer ergonomic, non-intrusive solutions ideal for industrial settings. This approach is particularly valued for its standalone nature, eliminating reliance on battery power and enhancing safety.

Projected AR also offers significant scalability, making it suitable for both small-scale operations and large industrial setups. Its ability to integrate seamlessly with existing tools and workflows ensures minimal disruption during implementation.

5. Benefits of Implementing Operator Guidance Systems

5.1 Enhanced Training
Guidance systems significantly reduce training durations by up to 50%, enabling temporary and new workers to become productive faster. Interactive features foster skill acquisition and confidence. Visual and interactive tools accelerate learning and reduce dependency on senior operators.

By incorporating real-time feedback mechanisms, these systems create a continuous learning environment. Operators can identify and correct errors on the spot, enhancing their overall proficiency over time.

5.2 Improved Quality and Efficiency
Standardised processes ensure that every operator performs tasks uniformly, minimising errors and waste. Systems that validate task completion further enhance quality assurance. By minimising rework and reducing scrap, these systems help manufacturers maintain competitive advantages.

Data from guidance systems can also be used to implement continuous improvement initiatives. By analysing patterns in errors and inefficiencies, managers can identify opportunities for process optimisation.

5.3 Adaptability and Flexibility
With customisable instructions, operators can seamlessly switch between tasks or product variants. This flexibility supports high-mix, low-volume production environments. The ability to integrate temporary or seasonal workers smoothly ensures operational continuity.

Moreover, guidance systems support cross-training initiatives, enabling workers to develop skills across multiple roles. This versatility enhances workforce agility and resilience.

5.4 Data-Driven Insights
Embedded analytics identify bottlenecks and error-prone steps, providing actionable data to optimise workflows and improve productivity. Reports generated from these systems allow supervisors to target specific areas for improvement, enhancing overall operational efficiency.

The integration of IoT devices further enhances data collection, offering deeper insights into machine performance and operator interactions. This holistic view enables more informed decision-making.

6. Empowering Operators: A Broader Perspective

Instead of focusing on a single case, the real power of operator guidance systems lies in their adaptability across diverse industries. Whether it is automotive manufacturing, electronics assembly, or medical device assembly, these systems are engineered to overcome common challenges such as complex task sequences and quality control. By integrating features like real-time feedback, customisable training modules, and seamless MES/ERP connectivity, businesses of all sizes can achieve:

• Up to 50% faster onboarding of new staff
• Streamlined multi-variant production processes
• A significant reduction in waste and rework
• Enhanced adaptability for workforce changes

This versatility highlights the universal benefits of operator guidance systems, making them indispensable tools for any forward-thinking manufacturing operation.

The ability to customise systems based on industry-specific requirements ensures that organisations can address their unique challenges effectively. From ensuring compliance in regulated industries to optimising throughput in high-volume sectors, these systems deliver measurable value.

7. The Future of Operator Guidance

As Industry 4.0 continues to evolve, operator guidance systems will play an even more critical role in bridging human expertise with advanced automation. Emerging trends include:

• AI-Driven Insights: Predictive analytics to pre-empt errors and optimise training
• IoT Integration: Seamless communication between tools, sensors, and guidance platforms
• Personalised Experiences: Tailoring guidance to individual operator preferences and skill levels
• Eco-Conscious Manufacturing: Incorporating sustainable practices through optimised resource management

By aligning with these trends, operator guidance systems will continue to serve as a cornerstone of modern manufacturing strategies. The focus on sustainability and worker well-being ensures that these systems contribute to broader organisational goals beyond operational efficiency.

Conclusion

Operator guidance with vision systems represents a pivotal advancement in manufacturing, addressing challenges from labour shortages to quality assurance. By leveraging technologies like augmented reality and digital work instructions, manufacturers can empower their workforce, reduce costs, and achieve unparalleled operational excellence. Embracing these systems is not just a step forward—it is an essential leap into the future of manufacturing. These systems’ adaptability, efficiency, and support for human-centric operations make them indispensable for achieving long-term success in a competitive global manufacturing market.

More details on IVS Operator Guidance Systems can be found here: www.industrialvision.co.uk/products/operator-guidance-platform

How automated vision technology ensures perfect pills and tablets

Posted on

When you pick up a pill or tablet, it may appear small and modest, but have you ever realised how much precision goes into making it perfect? In the pharmaceutical industry, the quality of pills and tablets is determined by more than just their chemical content. These tiny goods must also meet demanding size, shape, weight, and appearance requirements. A single flaw or defect can jeopardise not just the product’s integrity but also consumer trust, hence quality control is a major responsibility.

Automated vision technology is critical in pharmaceutical manufacturing because it ensures precision and compliance throughout the entire process. These systems are critical in modern manufacturing, delivering innovative solutions that ensure each pill fulfils stringent industry standards and regulatory criteria. From detecting cosmetic faults to following tight MHRA, FDA, and GxP criteria, these advanced vision systems add precision, speed, and dependability to an otherwise daunting process.

Why Does Perfection Matter in Pharmaceutical Manufacturing?
In the pharmaceutical sector, flaws are more than just an aesthetic issue. A tablet with obvious flaws, such as black spots, cracks, or discolouration, may raise concerns about its quality and safety. Furthermore, any change from the specified dimensions, weight, or appearance may have an impact on the medication’s efficacy or raise regulatory concerns.

Pharmaceutical firms are expected to follow strict rules such as MHRA, GAMP, and GxP laws. Automated vision systems meet these standards by performing speedy and comprehensive inspections, decreasing human error, and ensuring quality control consistency. Manual inspection is just not possible for production lines that run at high speeds, hence automation is an integral aspect of the process.

Tablet and Pill Inspection: A Complicated Process
Pills, pills, and capsules come in all shapes and sizes. Tablets typically measure 5-12mm in diameter and 2-8mm thick, with curved tablets reaching lengths of up to 21mm. Capsules, on the other hand, are classified according to their size, which typically ranges from size 0 (biggest) to size 5. Regardless of these variances, producers must detect cosmetic flaws down to the nano level—a feat well beyond the human eye’s capabilities.

Some frequent defect categories that vision systems must recognise are:

  • Surface problems include dirt, foreign particles, scratches, cracks (lengthwise and diagonal), splits, and holes.
  • Anomalies in shape include dents, bends, double capping, and collapsed tablets.
  • Color discrepancies, including discolouration and uneven finishes.

How Does Automated Vision Technology Work?
The inspection procedure starts with a high-speed feeding mechanism. Pills are carefully transferred from hoppers or bowls into the inspection channel and positioned for best viewing by the vision system. To guarantee both sides of the pill are inspected, modern systems frequently use a two-step process:
-First Side Inspection: A vacuum dial plate holds the pill in place while cameras take photos of the top surface.
-Second Side Inspection: The pill is moved to another plate and hung securely through a vacuum while cameras analyse the bottom.
This system ensures that each tablet is properly scrutinised with no blind spots.

The Magic of Multi-Camera Vision Systems.
The true value of automated vision technology comes from its capacity to deliver a 360-degree image of each tablet or pill. Multi-camera modules, which are frequently coupled with custom optics and mirrors, enable for thorough inspection. Manufacturers may take images of all sides and angles of the pill by strategically positioning cameras and mirrors, resulting in eight distinct perspectives of a single product.

These photos are evaluated by advanced algorithms that detect even the smallest imperfections, guaranteeing that only faultless products make it into packaging. The system’s capacity to eliminate blind spots is vital for performing the high-speed, high-accuracy inspections demanded by current pharmaceutical manufacturing.

Beyond Detection: The advantages of vision systems
Automated vision systems offer distinct benefits that correspond to the pharmaceutical industry’s rigorous requirements:

  • Vision systems can inspect hundreds of pills per minute without sacrificing accuracy, resulting in optimal manufacturing line efficiency.
  • Advanced imaging can detect faults as small as a few microns, invisible to the human sight.
  • Real-time data analytics in vision systems help manufacturers spot trends, foresee concerns, and take preventive action to preserve product quality.
  • Effective Compliance: Built-in checks linked with FDA, GAMP, MHRA and GxP standards ease regulatory conformity, decreasing the risk of infractions and assuring consistent product quality.
  • Vision systems reduce waste by recognising damaged pills early in the production process, saving money and resources.

    • These specific qualities make automated vision systems indispensable in modern pharmaceutical manufacturing, where precision and compliance are critical.

Innovation on the Horizon
As technology advances, so does the possibility for automated vision systems. Emerging technologies such as artificial intelligence (AI) and machine learning are improving defect detection capabilities by allowing systems to learn from prior inspections and improve with time. Additionally, integration with Internet of Things (IoT) devices enables real-time monitoring and data analysis, giving businesses with actionable insights to further improve manufacturing operations.

Final Thoughts
Automated vision technology is transforming the pharmaceutical industry by assuring that every pill and tablet meets the highest levels of quality and safety. These technologies improve manufacturing efficiency while maintaining consumer trust by combining speed, precision, and innovation.

The next time you take a pill, remember the sophisticated processes and cutting-edge technology that secured its perfection. Automated vision inspection enables manufacturers to confidently provide clean, high-quality products, one pill at a time.

Your quick guide to machine vision

Posted on

Choosing the most appropriate combination of components needed for a machine vision system requires expert understanding of application requirements and technology capabilities. From this perspective in this month’s blog post we thought we would provide you with enough knowledge and understanding to have richer more rewarding conversations about machine vision and vision systems technology. This quick guide will help you understand the basics of machine vision and vision systems, including components, applications, return on investment and potential for use in your business.

The first thing to understand are the basic elements of a machine vision system. We’ve covered this before in this post, but it’s good to re-iterate it here. The basics of a machine vision system are as follows:

  • The machine vision process starts with the part or product being inspected.
    When the part is in the correct place, a sensor will trigger the acquisition of the digital image.
  • Structured lighting is used to ensure that the image captured is of optimum quality.
  • The optical lens focuses the image onto the camera sensor.
  • Depending on capabilities, this digitising sensor may perform some pre-processing to ensure the correct image features stand out
    The image is then sent to the processor for analysis against the set of pre-programmed rules.
  • Communication devices are then used to report and trigger automatic events, such as part acceptance or rejection.
  • What can machine vision be used for?

The applications for machine vision vary widely between industries and product environments. However, to aid understanding, they can be broken down into the following five major categories. As outlined previously, in the section on ‘processor’, these usually combine a number of algorithms and software tools to achieve the desired result.

1. Location, guidance & positioning

When combined with robotics, machine vision offers powerful application options. By accurately determining the position of parts to direct robots, find fiducials, align products and provide positional adjustment feedback, guided robots enable a flexible approach to feeding and product changes. This eliminates the need for costly precision fixtures, allowing different parts to be processed without changing tools. Some typical applications include:

  • Locating and orientation of parts to compare them to specific tolerances
  • Finding or aligning parts so that they are positioned correctly for assembly with other components
  • Picking and placing parts from bins
  • Packaging parts on a conveyor belt
  • Reporting part positioning to a robot or machine controller to ensure correct alignment

 

2. Recognition, identification, coding & sorting

Using state-of-the-art neural network pattern recognition to recognize arbitrary patterns, shapes, features and logos, vision systems enable the comparison of trained features and patterns within fractions of a second. Geometric features are also used to find objects and easily identify models that are translated, rotated and scaled to sub-pixel accuracy. Typical applications include:

  • Decoding 1D & 2D symbols, codes and characters printed on parts, labels, and packages.
  • Direct Part Marking (DPM) a character, code or symbol onto a part or packaging
  • Identifying parts by locating a unique pattern or based on colour, shape, or size.
  • Optical character recognition (OCR) and optical character verification (OCV) systems read alphanumeric characters and confirms the presence of a character string.

3. Gauging & measuring

Measuring in machine vision is used to confirm the dimensional accuracy of components, parts and sub-assemblies automatically, without the need for manual intervention. A key benefit with machine vision is that it is non-contact and so does not contaminate or damage the part being inspected. Many machine vision systems can also measure object features to within 0.0254 millimetres and therefore provide additional benefits over the contact gauge equivalent.

4. Inspection, detection & verification

Inspection is used to detect and verify functional errors, defects, contaminants and other product irregularities.

Typical applications include:

  • Verifying the presence/absence of parts or components
  • Counting to confirm quantities
  • Detecting flaws
  • Conformance checking to inspect products for completeness.

5. Archiving & Tracking

Finally, machine vision can play an important role in archiving images and tracking parts and products through the whole production process. This can be particularly valuable in tracking the genealogy of parts in a sub-assembly that make up a finished product. Data recorded can be used to drive better customer support, improve production processes and protect brands against costly product recalls.

What are the benefits of machine vision?

The economic case for investing in machine vision systems is usually strong due to the two key following areas:

1. Cost savings through reducing labour, re-work/testing, removing more expensive capital expenditure, material and packaging costs and removing waste

2. Increased productivity through process improvements, greater flexibility, increased volume of parts produced, less downtime, errors and rejections

However, just viewing the benefits from an economic perspective does not do justice to the true value of your investment. Machine vision systems can add value in all the additional following ways. Unfortunately due to the intangible nature of some of these contributors it can be difficult to put an actual figure on the value but that shouldn’t stop attempts to include them.

  • Intellectually
    • By freeing staff from repetitive, boring tasks they are able to focus thinking in ways that add more value and contribute to increasing innovation. This is good for mental health and good for the business.
    • By reducing customer complaints, product recalls and potential fines machine vision can help to build and protect your brand image in the minds of customers
    • Building a strong image in the minds of potential business customers through demonstrating adoption of the latest technology, particularly when they come and visit your factory!
    • Through the collection of better data and improved tracking, machine vision can help you develop a deeper understanding of your processes
  • Physically
    • The adoption of machine vision can help to complement and even improve health and safety practice
    • Removing operators from hazardous environments or strenuous activity reduces exposure to sickness, absence, healthcare costs or insurance claims
  • Culturally
    • Machine vision can contribute and even accelerate a culture of continuous improvement and lean manufacturing
    • Through increased competitiveness and improving service levels machine vision helps build a business your people can be proud of
  • Environmentally
    • Contributing to a positive, safe working environment for staff
    • Through better use of energy and resources, smoother material flow and reduced waste machine vision systems can help reduce your impact on the environment

The costs of machine vision systems?

Costs can range from several hundred for smart sensors and cameras, up to half a million for complex systems. Of course this will depend on the size and scope of your operations and may be more or less.

However, even in the case of high levels of capital investment it should be obvious, from the potential benefits outlined above, that a machine vision system can quickly pay for itself.

How to deploy an effective vision system for automated inspection

Posted on

When we start developing a new vision system project or are asked to quote for a specific project, we return to the first principles of good practice for vision systems design. We have created these first principles from our millions of hours of experience developing machine vision solutions for Original Equipment Manufacturers (OEM) and end-user customers. It’s a holistic approach to a project review, from the initial understanding of the vision system elements to assessment for automation, an understanding of the process and production environment, and finally, control and factory information connectivity.

The key to this is being driven by the specification and development of a machine vision solution that will work and be robust in the long term. This might sound obvious, as why wouldn’t you design something which will work for the customer, provide long-term stability and make support (and everyone’s life) easier? But we sometimes hear of customers who have supposedly found a solution for a lower price or specification, which, when looked at in detail, proves to be a solution which won’t work, provides the customer with a lot of hassle and ends up being a quality control white elephant in their production. Vision systems have to be adequately thought out and understood. First and foremost, it must work and be robust so that the industrial automation in the line continues to run 24/7, without interruption.

So, how do we approach a machine vision project to ensure its effectiveness, I hear you say? Well, as we said, we look at the sequence of steps that will make for an effective vision system solution. This is best practice for vision system deployment and successful delivery. Where do you start:

1. User Requirement Specification (URS)/Specification/Detailed Information. The first thing to have is a very defined URS or specification to work with. Again, this might sound strange, but some customers have no specific written specifications, only an idea of a system. This is fine in the early stages, but to quote and ultimately deploy effectively, a specification is needed detailing the product, the variants, speeds, communication, quality checks required, tolerances, production information, process control and all elements of the production interaction (and rejection) that are required. For a formal medical device/pharma production URS, this will be spelt out in more detail on an individually numbered sentence-by-sentence or paragraph-by-paragraph basis, based on GAMP (Good Automated Manufacturing Practice). However, for others, it could be a few pages of written detail defining the requirements for the vision system. Whichever approach, the project needs to be defined from the get-go.

2. Samples Testing. Testing of samples is always a good idea. These are real-world samples from the production line showing the product variation on a shift-by-shift, week-by-week basis. Samples that show both good and actual reject samples are needed. Samples of varying defect styles are required to understand how such a rejection will manifest itself on the product. Depending on the project’s difference from those already known algorithms, a formal Proof of Principle may be suggested to determine how the vision system can effectively identify the rejects.

3. Test Documentation. Our proven and reliable test format drives our engineering to document the sample testing results. This allows us to record all the information on the project and provide tangible data to review in the future if the project goes ahead, so it’s a key document in the fight for effectiveness in the vision system deployment. The sheet is divided into specific areas and completed with the sample testing. It includes all details on the job, including:
-Application type: for example presence verification, gauging, code reading or Optical Character Recognition (OCR)
-Inspected Part: is the sample indicative of the real “in-production” type, how many variants are there?
-Material: is the part metallic, opaque, transparent, etc?
-Surface and Form: is it reflective, painted rough etc?
-Environment: what environment will the vision system operate in. For example, if surface detection of contamination is required, a clean room will help to reduce the false failures or debris on the surface.
-Background: how is the product presented on a fixture, and what does that look like?
-Vision System specifics: what camera head type is needed, resolution, pixel size, frame rate, spatial resolution, field of view, object distance and optics.
-In-process specifics: How fast is the product moving, what cycle time is needed, and what wavelength of light is used?
-Image processing: once all the above elements are confirmed the actual machine vision image processing needs to be reviewed. Can traditional algorithms be used or is it an AI application? How repeatable is the processing based on the product deviation over many samples? Sample images should be saved showing the test conditions and every sample reviewed.
-Process views and comms: What will we display on the production line HMI, what stats and yields need to be seen, and finally how will the system communicate with the Programmable Logic Controller (PLC) or factory information system.

4. Project Review. A multi-disciplinary team, including vision engineering, controls, mechanical engineering, and automation engineering carry out a review of the results. The team reviews testing results and assesses how this applies to the production environment, automation and interaction with other production processes. The test documentation will provide some specific angles, lighting and filters required for the vision set-up. Can the product be presented consistently to allow the defined fields of view to be seen? The whole team must agree that the project is viable and the vision testing was successful for us to progress – again, another gate to make sure the vision system deployment is effective.

5. Commercial Review. The commercial team will become involved in the project review to understand all elements of the vision system, the specific development needed, and how this translates into a complete system or machine, including all aspects of automation and validation. The commercials are agreed upon for the project.

6. Inspection Specification. Once a project is live, all of the work done in advance is transferred to the engineering team. This will lead to the development and publication of an Inspection Specification that will run through the whole project. This specification defines all elements of the vision system and the approach for inspection. It is agreed with the customer and becomes the guiding document through the project’s completion. For OEM customers who will be purchasing multiple systems, it also provides the ability to provide a consistent machine vision system from project to project.

7. Installation and Commissioning. As the project progresses, competent and experienced IVS vision engineers perform installation and commissioning. They are guided by all the information already collated and assessed, therefore reducing any guesswork about the vision system’s operation as it’s installed. This measured approach means there are no surprises or unknowns once this stage is reached, derisking the project from both sides.

8. Validation FAT and SAT. Prior to final confirmation of operation, a Factory Acceptance Test (FAT) and Site Acceptance Test (SAT) are conducted based on the vision engineering and inspection specification requirements. This rigid document tests all fail conditions of the machine vision system, robust operation over a long period, and confirmation of the calibration of the complete system.

How to deploy an effective vision system for automated inspection

Overall, these steps create a practical framework for the orderly specification and deployment of a robust and fit-for-purpose vision system. Even for our OEM customers who require multiple machines or vision systems over a long contractual period, it pays to follow the standard procedure for effective vision system deployment. The process is designed to minimise risk and provide a robust and long-service vision system that can easily be supported and maintained.

Crush Defects: The Power of Semi-Automatic Inspection

Posted on

This month, we’re discussing the elements of semi-automatic inspection. This is the halfway house that pharmaceutical manufacturers have to move to from manual quality inspection (of individual products) at a bench when volumes start to increase but don’t warrant a fully automated inspection solution. The catalyst for change is when the inspection room is full of quality inspectors, and it’s time to increase the throughput of quality assessment. The semi-automatic inspection solution allows vials (liquid and lyo), syringes, cartridges and ampoules to be presented to the operator at speed to review before a magnifier, enabling manual rejection to be completed. This allows a single operator to do the job of a room of quality inspectors. This process mimics the standard GAMP manual inspection of the black and white background booths found in manual inspection, allowing for the throughput of high volumes. However, how does the semi-automatic inspection fit into the validation process and allow validation at the relevant levels?

Crush Defects: The Power of Semi-Automatic Inspection

Validation of such semi-automatic inspection must adhere to the United States Pharmacopeia (USP). The following chapters from the USP are regarded as the main literature and source for regulatory information surrounding the visual inspection of injectables:

Chapter 〈790〉 VISIBLE PARTICULATES IN INJECTIONS
Chapter 〈1790〉 VISUAL INSPECTION OF INJECTIONS
Chapter 〈788〉 PARTICULATE MATTER IN INJECTIONS

Crush Defects: The Power of Semi-Automatic Inspection

Chapter 〈790〉 establishes the expectation that each unit of injectable product will be inspected as part of the routine manufacturing process. This inspection should take place at a point when defects are most easily detected; for example, prior to labelling or insertion into a device or combination product. Semi¬automated inspection should only be performed by trained, qualified inspectors. The intent of this inspection is to detect and remove any observed defect. When in doubt, units should be removed

Crush Defects: The Power of Semi-Automatic Inspection

Defect Types

IVS semi-automatic inspection machines with operators allow for the inspection of cosmetic defects in the container and particulate matter within the fluid. The machines will enable the inspection of the following defects:

Cosmetic Defects:
• Glass cracks
• Scratches
• Missing stoppers/caps
• Improper cap/stopper closure
• Glass inclusions

Crush Defects: The Power of Semi-Automatic Inspection

Particulate Matter:
• Fibers
• Glass
• Metal
• Product Related
• Rubber

Crush Defects: The Power of Semi-Automatic Inspection

What are the particle definitions which apply to Semi-Automatic Inspection?

Extrinsic – Highest risk
Particles may originate from many sources. Those that are foreign to the manufacturing process are considered exogenous or “extrinsic” in origin; these include hair, non-process-related fibres, starch, minerals, insect parts, and similar inorganic and organic materials. Extrinsic material is generally a one-time occurrence and should result in the rejection of the affected container in which it is seen; however, elevated levels in the lot may implicate a broader contribution from the same source. These particles may carry an increased risk of microbiological or extractable contamination because less is known about their path before deposition in the product container or their interaction with the product.

Intrinsic – Medium Risk
Other particles are considered “intrinsic”, from within the process. Intrinsic particles may come from processing equipment or primary packaging materials that were either added during processing or not removed during container preparation. These primary product-contact materials may include stainless steel, seals, gaskets, packaging glass and elastomers, fluid transport tubing, and silicone lubricant. Such particles still pose the risk of a foreign body, but generally come from sterile or sanitized materials and more is known about their interactions when in contact with the product.

Inherent- Lower Risk
“Inherent” particles are considered the lowest risk as they are known to be or intended to be associated with specific product formulations. The physical form or nature of inherent particles varies from product to product and includes solutions, suspensions, emulsions, and other drug delivery systems that are designed as particle assemblies (agglomerates, aggregates). Product formulation-related particulate formation should be studied in the development phase and in samples placed on stability to determine the normal characteristics and time-based changes that can occur.

Defects are commonly grouped into classifications based on patient and compliance risk. The most common system uses three groups: critical, major, and minor. Critical defects are those that may cause serious adverse reaction or death of the patient if the product is used. This classification includes any nonconformity that compromises the integrity of the container and thereby risks microbiological contamination of the sterile product. Major defects carry the risk of a temporary impairment or medically reversible reaction, or involve a remote probability of a serious adverse reaction. This classification is also assigned to any defect which causes impairment to the use of the product. These may result in a malfunction that makes the product unusable. Minor defects do not impact product performance or compliance; they are often cosmetic in nature, affecting only product appearance or pharmaceutical elegance.

Crush Defects: The Power of Semi-Automatic Inspection

Inspection criteria

On semi-automatic inspection machines, the vials are spun up at speed prior to reaching the inspection area. This sets any visible particles in motion which aids in detection as stationary particles will be difficult to detect. Upon 100% inspection, visible extrinsic and intrinsic particles should be reliably removed. The test method allows inherent particles to be accepted if the product appearance specification allows inherent particle types. The size of particles reliably detected (2′::70% probability of detection) is generally 150 µm or larger. This Probability of Detection (POD) is dependent on the container characteristics (e.g., size, shape, transparency), inspection conditions (lighting and duration), formulation characteristics (colour and clarity), and particle characteristics (size, shape, colour, and density). For syringes the products are agitated and turned over so that no particulate matter is left in the bung and can be seen.

Crush Defects: The Power of Semi-Automatic Inspection

Critical Inspection Conditions

Light intensity
The results of the inspection process are influenced by the intensity of the light in the inspection zone. In general, increasing the intensity of the light that illuminates the container being inspected will improve inspection performance; 〈790〉 recommends light levels of 2,000-3,750 lux at the point of inspection for routine inspection of clear glass containers. Special attention should be given to assure that inspection is not performed below the lower limit of 2,000 lux.

Background and Contrast
Contrast between the defect of interest and the surrounding background is required for detection, and increased contrast improves detection. The use of both black and white backgrounds is described in 〈790〉, as well as other global pharmacopoeias. The use of both backgrounds provides good contrast for a wide range of particulate and container defects, which can be light or dark in appearance.

Inspection Rate
This is controlled by the roller travel speed. Sufficient time must be provided to allow for thorough inspection of each container; chapter 〈790〉 specifies a reference time of 10 s/container (5s each against both black and white backgrounds).

Magnification
Some inspection processes use a large magnifier to increase image size and thus increase the probability of detecting and rejecting containers with defects near the threshold of detection. Most lenses used during this inspection process are around X2 magnification.

Crush Defects: The Power of Semi-Automatic Inspection

Overall, Semi-Automatic Inspection is a necessary step when pharmaceutical manufacturers move into medium-volume production. Validating such systems allows production to ramp up to the required volume without the need for manual benches and provides capacity for future volumes before fully automated vision inspection with vision systems. More details on how to use Semi-Automatic inspection for regulatory compliance can be found here.

Machine vision: The key to safer, smarter medical devices

Posted on

In this month’s blog, we are discussing the highly regulated field of medical device manufacturing, where precision and compliance are not just desirable—they are mandatory. The growth of the medical devices industry means there have been substantial advances in the manufacturing of more complex devices. The complexity of these products demands high-end technology to ensure each product is of the correct quality for human use, so what’s the key to producing safer, smarter medical devices? Machine vision is one of the most important technologies that allow for the achievement of precision and compliance within the required regulations. In this article, we will touch on the aspect of machine vision in medical device manufacturing and its role in ensuring precision while serving regulatory compliance.

How Machine Vision Works in Manufacturing

Machine vision (often referred to in a factory context as industrial vision or vision systems) uses imaging techniques and software implementation to perform visual inspections on the manufacturing line for many applications where quality control inspection is required at speed. Using cameras, sensors, and complex algorithms—Visual Perception allows machines to develop a sense of sight by capturing images with the camera(s) and processing them in order to enable decision-making from visual data.

When it comes to the medical device manufacturing process, machine vision systems play a vital role in ensuring the highest levels of precision and quality. Examples include systems that can detect the smallest imperfections, measure components with sub-micron precision, and confirm every product is produced to the tightest of tolerances—all automatically.

The Significance of Medical Device Manufacturing Accuracy

Surgical instruments, injectable insulin pens, contact lenses, asthma devices and medical syringes all need high-precision manufacturing, and this is due to several reasons. The devices not only involve patient health and safety but also must be produced at a legal level, to validated specifications. Even tiny damage or a slight deviation from those specifications can lead to the collapse of these products and hence impact human life. The drive towards miniaturisation in medical devices means that more precise parts have to be manufactured than ever before. With devices getting smaller (miniaturisation) and more complex, the margin for error decreases, hence making precision even more critical.

Machine vision systems can easily maintain precision at these levels due to the precise resolution they run at. The vision systems can use advanced imaging techniques, such as 3D vision, to measure dimensions, check alignments, and verify components are manufactured within tolerance. It makes a quality-assurance check on every unit as it comes off the assembly line to prevent defects and recalls later down the line.

Meeting Compliance Regulations

The medical device industry is heavily regulated by organizations like the FDA (Food and Drug Administration) in the United States, European Medicines Agency (EMA), and other national and international bodies that set relevant standards. Regulations govern every dimension of device manufacture, from design and production to testing and distribution.

The Current Good Manufacturing Practice (CGMP) regulations issued by the FDA draw attention to quality requirements needed throughout the manufacturing process. Machine vision systems can automatically inspect components and end products according to specifications, allowing manufacturers to validate to the relevant regulations.

Machine vision systems can produce extremely stringent inspection records with the traceability required to prove compliance against established regulatory standards. This is crucial specifically for audit purposes; if needed, manufacturers must be able to show evidence that their product was manufactured according to regulations.

Using Machine Vision in the Medical Devices Production

Each of these stages using Machine Vision to ensure precision-orientation compliance with the final product. A few of the main uses are:
• Surface Inspection: Vision systems can detect scratches, cracks, and foreign material present on the surface during the manufacturing process, which may lead to a device failure in operation.
• Dimensional Measurement: Vision metrology is used for measuring component dimensions to ensure they meet design specifications.
• Assembly Verification: Machine vision ensures that components are assembled correctly, reducing defect risk from the assembly process.
• Label Verification: Understanding which label goes on which batch is essential for compliance. Machine vision systems can inspect that labels are properly positioned and the writing on them is accurate.
• Packaging Inspection: Proper packaging ensures that devices remain sterile and protected while in transit. Machine vision systems ensure that packaging is not defective and is properly sealed.
• Code Reading: Machine vision systems check and verify datamatrix & barcodes on products and packaging to maintain correct product identification throughout the supply chain.

Optimising Efficiency and Lowering Costs

The machine vision system has more benefits and is likely to improve manufacturing not only in a precise manner but also with strict compliance while increasing the efficiency of manufacturing, resulting in reduced costs. This will help speed up the throughput from these systems, where automated inspection and measurement can be done much faster and more consistently than a team of human inspectors.

Machine vision products also reduce human error, which could cost in relation to medical device manufacturing. Where a simple mistake can cause the manufacturer to recall defective products, leading them to legal lawsuits and damaging their reputation. Catching defects early can help to minimise these risks and costs, which is why machine vision offers such a huge benefit.

Manufacturers can also use inspection data to analyse trends and uncover underlying issues before they lead to defects, allowing for higher uptime with preventative maintenance of the lines.

Future Trends in Medical Device Manufacturing and Machine Vision

As technology advances, the function of machine vision systems will continue to develop in medical device manufacturing. Here are some of the likely trends we can expect to see over time.
• Integration of Artificial Intelligence (AI) with Machine Vision Systems: AI and machine learning are increasingly incorporated into machine vision systems, further advancing image analysis and pattern recognition. This will enable even greater precision and the possibility of detecting less visible imperfections that conventional vision systems might overlook.
• 3D Vision: Where 2D vision systems are traditionally used, the third dimension is being used more. Due to cross-verification, 3D vision systems provide a complete view of the components (compared to a single-plane 2D view), offering better measurement and inspection capabilities over complex shapes and assemblies.
• High-Speed Vision Systems: The push for higher-speed vision systems goes hand in hand with the increased manufacturing speeds being implemented today, and the higher speeds of machines increase demand for accurate inspection.
• Edge Computing: With the advent of edge computing, machine vision systems can process data locally with greater power and accuracy to eliminate latency for real-time decisions. This is crucial in applications that need instant feedback to change the manufacturing process.

Conclusion

Medical device manufacturing can be significantly enhanced with the incorporation of machine vision that provides superior levels of precision and compliance. For manufacturers, it also ensures compliance with rigorous regulatory needs by automating inspections and measurements with machine vision systems. While still advancing, the necessity of machine vision in this industry is only likely to become more critical as time goes on and improvements are made in efficiency, accuracy, and overall manufacturing quality.

How to boost AI machine vision systems

Posted on

Artificial Intelligence (AI) machine vision continues to develop, and using AI deep learning (DL) in automated machine vision inspection has become a valid option in those applications where clear trends, learning, and data are available for process inspection. We continue to see strong growth in the use of AI vision systems. But at what point is a decision made on which machine vision process is best for the application deployment, and when should you boost your machine vision inspection to include an element of 100% AI deep learning inspection? And how do you improve and continue to turbo-charge your AI inspection.

Let’s drill down on what we need to apply AI machine vision. To capture training data, we need a consistent setup with known samples to capture a whole series of images. High-resolution images can capture more details, which can significantly improve the accuracy of the vision system. We need images for training the AI classifier engine, images to test the classifier within the training process, and finally, a set of unseen images to confirm the trained classifier is working as it should be. Some applications are naturally more akin to AI machine vision – such as surface inspection, surface anomalies, or subtle changes to a product’s appearance.

This differs from applications that require specific data to be calculated, such as automated gauging and metrology, where particular parts need to be measured with a vision system to an exact tolerance; this is not an application suited or achievable with AI vision systems (as no such data is available from the AI classifier).

We should also be mindful of how the production systems can be deployed. As AI requires a dataset to train and work with in many cases, the system will need to be installed and images captured from the live system before a determination can be made if AI machine vision is applicable in this case. For example, in medical device and pharmaceutical applications, this is difficult, as the solution needs to be proven and validation paperwork completed before the final installation qualification, and it’s hard to validate an AI model. But in other application areas cameras can be installed and images captured as part of the installation process. Always remember the Pros and Cons of Artificial Intelligence in machine vision.

How can we boost the AI machine vision algorithm?

The first step in boosting the AI machine vision algorithm involves showing new images, more deviations from the normal, and selecting the ability to account for skew, changes in size, and overall deviation of the image. So, it’s important to make the most out of the available data by using data augmentation techniques. This includes rotating, flipping, scaling, and adding noise to the images. Data augmentation increases the diversity of the training data without needing to collect new images, which helps prevent overfitting and improves the generalisation capabilities of the AI model.

It’s important to ensure that your dataset represents the real-world scenarios your machine vision system will encounter. A balanced dataset that includes various angles, lighting conditions, and object variations is crucial for training a robust AI model. Including diverse examples helps avoid biases and makes the system more adaptable and accurate.

It’s important to ensure all elements are handled, so all versions of the reject are known and seen. The classifier will still flag those parts with deviations it has not seen before, but you can boost the AI by providing it with more data to work with. However, there is a trade-off between the time needed to retrain the classifier on a decent GPU PC and the boost you can give to the AI machine vision calculation. It’s best to utilise hardware accelerators like GPUs, TPUs, or FPGAs to speed up the training and inference of the machine vision AI models.

In general, the more data the AI has and the larger the network, the more accurate the analysis will be. Implementing a methodology for continuous integration and deployment (CI/CD) to streamline updating models in production is crucial.

Another way to boost the AI machine vision system is to combine its functionality with traditional machine vision algorithms. We do this often, knowing AI is not a panacea for all application needs. So, use an algorithm, for example, to find specific error states, and then use an AI classification to drill down on ambiguous or hard-to-spot surface/defect deviations.

Continuous Monitoring and Updating of the AI vision system

It’s extremely important to regularly monitor the performance of a machine vision system in production. We generally set up automated systems to track key performance metrics and detect any degradation in performance over time. Continuous monitoring allows timely interventions and updates to maintain the AI model’s high accuracy and reliability. Remember, the environment in which machine vision systems operate can change over time. Periodically update your models with new data to stay accurate and relevant.

Boosting AI machine vision systems involves a holistic approach that includes enhancing data quality, utilising advanced algorithms, ensuring real-time processing capabilities, and implementing robust preprocessing and postprocessing techniques. Additionally, focusing on robustness, generalisation, and continuous monitoring ensures that the system remains accurate and reliable. By following these strategies, you can significantly improve and boost the performance and applicability of your AI machine vision systems, unlocking their full potential across many industry sectors and strengthening their use in industrial automation.

Artificial Intelligence (AI) machine vision

The magic behind machine vision: Clever use of optics and mirrors

Posted on

Sometimes, we’re tasked with some of the most complex machine vision and automated inspection tasks. In addition to our standard off-the-shelf solutions in the medical device, pharmaceutical, and automotive markets, we often get involved with the development of new applications for machine vision inspection. Usually, this consists of adapting our standard solutions to a client’s specific application requirement. A standard machine vision camera or system cannot be applied due to either the complexity of the inspection requirements, the mechanical handling, part surface condition, cycle time needs or simply the limitation to how the part can be presented to the vision system. Something new is needed.

This complex issue is often discussed in customer and engineering meetings, and the IVS engineering team often has to think outside the box and perhaps use some “magic”! This is when the optics (machine vision lenses) need to be used in a unique way to achieve the desired result. This can be done in several ways, typically combining optical components, mirrors, and lighting.

So what optics and lenses are used in machine vision?
The primary function of any lens is to collect light scattered by an object and reproduce a picture of the object on a light-sensitive ‘sensor’ (often CCD or CMOS-based); this is the machine vision camera head. The image captured is then used for high-speed industrial image processing. When selecting optics, several parameters must be considered, including the area to be imaged (field of view), the thickness of the object or features of interest (depth of field), the lens-to-object distance (working distance), the intensity of light, the optics type (e.g. telecentric), and so on.

Therefore, the following fundamental parameters must be evaluated in optics.
Field of View (FoV) is the entire area the lens can see and image on the camera sensor.
Working distance (WD) is the distance between the object and the lens at which the image is in the sharpest focus.
Depth of Field (DoF) is the maximum range over which an object seems to be in acceptable focus.
In addition, the vision system magnification (ratio of sensor size to field-of-view) and resolution (the shortest distance between two points that can still be distinguished as separate points) must also be appraised.

But what if the direct line of the site cannot be seen due to a limitation in the presentation or space available? This is when the magic happens. Optical path planning is used to understand the camera position (or cameras) relative to the part and angle of view required. Combining a set of mirrors in the line of site makes it possible to see over a longer working distance than possible without. The same parameters apply (FoV, WD, DoF etc), but a long optical path can be folded with mirrors to fit into a more compact space. This optical path can be folded multiple times using several mirrors to provide one continuous view through a long path. Cameras can also be mounted closely with several mirrored views to offer a 360-degree view of the product. This is especially true in smaller product inspections like pill or tablet vision inspection checks. Multiple mirrors allow all sides and angles of the pill to be seen, providing a comprehensive automated inspection for surface defects and imperfections for such applications. This technique is also applied in the subtle art of needle tip inspection (in medical syringes) using vision systems, with mirror systems to allow for a complete view of the tip from all angles, sometimes providing a single image with two views of the same product. The optical paths, the effect of specific machine vision lighting and the mechanical design must all be considered to create the most robust solution.

So when our engineers say they will be using “magic” optics, I no longer look for a wand to be waved but know that a very clever application of optics and mirrors will be designed to provide a robust solution for the automated vision system task at hand.

Why industrial vision systems are replacing operators in factory automation (and what they aren’t doing!)

Posted on

This month, we’re following on from last month’s post.
We’ve all seen films showing the dystopian factory landscape a few hundred years in the future. Flying cars against a grey backdrop of industrial scenery. Robots serving customers at a fictitious future bar, and probably – if they showed a production line, it would be full of automatons and robots. We will drill down on the role that industrial vision systems can have on the real factory production line. Is it the case that in the future, all production processes will be replaced with automated assembly, coupled with real-time quality inspection? Intelligent robots which can handle every production process?

Let’s start with what’s happening now, today. It’s certainly the case that machine vision has developed rapidly over the last thirty years. We’ve gone from slow scientific image processing on a 386 computer (look it up!) to AI deep learning running at hundreds of frames per second to allow the real-time computation and assessment of an image in computer vision. But this doesn’t mean that every process has (or can be) replaced with industrial vision systems, but what’s stopping it from being so?

Well, the main barrier to this is the replication of the human dexterity and ability to manoeuvre the product in delicate (compared to an industrial automated process) ways. In tandem with this is the ability for a human to immediately switch to a different product mix, size and type of product. So you could have a human operator construct a simple bearing in a matter of seconds, inspect it – and then ask them to build next a completely different product, such as a small medical device. With some training and show how, this information exchange can be done and the human operator adapts immediately. But a robot would struggle. Not to say it couldn’t be done, but with today’s technology, it takes effort. This is the goal of Industry 5.0, the next step generation from Industry 4.0 flexible manufacturing. Industry 5.0 is a human-centric approach, so industry understanding that humans working in tandem with robotics, vision, and automation is the best approach.

So we need to look at industrial vision in the context of not just whether the image processing can be completed (be it with traditional algorithms or AI deep learning), but also how we can present the product meaningfully at the correct angles to assess it. Usually, these vision inspection checks are part and parcel with an assembly operation, which requires specific handling and movement (which a human is good at). This is the reason most adoption of machine vision happens on high throughput, low variation manufacturing lines – such as large-scale medical device production where the same product is validated and will be manufactured in the same way over many years. This makes sense – the payback is there and automation can be applied for assembly and inspection in one.

But what are the drivers for replacing people on production lines with automated vision inspection?
If the task can be done with automation and vision inspection, it makes sense to do it. Vision inspection is highly accurate, works at speed and is easy to maintain. Then there are the comparisons comparing the processes to a human operator. Vision systems don’t take breaks, don’t get tired, and robots don’t go to parties (I’ve never seen a robot at a party) – so they don’t start work in the morning with their minds not on the task at hand! So, it makes sense to move towards automated machine vision inspection wherever possible in a production process, and this represents huge growth in the adoption of industrial vision systems in the coming years.

If the job is highly complex in terms of intricate build, with many parts and variants, then robots, automation and vision systems are not so easy to deploy. However, with the promise of Industry 5.0, we have the template of the future – moving towards an appreciation of including the human operator in factory automation – combining humans with robots, automation, augmented reality, AI and automated inspection. So, the dystopian future might not be as bad as the filmmakers make out, with human operators still being an integral part of the production process.

Catalysts of change: How robots, machine vision and AI are changing the automotive manufacturing landscape

Posted on

This month, we are discussing the technological and cultural shift in the automotive manufacturing environment caused by the advent of robotics and machine vision, coupled with the development of AI vision systems. We also drill down on the drivers of change and how augmented reality will shape the future of manufacturing technology for automotive production.

Robots in Manufacturing
Robots in manufacturing have been used for over sixty years, with the first commercial robots used in mass production in the 1960s – these were leviathans with large, unwieldy pneumatic arms, but they paved the way for what was to come in the 1970s. At this time, it was estimated that the USA had 200 such robots [1] used in manufacturing; by 1980, this was 4,000 – and now there are estimated to be more than 3 million robots in operation [2]. During this time the machine vision industry has grown to provide the “eyes” for the robot. Machine vision uses camera sensor technology to capture images from the environment for analysis to confirm either location (when it comes to robot feedback), quality assessment (from presence verification through to gauging checks) or simply for photo capture for warranty protection.

The automotive industry is a large user of mass-production robots and vision systems. This is primarily due to the overall size of the end unit (i.e. a built car), along with vision systems for confirmation of quality due to the acceptable parts per million failure rate (which is extremely low!). Robots allow repetitive and precise assembly tasks to be completed accurately every time, reducing the need for manual labour and providing a faster speed for manufacturing.

Automating with industrial robots is one of the most effective ways to reduce automotive manufacturing expenses. Factory robots help reduce labour, material, and utility expenses. Robotic automation reduces human involvement in manufacturing, lowering wages, benefits, and worker injury claims.

AI Machine Vision Systems
Deep learning in the context of industrial machine vision teaches robots and machines to do what comes naturally to humans, i.e. to learn by example. New multi-layered “bio-inspired” deep neural networks allow the latest machine vision solutions to mimic the human brain activity in learning a task, thus allowing vision systems to recognise images, perceive trends and understand subtle changes in images that represent defects. [3]

Machine vision performs well at quantitatively measuring a highly structured scene with a consistent camera resolution, optics and lighting. Deep learning can handle defect variations that require an understanding of the tolerable deviations from the control medium, for example, where there are changes in texture, lighting, shading or distortion in the image. Deep-learning vision systems can be used in surface inspection, object recognition, component detection and part identification. AI deep learning helps in situations where traditional machine vision may struggle, such as parts with varying size, shape, contrast and brightness due to production and process constraints.

Augmented Reality in Production Environments
In industrial manufacturing, machine vision is primarily concerned with quality control, which is the automatic visual identification of a component, product, or subassembly to ensure that it is proper. This can refer to measurement, the presence of an object, reading a code, or verifying a print. Combining augmented, mixed reality with automated machine vision operations creates a platform for increased efficiency. There is a shift towards utilising AI machine vision systems (where applicable!) to improve the reliability of some quality control checks in vision systems. Then, combine that assessment with the operator.

Consider an operator or assembly worker sitting in front of a workstation wearing wearable technology like the HoloLens or Apple Vision Pro (an augmented reality headset). An operator could be putting together a sophisticated unit with several pieces. They can see the tangible objects around them, including components and assemblies. They can still interact with digital content, such as a shared document that updates in real time to the cloud or assembly instructions. That is essentially the promise of mixed reality.

The mixed-reality device uses animated prompts, 3D projections, and instructions to guide the operator through the process. A machine vision camera is situated above the operator, providing a view of the scene below. As each step is completed and a part is assembled, the vision system automatically inspects the product. Pass and fail criteria can be automatically projected into the operator’s field of sight in the mixed reality environment, allowing them to continue building while knowing the part has been inspected. In the event of a rejected part, the operator receives a new sequence “beamed” into their projection, containing instructions on how to proceed with the failed assembly and where to place it. When integrated with machine vision inspection, mixed reality has become a standard aspect of the production process. Data, statistics, and important quality information from the machine vision system are shown in real time in the operator’s field of view.

Robots, AI Vision Systems and Augmented Reality
Let’s fast forward a few years and see what the future looks like. Well, it’s a combination of all these technologies as they continue to develop and mature. So AI vision systems mounted on cobots help with the manual assembly, while the operator wears an augmented reality headset to direct and guide the process for an unskilled worker. Workers are tracked while all tasks are being quality assessed and confirmed, while data is stored for traceability and warranty protection.

In direct automotive manufacturing, vision systems will become easier to use as large AI deep-learning datasets become more available for specific quality control tasks. These datasets will continue to evolve as more automotive and tier one and two suppliers use AI vision to monitor their production, allowing quicker deployment and high-accuracy quality control assessment across the factory floor.


References