Reading view

There are new articles available, click to refresh the page.

Pharmaceutical Production with AI-Powered Process Monitoring

Hardware: reServer Industrial J4012, powered by NVIDIA Jetson Orin NX 16GB

Use Case Provider: NeuroSYS

Application: Abnormal Detection in Production Line

Industrial: Pharmaceutical

Deployment Location: Norway

A global pharmaceutical company sought to enhance the efficiency and accuracy of its production process by integrating advanced AI technologies. Their challenge was to detect anomalies, such as tipped vials on conveyor belts, without disrupting existing workflows or requiring extensive reconfiguration of equipment. That’s how the whole solution got started, combining Seeed reServer Industrial J4012 edge device with NeuroSYS AI software platform together to deliver an innovative solution, transforming their production monitoring with an AI-enabled camera system.

Background

Pharmaceutical production lines often handle vials of varying materials (plastic and glass) and capacities (7 to 100 ml), totaling seven distinct types. Traditionally, the process relied on manual tuning of sensors and equipment reconfiguration for each vial type. These limitations resulted in inefficiencies and downtime, especially when tipped vials reached the filling machine.

The company required a versatile solution to address this challenge—one capable of real-time anomaly detection and performance monitoring while minimizing physical intervention.

Initial Challenge

The key challenges included:

  • Detecting tipped vials on a moving conveyor belt.
  • Minimizing false alarms caused by obstructions or unanticipated scenarios.
  • Ensuring the system can adapt to various vial types without retooling machinery.
  • Developing a scalable, non-intrusive solution that could integrate seamlessly with existing workflows.

Solution

The whole system implemented an advanced vision AI pipeline leveraging a combination of industrial hardware and AI-driven software.

Components

  1. Hardware: An industrial-grade camera integrated with the reServer industrial J4012 edge computing unit, powered by NVIDIA Jetson Orin NX 16GB.
  2. Software: Machine learning models trained on production data to detect anomalies and gather insights.
  3. Dashboard: Custom visualizations for real-time monitoring and historical analysis.

Implementation Process

  1. Optimized Setup:
    • The camera and lens were calibrated to capture high-quality images of vials as they moved along the conveyor belt.
    • During the Proof of Concept (PoC) stage, the system operated behind a plastic curtain to validate functionality without disrupting production.
  2. Real-Time Analysis:
    • Frames captured by the camera were processed on the reServer Jetson device in real-time using convolutional neural networks (CNNs).
    • The system determined vial positions (standing or tipped) and triggered alerts for anomalies.
  3. Data Processing and Visualization:
    • Data was stored in a local database and visualized on dashboards, providing insights into machine performance.
    • A vial counting module tracked both standing and tipped vials for statistical analysis.
  4. Enhanced Alert Mechanisms:
    • Detection of a tipped vial activated a signal tower with visual (light) and auditory (buzzer) alerts.

Challenges Encountered During Implementation

During implementation, the system faced challenges to meet the specific deployment scenarios. for example, there could be some false alarms happening which are caused by operator hands entering the camera’s field of view, it’s finally optimized by retraining the machine learning model with additional obstructed images which includes obstructions. Sometimes the vials getting stuck or tipped at curved conveyor segments could be misclassified, and the dataset gaps that overlooked scenarios involving occlusions and bends. These issues were all addressed by enriching the dataset to improve robustness, ensuring accurate performance in diverse conditions.

Results and Achievements

The system delivered remarkable results, transforming the client’s production process:

  1. Anomaly Detection: Achieved 99.89% accuracy in detecting tipped vials, regardless of material or capacity.
  2. Downtime Monitoring: Enabled precise downtime tracking, counting delays after 10 seconds of no vial movement.
  3. Statistical Insights:
    • Counted tipped vials for quality monitoring and standing vials to assess machine efficiency.
    • Provided metrics for machine cycle optimization.
  4. Scalability:
    • The same hardware setup was enhanced with new functionalities, requiring only software updates.
    • Features like snapshot saving of anomalies allowed for deeper analysis of system performance and false positives.

Additional Benefits

  • Flexibility: Eliminated the need for retooling and physical modifications by enabling remote software updates.
  • Future-Proofing: New scenarios and events can be incorporated into the model as they occur, ensuring continuous improvement.
  • Scalable Solution: With minimal hardware adjustments, the system can evolve to handle additional tasks or integrate with advanced analytics platforms.

This project showcases the transformative potential of AI in industrial automation, setting the stage for smarter and more efficient manufacturing processes. The reServer Jetson edge device not only addressed the pharmaceutical company’s immediate challenges but also provided a robust platform for continuous innovation. By leveraging the Jetson edge vision AI technology, the client gained real-time anomaly detection, improved machine efficiency, and actionable insights into their production process—all while reducing manual intervention and hardware dependency.

By implementing this solution, the client not only resolved their immediate challenges but also gained a robust and scalable system for ongoing innovation and operational excellence.


Seeed NVIDIA Jetson Ecosystem

Seeed is an Elite partner for edge AI in the NVIDIA Partner Network. Explore more carrier boards, full system devices, customization services, use cases, and developer tools on Seeed’s NVIDIA Jetson ecosystem page.

Join the forefront of AI innovation with us! Harness the power of cutting-edge hardware and technology to revolutionize the deployment of machine learning in the real world across industries. Be a part of our mission to provide developers and enterprises with the best ML solutions available. Check out our successful case study catalog to discover more edge AI possibilities!

Discover infinite computer vision application possibilities through our vision AI resource hub!

Take the first step and send us an email at edgeai@seeed.cc to become a part of this exciting journey! 

Download our latest Jetson Catalog to find one option that suits you well. If you can’t find the off-the-shelf Jetson hardware solution for your needs, please check out our customization services, and submit a new product inquiry to us at odm@seeed.cc for evaluation.

The post Pharmaceutical Production with AI-Powered Process Monitoring appeared first on Latest Open Tech From Seeed.

2024 reCamera reCap – AI Camera Growing on the Way

Dear All,

It’s been four months since our tiny AI superstar, reCamera, first stepped into the spotlight among our developer community. From its humble beginnings to the milestones we’ve achieved together, reCamera has become the trusted companion, continually inspiring creativity and innovation in edge AI and robotics. Now, as we look back at the journey so far, it’s the perfect moment to revisit how it all started, celebrate the progress we’ve made, and explore the exciting possibilities that await in the next chapter!

Have you heard about reCamera? What makes it unique?

reCamera comes with its processor and camera sensor. It’s the first open-source, tiny AI camera, programmable and customized, powered by an RISC-V SoC, delivering 1TOPS AI performance with video encoding 5MP@30fps. The modular hardware design gives you freedom to change various camera sensors and diverse interfaces baseboard as requirement, offering the most versitile platform for developers tackling vision AI systems.

Hardware checking list

  • Core board: CPU, RAM, 8GB/64GB eMMC, and wireless module as customized antenna on-board
  • Sensor board: currently compatible with OV5647/IMX335/SC130GS camera sensor, and continuously supporting more on the list, along with other sensors: mic, speaker, actuator, LED.
  • Base board: determines the communication ports at reCamera’s bottom, we have USB2.0, ethernet, and serial port by default, open to be customized as you want – PoE/CAN/RS485/Display/Gyro/Type-C/vertical Type-C, etc.
  • Core board covering by metal mainframe, along with the rubber ring wrapped inside the grooves for waterproofing and excellent temperature maintainance below 50℃.

OS & Dashboard

Well, the very first and important impression you should get from reCamera is that it’s already a computer. We set up the build root system, a lightweight customized Linux system in multi-thread, running all tasks without worrying about the conflicts. It supports Python and Node.js directly from console. You can also easily deploy the compiled executive files from C/Rust, so, very programming-friendly.

Just in case you’d prefer to forget about all programming scripts and complex configurations 🙂 we’ve pre-built Node-RED integration for you, to build up your whole workflow in NO-CODE. It’s completely simple to start by choosing the customized nodes for reCamera pipeline, linking each other to call the camera API, and using the NPU to load AI models directly onto the device. Finally, a web UI or mobile dashboard could show up seamlessly and help verify results effortlessly.

So far, what we’ve done

Ultralytics & reCamera

Besides the standard reCamera as a standalone device only with hardware combination and Node-RED integration, we also provide you another option that can be more seamless to build your vision AI project – reCamera pre-installed with Ultralytics YOLO11 model (YOLO11n)! It comes with the native support and licensing for Ultralytics YOLO, offering real-world solutions such as object counting, heatmap, blurring, and security systems, enhancing efficiency and accuracy in diverse industries.

Application demos

1. reCamera voice control gimbal: we used Llama3 and LLaVA deployed on reComputer Jetson Orin. The whole setup is fully local, reading live video streamed from reCamera to get the basic perception of the current situation, and delivering instructions through Jetson “brain” thinking. Now, you can ask reCamera to turn left to check how many people are there and describe what it sees!

2. reCamera with Wi-Fi HaLow: We’ve tested reCamera with Wi-Fi HaLow long-range connectivity, linear distance could be up to 1km in stable!

3. Live-check reCamera detecting results through any browser: With pre-built Node-RED for on-device workflow configuration, you can quickly build and modify your applications on it, and check out video streams with various platforms.

4. reCamera with LeRobot arm: We used reCamera to scan ArUco markers to identify specific objects and utilized the ROS architecture to control the robotic arm.

Milestone – ready to see you in the real world!

July: prototype in reCamera gimbal

August: First show up: in Seeed “Making Next Gadget” Livestream

September: Introduce reCamera to the world

October: unboxing

November: first batch shipping on the way

December: “gimbal” bells coming – reCamera gimbal alpha test

Where our reCamera has traveled

  • California, US – K-Hacks0.2 humanoid robotics hackathon 12/14-15
  • Shanghai, China – ROSCON China 2024 12/08
  • Barcelona, France – Smart City Expo World Congress 2024 11/05-07
  • California, US – MakerFaire Bay Area 10/18-20
  • Madrid, Spain – YOLO Vision 2024 09/27

Wiki & GitHub resources

Seeed Wiki:

Seeed GitHub:

Appreciate community contribution on reCamera resources from our Discord group:

Listen to users: upon Alpha Test reviews

Based on insights from the Alpha test and feedback during the official product launch, we’ve gained invaluable input from our developer community. Many of you have voiced specific requests, such as waterproofing the entire device, integrating NIR infrared, thermal imaging, and night vision camera sensors with reCamera. These features are crucial, and we’re committed to diving deeper into their development to bring them to life. Your enthusiasm and support mean the world to us—thank you for being part of this journey.

Some adorable moments~

In addition, we’ve selected four Alpha testers to explore fresh ideas and contribute to hardware iterations by trying out the reCamera gimbal. Stay tuned for our updates, and continue to join us as we embark on this exciting path of growth and innovation!

Warm Regards,

AI Robotics Team @ Seeed Studio

The post 2024 reCamera reCap – AI Camera Growing on the Way appeared first on Latest Open Tech From Seeed.

❌