❌

Reading view

There are new articles available, click to refresh the page.

ARMOR: Egocentric Perception for Humanoid Robot Powered by XIAO ESP32S3

✇Seeed
By: Kezang Loday

Daehwa Kim (Carnegie Mellon University), Mario Srouji, Chen Chen, and Jian Zhang (Apple) have developed ARMOR, an innovative egocentric perception hardware and software system for humanoid robots. By combining Seeed Studio XIAO ESP32S3-based wearable depth sensor networks and transformer-based policies, ARMOR tackles the challenges of collision avoidance and motion planning in dense environments. This system enhances spatial awareness and enables nimble and safe motion planning, outperforming traditional perception setups. ARMOR was deployed on the GR1 humanoid robot from Fourier Intelligence, showcasing its real-world applications.

[Source: Daehwa Kim]

Hardwares Used

ARMOR uses the following hardware components:

    • XIAO ESP32S3 microcontrollers: Efficiently collect sensor data and stream it to the robot’s onboard computer via I2C.
    • Onboard Computer: NVIDIA Jetson Xavier NX processes sensor inputs. 
    • GPU (NVIDIA GeForce RTX 4090): Handles ARMOR-Policy’s inference-time optimization for motion planning.
    • SparkFun VL53L5CX Time-of-Flight (ToF) lidar sensors: Distributed across the robot’s body for comprehensive point cloud perception.

How the ARMOR Works

The hardware solution of ARMOR’s egocentric perception system uses distributed ToF lidar sensor networks. Groups of four ToF sensors are connected to Seeed Studio XIAO ESP32S3 microcontrollers, capturing high-precision depth information from the environment. The XIAO ESP32S3 serves as a crucial intermediary controller, efficiently managing real-time sensor data transmission. It streams the collected depth data via USB to the robot’s onboard computer, the NVIDIA Jetson Xavier NX, which then wirelessly transmits the data to a powerful Linux machine equipped with an NVIDIA GeForce RTX 4090 GPU for data processing. This sophisticated data pipeline enables the creation of an occlusion-free point cloud around the humanoid robot, providing essential environmental awareness data for the ARMOR neural motion planning algorithm. The distributed and light-weight hardware setup also ensures enhanced spatial awareness and overcomes the limitations of head-mounted or external cameras, which often fail in cluttered or occluded environments.

Daehwa Kim, one of the core developers of this project, mentions why they selected the Seeed Studio XIAO for this project: “We might imagine a future where users easily plug and play with wearable sensors for humanoids and augment robots’ perceptions in various tasks. XIAO ESP32 series makes the wearable sensor system easily modularizable. We specifically adopted the XIAO ESP32S3 in ARMOR because of its powerful computing and tiny form factor.”

Armor Policy - Transformer-based policy [Source: Daehwa Kim]

The neural motion planning system, ARMOR-Policy, is built on a transformer-based architecture called the Action Chunking Transformer. This policy was trained on 86 hours of human motion data from the AMASS dataset using imitation learning. ARMOR-Policy processes the robot’s current state, goal positions, and sensor inputs to predict safe and efficient trajectories in real-time. The system leverages latent variables to explore multiple trajectory solutions during inference, ensuring flexibility and robustness.

Trained on 86 hours of human motion dataset [Source: Daehwa Kim]

ARMOR was rigorously tested in both simulated and real-world scenarios. It demonstrated remarkable improvements in performance, reducing collisions by 63.7% and increasing success rates by 78.7% compared to exocentric systems with dense head-mounted cameras. Additionally, the transformer-based ARMOR-Policy reduced computational latency by 26× compared to sampling-based motion planners like cuRobo, enabling efficient and nimble collision avoidance.

Real World Hardware Deployment [Source: Daehwa Kim]

Discover more about ARMOR

Want to explore ARMOR’s capabilities? The research team will soon release the source code, hardware details, and 3D CAD files on their GitHub repository. Dive deeper into this cutting-edge project by reading their paper on arXiv. Stay tuned for updates to replicate and innovate on this revolutionary approach to humanoid robot motion planning! To see ARMOR in action, check out their demonstration video on YouTube.

End Note

Hey community, we’re curating a monthly newsletter centering around the beloved Seeed Studio XIAO. If you want to stay up-to-date with:

🤖 Cool Projects from the Community to get inspiration and tutorials
📰 Product Updates: firmware update, new product spoiler
📖 Wiki Updates: new wikis + wiki contribution
📣 News: events, contests, and other community stuff

Please click the image below👇 to subscribe now!

The post ARMOR: Egocentric Perception for Humanoid Robot Powered by XIAO ESP32S3 appeared first on Latest Open Tech From Seeed.

💾

Let’s Type Cooler with KeebSupply Keyboards: Zilpzalp and GEIST TOTEM, Powered by Seeed Studio XIAO

✇Seeed
By: Kezang Loday

At KeebSupply, a passion for unique, high-quality mechanical keyboards has transformed a small hobby into a thriving business for Jakob, Conor, and Timur. Initially, Jakob and Conor’s tinkering led them to design a modest macropad in 2020, sparking a love for designing custom keyboards that’s only grown. Today, the KeebSupply team brings users thoughtful, meticulously crafted designs that balance simplicity with innovation, inviting keyboard enthusiasts of all skill levels to create and customize their perfect setup.

MacroPad image
Their very first 1337 MacroPad

With each product, KeebSupply aims to empower hobbyists and designers alike by creating versatile, customizable keyboards built around open-source principles. Collaborating with artists and designers in the mechanical keyboard community, the team develops products that support the DIY ethos, using quality materials and components while prioritizing accessibility.

Today, let’s dive into two of their very special innovations, Zilpzalp and GEIST TOTEM, to see how KeebSupply combines simplicity, community-driven design, and advanced tech with the tiny but powerful Seeed Studio XIAO controllers.

The Zilpzalp Keyboard: Compact, Portable, and Minimalist, Powered by XIAO RP2040


Source: KeebSupply

The Zilpzalp, designed by kilipan, brings a unique take to the unibody-split keyboard format. With just 28 keys, the Zilpzalp is a column-staggered keyboard that maintains the precision and functionality of a full-sized keyboard in a much smaller footprint. Its minimalist layout makes it a great choice for anyone prioritizing compactness without compromising on ergonomic features.

Central to the Zilpzalp’s design is the Seeed Studio XIAO RP2040 microcontroller, a compact yet powerful component that supports both QMK and ZMK firmware for wired and wireless configurations, respectively. The Zilpzalp offers various switch versions, including Choc and MX, with options for both hot-swap sockets and solder-only setups, so users can fully customize their tactile experience. Thanks to FOSS tools like KiCad and Ergogen, the keyboard’s PCB layout is open-source, inviting more customization options.

Source: KeebSupply

The Zilpzalp is ideal for minimalist enthusiasts who want a small, portable keyboard without sacrificing style or performance. Its compact nature makes it perfect for travelers, desk minimalists, and anyone looking to explore compact keyboards for the first time.

The GEIST TOTEM Keyboard: A Versatile, Ergonomic Split Design, Powered by XIAO nRF52840 and XIAO RP2040


Source: KeebSupply

GEIST TOTEM, a collaborative project between KeebSupply and designer GEIST, is a 38-key, column-staggered split keyboard designed with both comfort and flexibility in mind. TOTEM is a great fit for those who prefer a low-profile, ergonomic setup, as it comes with a split layout to help reduce strain on the fingers and wrists during long sessions.

The TOTEM kit comes in a wired and wireless variant. The wired version runs on the XIAO RP2040, while the wireless model uses the XIAO nRF52840 for seamless Bluetooth connectivity. Designed with beginners in mind, TOTEM includes pre-soldered diodes to streamline the assembly process. Each kit comes standard with a durable SLA 3D-printed black resin case, ensuring a sleek and sturdy build. For those seeking maximum convenience, a fully assembled kit option is also available, making it easy to dive into the world of custom keyboards.

GeistTotem img

Source: KeebSupply

It’s noteworthy that GEIST TOTEM won the first prize award in the Seeed Fusion DIY XIAO Mechanical Keyboard Contest back in 2022. It’s always exciting to see projects like this flourish in the community, thanks to KeebSupply.

The KeebSupply Experience

Whether you’re a DIY keyboard enthusiast or a newcomer to custom keyboards, KeebSupply’s Zilpzalp and TOTEM models bring something truly special to the table. These keyboards showcase the team’s commitment to accessible, high-quality designs, allowing users to personalize their typing experience fully. KeebSupply’s collaboration with designers like GEIST and kilipan reflects their passion for open-source designs and their support for the keyboard community.

For more about Zilpzalp, TOTEM, or any of KeebSupply’s projects, head over to their website.


More Info

End Note

Hey community, we’re curating a monthly newsletter centering around the beloved Seeed Studio XIAO. If you want to stay up-to-date with:

🤖 Cool Projects from the Community to get inspiration and tutorials
📰 Product Updates: firmware update, new product spoiler
📖 Wiki Updates: new wikis + wiki contribution
📣 News: events, contests, and other community stuff

Please click the image below👇 to subscribe now!


The post Let’s Type Cooler with KeebSupply Keyboards: Zilpzalp and GEIST TOTEM, Powered by Seeed Studio XIAO appeared first on Latest Open Tech From Seeed.

Upcoming Webinar – 8 Business Solutions Built with LoRaWAN and Low-Code IoT Platform

✇Seeed
By: Kezang Loday

Hey community, we’re excited to share that we’re speaking at a joint webinar, “8 Business Solutions Built with LoRaWAN and Low-Code IoT Platform,” hosted by Blynk and The Things Industries. Join us on Thursday, November 21st, at 10:00 AM EST / 4:00 PM CET for the insightful webinar, where you can explore how to combine LoRaWAN-enabled hardware with Blynk’s low-code IoT platform can help you quickly launch and scale IoT solutions that are practical, powerful, and easy to manage.

Blynk TTI Webinar poster

Why You Should Attend

Building an IoT solution doesn’t have to be complex. This webinar offers a step-by-step look into using off-the-shelf LoRaWAN hardware including our SenseCAP LoRaWAN devices (read on to explore), paired with Blynk’s intuitive platform, to create impactful IoT solutions without heavy coding or lengthy development time. Whether you’re an IoT beginner or looking to expand your current deployments, this session has everything you need to set your IoT solutions up for long-term success.

What You’ll Learn

In just one hour, you’ll gain insights from industry experts on:

    • Quickly deploy and manage IoT solutions using best-in-class LoRaWAN hardware.
    • Seamlessly provision and manage devices with Blynk’s low-code platform for faster setup and efficient data handling.
    • Visualize data through no-code web and mobile dashboards to easily monitor and control your devices.
    • Explore 8 game-changing IoT Solutions which are designed to solve specific business challenges, offering ready-to-deploy options that can scale as your business grows

This session is designed to empower you to take your IoT deployments from prototyping to enterprise scale effortlessly.

Discover 8 Game-Changing IoT Solutions for Business

The hosts, Pavlo and Felix together with 8 industry leaders from Thermokon Sensortechnik GmbH, Pepperl+Fuchs Group, Miromico, Seeed Studio, MOKO SMART, Milesight IoT, ATIM Radiocommunication, and Blues, will introduce eight proven IoT applications across various industries. Each solution is designed to solve a specific business challenge, offering ready-to-deploy options that can scale as your business grows. Here’s a sneak peek at what you’ll explore:

    • Smart heating for hotels 
    • Warehouse & production site solutions 
    • Building Management 
    • People Counting 
    • Personnel safety on construction site 
    • Water leak detection 
    • Smart metering 
    • Refrigerator fleet monitoring

During the webinar, our BD manager Violet Su will present our latest LoRaWAN solution with built-in Vision AI capabilities for efficient meter reading, person detection, people counting, object detection, and more. 

The solution is powered by SenseCAP A1102 Vision AI Sensor and SenseCAP S21000 LoRaWAN DTU. 

    • Built-in AI Camera: Local AI models for high-accuracy detection
    • Battery-Saving and Long Range LoRaWAN Connectivity: Perfect for various settings with range up to 10km
    • Industrial RS485 Support: Connect to your legacy LoRaWAN DTUs via RS485
    • Actionable Data: Integrated with Blynk’s low-code platform, making data easy to analyze and act on

Register Now

Don’t miss this opportunity to learn from the experts and bring your IoT ideas to life with LoRaWAN and low-code technology!

Mark your calendar for November 21st and take the next step in your IoT journey. We look forward to seeing you there!

The post Upcoming Webinar – 8 Business Solutions Built with LoRaWAN and Low-Code IoT Platform appeared first on Latest Open Tech From Seeed.

Transforming City Fountain Management with SenseCAP LoRaWAN Weather Monitoring-Based Automation in Slovakia

✇Seeed
By: Kezang Loday

The city of Trenčín in Slovakia has transformed the management of its iconic Vodnik fountain using IoT-powered automation, powered by the Helium LoRaWAN network. By deploying SenseCAP sensors and controllers, the team at Heliotics supported the city automating the fountain’s operation based on real-time weather data, ensuring optimal efficiency and resource conservation. The system allows for remote management, significantly reducing water and energy consumption while minimizing the need for manual intervention. This innovative solution demonstrates how IoT can modernize urban infrastructure and enhance sustainability efforts in smart cities.

  • Solution: IoTech automated the Vodnik fountain using a smart weather station and controller, powered by Helium LoRaWAN, for real-time weather data, remote management.
  • Industry: Smart City Solutions, IoT Automation
  • Solution Deployed in: Vodnik Fountain, Štúr Square, Trenčín, Slovakia

Trenčín, Slovakia, is a city rich in history and known for its picturesque landmarks, including the Vodnik fountain at Štúr Square. This iconic fountain draws tourists and locals alike, especially during the summer. However, managing its operation, especially during adverse weather conditions, has proven both challenging and costly for the city. Traditionally, city workers had to manually switch the fountain on and off, leading to inefficiencies, excess water consumption, and unnecessary energy use. The need for a more efficient, automated solution prompted the city to explore IoT technology to manage the fountain remotely.

Fountain
The Vodnik Fountain

Challenges

Traditional Fountains, like the Vodnik fountain, need to operate under specific conditions to maximize their aesthetic appeal while conserving resources. Ideal operational conditions include moderate temperatures, low wind speeds, and no rainfall, ensuring optimal visual impact without unnecessary water or energy wastage.

However, the manual operation process required city workers to visit the fountain, turn it off during storms or at night, and turn it back on under favorable conditions. This time-consuming method led to unnecessary resource use when immediate action was needed, and it relied heavily on weather forecasts and human intervention. Moreover, the risk of damage from freezing temperatures or water splashing during high winds presented further challenges, leading to increased maintenance costs and resource wastage.

The Vodnik Fountain

Solution

To address these issues, our partner Heliotics implemented a smart, IoT-powered solution for the city of Trenčín, leveraging the Helium LoRaWAN network and Heliotics CORE app. This system integrates a SenseCAP S1000 V2 10-in-1 Compact Weather Sensor and SenseCAP S2100 Data Logger for real-time monitoring of weather conditions, and a Milesight UC300 Controller for automation of the fountain’s operation. The weather station tracks key environmental factors like temperature, humidity, wind speed, and rainfall, while the controller is connected to the fountain’s main electrical system to manage its operation.

This solution automates the fountain’s on/off cycles based on predefined threshold values (e.g., low temperatures, high wind speeds, or heavy rainfall), ensuring optimal operation. The system’s logic follows a color-coded range (green for favorable conditions, yellow for caution, and red for shutoff), allowing the fountain to shut down automatically under poor weather conditions and restart when conditions improve—all in less than 10 seconds.

The system also features remote management capabilities via the Heliotics CORE app, enabling authorized personnel to monitor and control the fountain’s operation from any device. Alerts via SMS or email are sent in case of extreme weather or malfunction, allowing for real-time intervention if necessary.

SenseCAP Data Logger

Why SenseCAP and LoRaWAN?

The SenseCAP sensors were chosen for their ability to deliver reliable and real-time data in outdoor environments, crucial for the automation of the Vodnik fountain system. The SenseCAP S1000 V2 10-in-1 Compact Weather Sensor provides multi-parameter monitoring, collecting key environmental data such as temperature, humidity, wind speed, and rainfall to ensure the fountain operates under safe conditions. These sensors are durable, designed to withstand harsh weather without frequent maintenance, making them ideal for continuous outdoor monitoring. Known for their low power consumption, SenseCAP devices are also cost-effective for long-term use and scalable, allowing for future expansion to other smart city infrastructure. Additionally, their seamless integration with the Helium LoRaWAN network ensures efficient, long-range data transmission, perfect for city-wide remote monitoring and automation solutions.

“Our IoT solution at Vodník Fountain in Trenčín uses LPWAN technology, reducing installation costs by eliminating cabling. With advanced automation and remote 24/7 control, the city has achieved nearly 75% savings in water use and optimized energy consumption. The flexible system also allows manual operation, saving time on-site and highlighting the sustainable impact of smart infrastructure” comments Miroslav Macko, CEO of Heliotics

Heliotics CORE App

Heliotics CORE App Dashboard

SenseCAP 10-in-1 Compact Weather Sensor

Results

The implementation of this IoT-powered solution has transformed the management of the Vodnik fountain, significantly reducing water and energy consumption by automating its operation. The system ensures the fountain only runs under optimal conditions, thus extending its operational lifespan and minimizing maintenance costs. Furthermore, remote monitoring via the Heliotics CORE app has reduced the need for physical intervention, allowing the city to respond swiftly to changing weather conditions while also conserving resources.

Overall, this smart solution has improved the city’s sustainability efforts, cut unnecessary costs, and enhanced the public experience of this iconic landmark. The success of this project demonstrates the potential of IoT in modernizing municipal operations, setting an example for other cities looking to adopt smart technologies for better resource management.

Partners

https://www.heliotics.com/ 

Heliotics is a provider of IoT solutions that specialize in smart city applications, offering advanced automation tools for urban infrastructure management. Through its flagship Heliotics CORE app, the company enables remote monitoring and control of various systems, such as fountains, lighting, and environmental monitoring, to optimize city operations. By integrating real-time data and automation, Heliotics helps municipalities like Trenčín achieve greater efficiency, reduce resource consumption, and improve sustainability.

https://www.helium.com/lorawan 

The Helium LoRaWAN Network is a decentralized wireless network designed for IoT devices, offering long-range, low-power connectivity across large areas. Known for its cost-effective and scalable infrastructure, the network allows smart city solutions to operate seamlessly without the need for traditional cellular or Wi-Fi networks. By utilizing Helium’s LoRaWAN technology, cities like Trenčín can monitor and control infrastructure remotely, enhancing both operational efficiency and real-time data collection.

More Case Study

The post Transforming City Fountain Management with SenseCAP LoRaWAN Weather Monitoring-Based Automation in Slovakia appeared first on Latest Open Tech From Seeed.

SeamPose Powered by XIAO nRF52840, Repurposing Seams for Upper-Body Pose Tracking with Smart Clothing

✇Seeed
By: Kezang Loday

Imagine turning your everyday clothes into smart motion-tracking tools. That’s exactly what a team of researchers at Cornell University has achieved with SeamPose. This innovative project, led by Catherine Tianhong Yu and Professor Cheng Zhang uses conductive threads sewn over the seams of a shirt to transform it into an upper-body pose-tracking device by unleashing the power of XIAO nRF52840. Unlike traditional sensor-laden garments that change the clothing’s appearance and comfort, SeamPose blends seamlessly into everyday wear without compromising aesthetics or fit.

This project offers exciting potential applications in areas like health monitoring, sports analytics, AR/VR, and human-robot interaction by making wearable tracking more accessible and comfortable.

Source: Cornell University Team

Hardwares

To build SeamPose, the following key hardware elements were used:

    • Long-sleeve T-shirt with machine-sewn conductive thread along the seams.
    • Customized Sensing Board:
      • XIAO nRF52840 
      • A 36x31mm board with two FDC2214 capacitance-to-digital converters
      • 3.7V 290mAh LiPo battery
Source: Cornell University Team

How SeamPose Works

SeamPose operates by transforming ordinary seams in a long-sleeve shirt into capacitive sensors, enabling real-time tracking of upper-body movements. Conductive threads, specifically insulated silver-plated nylon, are machine-sewn along key seams—such as the shoulders and sleeves—without altering the garment’s appearance or comfort. As the wearer moves, the seams stretch and shift, causing variations in their capacitance. These signals are captured by a customized sensing board integrated with two FDC2214 capacitance-to-digital converters and the XIAO nRF52840 microcontroller. The XIAO nRF52840 transmits the data wirelessly via Bluetooth Low Energy (BLE) to a nearby computer for processing.

The transmitted signals are fed into a deep learning model that maps the seam data to 3D joint positions relative to the pelvis. This allows the system to interpret complex upper-body movements using only eight sensors distributed symmetrically along the shirt. During testing, SeamPose achieved a mean per joint position error (MPJPE) of 6.0 cm, comparable to more invasive tracking systems. The XIAO nRF52840 ensures seamless real-time data transmission, making SeamPose a breakthrough in wearable technology by combining comfort with precise motion tracking.

Signals

Source: Cornell University Team

What’s Next for SeamPose?

SeamPose offers a glimpse into the future of smart clothing, where everyday garments become powerful tools for motion tracking without sacrificing comfort or design. However, challenges like real-world deployment considerations and smart-clothing manufacturing at scale need to be addressed for broader adoption. The research team plans to explore improved seam placement and enhanced sensor calibration for even more accurate tracking in the future.

If you’re excited about SeamPose and want to dive deeper, check out their paper on ACM Digital Library

End Note

Hey community, we’re curating a monthly newsletter centering around the beloved Seeed Studio XIAO. If you want to stay up-to-date with:

🤖 Cool Projects from the Community to get inspiration and tutorials
📰 Product Updates: firmware update, new product spoiler
📖 Wiki Updates: new wikis + wiki contribution
📣 News: events, contests, and other community stuff

Please click the image below👇 to subscribe now!

The post SeamPose Powered by XIAO nRF52840, Repurposing Seams for Upper-Body Pose Tracking with Smart Clothing appeared first on Latest Open Tech From Seeed.

Seeed Studio and Blynk Expand Partnership to Enhance IoT Integration with LoRaWAN and MQTT

✇Seeed
By: Kezang Loday

Seamless IoT with LoRaWAN and MQTT Support

With industries increasingly adopting LoRaWAN and MQTT protocols, Seeed Studio’s devices—like the SenseCAP LoRaWAN sensors and gateways—are now fully supported on Blynk’s platform. This expanded functionality simplifies IoT deployments by allowing users to monitor and control their devices through Blynk‘s intuitive dashboard, without needing extensive coding or infrastructure setup.

“The expanded functionality available with Blynk’s platform is a game-changer for businesses using Seeed Studio SenseCAP LoRaWAN devices,” said Joey Jiang, VP of Industrial Application Group at Seeed Studio. “Our customers can now take advantage of Blynk’s advanced device management features, such as multi-level user management and granular access controls, to manage fleets of devices at scale with ease. This integration allows businesses to focus on their operations while Blynk and Seeed handle the heavy lifting on the backend, from device provisioning to user control.”

SeeedxBlynk

Empowering Developers and Businesses with No-Code IoT Solutions

Through Blynk’s intuitive no-code platform, users gain access to advanced device management tools such as visual data visualization, automation workflows, and real-time alerts. With native MQTT support and a recent integration with The Things Stack for LoRaWAN, Seeed Studio hardware can now unlock unprecedented possibilities for IoT deployments.

“Our mission has always been to simplify IoT for businesses of all sizes,” said Pavel Bayborodin, CEO of Blynk. “By expanding our platform to support industry-standard protocols like LoRaWAN and MQTT, and partnering with Seeed Studio’s robust hardware lineup, we are enabling companies to launch powerful IoT systems faster than ever.”

Unlocking Opportunities Across Smart Industries

The extended partnership offers tremendous opportunities across key industries like smart agriculture, industrial automation, and smart cities. With Seeed’s SenseCAP LoRaWAN devices integrated into Blynk, businesses can achieve remote monitoring, real-time data transfer, and centralized device management with minimal effort. Whether deploying sensors in the field or managing urban infrastructure, users benefit from both Blynk’s software capabilities and Seeed’s reliable hardware for cost-effective solutions.

Discover Seeed Studio Products with LoRaWAN and MQTT Support

Explore Seeed Studio’s wide range of IoT solutions designed to seamlessly integrate with Blynk’s platform. Whether you need SenseCAP LoRaWAN sensors for environmental monitoring, LoRaWAN gateways for reliable connectivity, or development kits for rapid prototyping, Seeed Studio has the tools to bring your IoT vision to life.

About Seeed Studio

Seeed Studio, founded in 2008, is a pioneer in Open Hardware and IoT innovation, offering a broad portfolio of industrial IoT solutions, including sensor modules, edge devices, and platforms like SenseCAP. By promoting collaborative development and open-source principles, Seeed Studio empowers developers and enterprises worldwide to design solutions that address local challenges and advance emerging technologies such as AI and IoT.

About Blynk

Blynk is a leading low-code IoT platform that enables businesses to build custom mobile IoT applications and manage millions of connected devices globally. Used by over 1 million developers and 5,000 businesses, Blynk simplifies IoT management through easy-to-use dashboards and advanced user management features, accelerating time to market and helping companies scale their connected products.

The post Seeed Studio and Blynk Expand Partnership to Enhance IoT Integration with LoRaWAN and MQTT appeared first on Latest Open Tech From Seeed.

WatchThis: A Wearable Point-and-Ask Interface Powered by Vision-Language Models and XIAO ESP32S3 Sense

✇Seeed
By: Kezang Loday

MIT Media Lab researchers Cathy Mengying Fang, Patrick Chwalek, Quincy Kuang, and Pattie Maes have developed WatchThis, a groundbreaking wearable device that enables natural language interactions with real-world objects through simple pointing gestures. Cathy conceived the idea for WatchThis during a one-day hackathon in Shenzhen, organized as part of MIT Media Lab’s “Research at Scale” initiative. Organized by Cedric Honnet and hosted by Southern University of Science and Technology and Seeed Studio, the hackathon provided the perfect setting to prototype this innovative device using components from the Seeed Studio XIAO ESP32S3 suite. By integrating Vision-Language Models (VLMs) with a compact wrist-worn device, WatchThis allows users to ask questions about their surroundings in real-time, making contextual queries as intuitive as pointing and asking.

Credit: Cathy Fang

Hardwares

The WatchThis project utilizes the following hardware components:

Credit: Cathy Fang

How the Project Works

WatchThis is designed to seamlessly integrate natural, gesture-based interaction into daily life. The wearable device consists of a watch with a rotating, flip-up camera attached to the back of a display. When the user points at an object of interest, the camera captures the area, and the device processes contextual queries based on the user’s gesture.

The interaction begins when the user flips up the watch body to reveal the camera, which then captures the area where the finger points at. The watch’s display shows a live feed from the camera, allowing precise aiming. When the user touches the screen, the device captures the image and pauses the camera feed. The captured RGB image is then compressed into JPG format and converted to base64, after which an API request is made to query the image.

The device uses these API calls to interact with OpenAI’s GPT-4o model, which accepts both text and image inputs. This allows the user to ask questions such as “What is this?” or “Translate this,” and receive immediate responses. The text response is displayed on the screen, overlaid on the captured image. After the response is shown for 3 seconds, the screen returns to streaming the camera feed, ready for the next command.

The software driving WatchThis is written in Arduino-compatible C++ and runs directly on the device. It is optimized for quick and efficient performance, with an end-to-end response time of around 3 seconds. Instead of relying on voice recognition or text-to-speech—which can be error-prone and resource-intensive—the system uses direct text input for queries. Users can further personalize their interactions by modifying the default query prompt through an accompanying WebApp served on the device, allowing tailored actions such as identifying objects, translating text, or requesting instructions.

Credit: Cathy Fang

Applications

Imagine strolling through a city and pointing at a building to learn its history, or identifying an exotic plant in a botanical garden with a mere gesture.

The device goes beyond simple identification, offering practical applications like real-time translation of, for example, menu items, which is a game-changer for travelers and language learners alike.

The research team has discussed even more exciting potential applications:

    • A “Remember this” function could serve as a visual reminder system, potentially aiding those who need to take medication regularly.
    • For urban explorers, a “How do I get there” feature could provide intuitive, spatially-aware navigation by allowing users to point at distant landmarks.
    • A “Zoom in on that” capability could offer a closer look at far-off objects without disrupting the user’s activities.
    • Perhaps most intriguingly, a “Turn that off” function could allow users to control smart home devices with a combination of voice commands and gestures, seamlessly integrating with IoT ecosystems.

While some of these features are still in conceptual stages, they paint a picture of a future where our interactions with the world around us are more intuitive, informative, and effortless than ever before.

Credit: Cathy Fang

Build Your Own WatchThis

Interested in building your own WatchThis wearable? Explore the open-source hardware and software components on GitHub and start creating today! Check out their paper below for full details.

End Note

Hey community, we’re curating a monthly newsletter centering around the beloved Seeed Studio XIAO. If you want to stay up-to-date with:

🤖 Cool Projects from the Community to get inspiration and tutorials
📰 Product Updates: firmware update, new product spoiler
📖 Wiki Updates: new wikis + wiki contribution
📣 News: events, contests, and other community stuff

Please click the image below👇 to subscribe now!

The post WatchThis: A Wearable Point-and-Ask Interface Powered by Vision-Language Models and XIAO ESP32S3 Sense appeared first on Latest Open Tech From Seeed.

Simulate Your XIAO ESP32 Projects with Wokwi NOW

✇Seeed
By: Kezang Loday

Hey community, we are excited to announce that three of our powerful XIAO ESP32 development boards are now fully integrated with Wokwi, the popular online electronics simulator! You can now experiment, test, prototype and build projects virtually with the XIAO ESP32C6, XIAO ESP32S3, and XIAO ESP32C3 directly from your browser. A big shout-out to Uri Shaked, Founder and Creator of Wokwi, for making this happen.

Seeed x Wokwi image

What is Wokwi?

Wokwi is an innovative online electronics simulator that supports a wide variety of microcontrollers, sensors, and peripherals. Whether you’re working with an Arduino, ESP32, STM32, or other popular boards, Wokwi gives you a fast and easy way to design and test embedded projects – all from the convenience of your browser.

Key Benefits of Wokwi:

    • Start instantly: No need for downloading complex software or waiting for hardware.
    • Learn by experimenting: Mistakes won’t fry your components – experiment freely without fear!
    • Debug with confidence: With Wokwi’s virtual logic analyzer, WiFi simulation, and GDB debugging, you can tackle both hardware and software challenges.
    • Share your work easily: A simple link to your Wokwi project is all you need to get feedback from the community.
    • Unlimited parts: No more scouring for hardware – use as many virtual components as you need without worrying about cost or availability.

Wokwi is free to use and perfect for beginners and experienced developers alike. For professional users, the Wokwi Club offers access to advanced features and lets you shape the platform’s future.

Integration of 3 XIAO ESP32 Dev Boards on Wokwi

This integration reaffirms our commitment to providing makers and developers with cutting-edge tools that enable rapid prototyping and seamless development. 

With the integration you can simulate your XIAO ESP32-based projects and start coding even without these boards at hand right away. It also allows developers to take full advantage of the flexibility of Wokwi to prototype IoT applications, debug projects, and refine ideas before working with real hardware.

XIAO ESP32C6 img
XIAO ESP32S3 Img
XIAO ESP32C3 img

The XIAO ESP32C6 excels in Matter-compliant smart home applications with its support for various wireless connectivity (2.4GHz Wi-Fi 6, BLE 5.0, Zigbee, and Thread). Encrypted on the chip, XIAO ESP32C6 ensures a desired level of security, streamlined development experience, and swift market entry by integrating easily with major IoT Cloud platforms.

Use Cases: Smart home devices, IoT gateways, and low-latency networking

Explore on Wokwi:

The XIAO ESP32S3 leverages 240MHz Xtensa 32-bit LX7 dual-core processor, supporting both WiFi and BLE 5.0 wireless connectivities, a 2.4GHz Rod antenna, allows for deep sleep mode with power consumption as low as 14μA while supporting lithium battery charging management.

Use Cases: AI-based edge computing, real-time data processing, and robotics.

Explore on Wokwi:

The XIAO ESP32C3 is a compact and affordable development board powered by ESP32-C3. It offers low-power operation and Bluetooth LE support, making it ideal for battery-powered devices and wearable technology.

Use Cases: Smart sensors, fitness trackers, and BLE-based applications.

Explore on Wokwi:

Simulate, Experiment, and Share Your XIAO Projects

It’s time to bring your ideas to life! With the XIAO ESP32C6, XIAO ESP32S3, and XIAO ESP32C3 now available on Wokwi, you have the tools you need to simulate, prototype, and refine your projects – all in a virtual environment

If you think you made something cool, share your projects with us! We’d love to see what you create. Tag us on social media or post your Wokwi project links. Let’s build something amazing together and inspire others in the community.

BTW., these 3 dev boards are just the beginning. We’re working hard together with the team at Wokwi to make more Seeed products available on Wokwi. Feel free to comment to let us know which product you want to see live on Wokwi. 🙂

End Note

Hey community, we’re curating a monthly newsletter centering around the beloved Seeed Studio XIAO. If you want to stay up-to-date with:

🤖 Cool Projects from the Community to get inspiration and tutorials
📰 Product Updates: firmware update, new product spoiler
📖 Wiki Updates: new wikis + wiki contribution
📣 News: events, contests, and other community stuff

Please click the image below👇 to subscribe now!

The post Simulate Your XIAO ESP32 Projects with Wokwi NOW appeared first on Latest Open Tech From Seeed.

MONOKEY, The One-Button Bluetooth Keyboard Powered by XIAO ESP32C3

✇Seeed
By: Kezang Loday

Tired of all those unused keys collecting dust on your keyboard? Meet MONOKEY, a one-button Bluetooth keyboard designed to simplify your tech experience. Created by Big Bad Cult, MONOKEY is a revolutionary wireless 1% mechanical keyboard that brings utility, fun, and personalization to your daily tasks. Whether you’re looking for a practical key charm, a fidget tool, or a programmable button for macros, MONOKEY offers endless possibilities—all powered by the reliable XIAO ESP32C3 microcontroller.

Source: Big Bad Cult

Hardwares

The MONOKEY project is built using the following hardware components:

Source: Big Bad Cult

How the Project Works

The MONOKEY is a compact and portable one-button Bluetooth keyboard that connects effortlessly to any Bluetooth-enabled device, including smartphones, tablets, and computers. Out-of-the-box Bluetooth connectivity allows it to pair quickly with any compatible device, making it instantly ready for use with just one app for mapping. You can program MONOKEY to perform a wide range of tasks, from executing complex keyboard combinations to controlling media playback or even simplifying repetitive tasks like typing passwords with a single press.

Thanks to its hot-swappable key switches, MONOKEY is customizable—you can easily swap key switches and keycaps to match your personal style and preferences without needing to solder. Additionally, MONOKEY supports Wi-Fi connectivity, enabling advanced users to develop custom firmware using Arduino libraries. This feature opens up endless possibilities for creating custom commands or macros.

MONOKEY is powered by a 100 mAh rechargeable battery, providing long-lasting use. Charging is made simple with a USB-C port, ensuring fast recharges when needed. Its lightweight and compact design make it highly portable, allowing you to carry it with ease and add an extra layer of personalization to your tech setup wherever you go.

Source: Big Bad Cult

Get Your MONOKEY Today!

Interested in simplifying your life, one key at a time? The MONOKEY has been launched on Kickstarter with over 400% funded. You can still order one  today for just $39! Shipping is available worldwide, with a $5 flat rate for the US and Canada. Get your MONOKEY before Christmas and revolutionize your workflow with this practical, customizable one-key Bluetooth keyboard. For more details and to join the community, hop onto their Discord. Click your worries away!

End Note

Hey community, we’re curating a monthly newsletter centering around the beloved Seeed Studio XIAO. If you want to stay up-to-date with:

🤖 Cool Projects from the Community to get inspiration and tutorials
📰 Product Updates: firmware update, new product spoiler
📖 Wiki Updates: new wikis + wiki contribution
📣 News: events, contests, and other community stuff

Please click the image below👇 to subscribe now!

The post MONOKEY, The One-Button Bluetooth Keyboard Powered by XIAO ESP32C3 appeared first on Latest Open Tech From Seeed.

AIoT Xperience Day in Düsseldorf: Unlock the Power of AI and IoT

✇Seeed
By: Kezang Loday

Hey community! We’re excited to invite you to join us at the AIoT Xperience Day in Düsseldorf, an event co-organized by Techbros, Uplink, Heliotics, Infinetics and Seeed Studio. 

This is an event you should not miss. Either join the hands-on workshops, play with live demos, show your projects or talk with like-minded enthusiasts, innovators, and professionals in the fields of AI and IoT, it is ensured to be a half-day full of excitement!

Hands-on Workshops

During the event, you’ll get the opportunity to explore two exciting workshops:

1. Meshtastic Workshop

Learn how to set up and utilize Meshtastic, a decentralized LoRa mesh network, with the SenseCAP T1000-E Tracker. Whether you’re a beginner or an experienced developer, this session will demonstrate how you can build a free, off-grid communication network to transmit messages without relying on traditional infrastructure.

2. No-Code AI with XIAO ESP32S3 Sense

Can AI be added to almost anything? Yes, and without any coding! In this hands-on workshop, you’ll discover how to easily build your own AI Vision sensor using XIAO ESP32S3 Sense and SenseCraft AI, our no-code platform for training and deploying AI models. With just a few steps, you’ll have your own custom AI Vision sensor up and running. For this workshop participants need to bring their own laptop.

Why Attend?

This event is more than just workshops. You’ll also get to play with live demos of cutting-edge AIoT technology and connect with others who are passionate about the future of AI and IoT.  Don’t miss the “show and tell” session, where participants will have the chance to share their own innovative projects. And you are invited to bring your projects to the spotlight as well!

Whether you’re interested in creating decentralized communication networks, or you want to see how AI can be seamlessly integrated into your projects without a single line of code, this is the event for you.

Event Details

Time: September 27, 2024  2:00 PM – 6:00PM

Venue: Techbros Office, Heerdter Lohweg 212, 40549 Düsseldorf, Germany

Food and drinks will be prepared according to sign-ups, and the spots are limited. Do sign up now to secure your spot! See you in Düsseldorf!

The post AIoT Xperience Day in Düsseldorf: Unlock the Power of AI and IoT appeared first on Latest Open Tech From Seeed.

Seeed Studio at The Things Conference 2024: Join Us for the Future of IoT

✇Seeed
By: Kezang Loday

We are thrilled to announce that Seeed Studio will be a Silver Sponsor at The Things Conference 2024 in Amsterdam! As a proud participant in this flagship event for LoRaWAN® and Low Power IoT, we invite you to visit us at Booth B03 and explore our cutting-edge technologies that are revolutionizing the IoT space. From September 25-26, join us and over 1,500 industry professionals for a deep dive into the latest innovations in LoRaWAN®.

At our booth, we will be showcasing several new and existing products, providing hands-on demos, and discussing how these solutions are making IoT applications smarter, scalable, and more efficient by unleashing the power of AI. You’ll get to experience our latest innovations, including:

New Products

    • SenseCAP A1102 LoRaWAN Vision AI Sensor: A state-of-the-art AI-powered sensor.
    • Wio-SX1262: The world’s smallest LoRa module.
    • SenseCAP Watcher: The ultimate solution for intelligent monitoring.

Existing Products

A Joint Live Demo with Blynk

Additionally, we are collaborating with Blynk to deliver a Joint Live Demo showcasing the seamless onboarding of the SenseCAP S2120 8-in-1 LoRaWAN Weather Station. Experience real-time climate data visualization on the Blynk platform, offering end-to-end IoT solutions for your projects.

Explore Innovation with Seeed’s Keynotes and Hands-on Workshops

In addition to our exhibits, we’re excited to participate in key discussions and workshops that highlight the synergy between LoRaWAN® and AI. Here are some key sessions you won’t want to miss:

Keynote Speech: Revolutionizing IoT: The Synergy of LoRaWAN and Artificial Intelligence

Speaker: Joey Jiang, VP of Seeed Studio
Time: 4:40 PM, September 25 (Wednesday)
Venue: The Things Theater

In today’s rapidly evolving digital landscape, the need for efficient data processing from the physical world is growing exponentially. Joey Jiang, VP of Seeed Studio, will present a thought-provoking keynote on how the synergy between LoRaWAN and Artificial Intelligence (AI) is revolutionizing IoT solutions.

LoRaWAN’s long-range, low-power capabilities make it ideal for IoT, but handling vast data streams can be challenging. AI enhances LoRaWAN by optimizing data at the sensor level, compressing large datasets into actionable insights for transmission, reducing latency, bandwidth usage, and costs. In this session, Joey Jiang will showcase Seeed Studio’s AI-enabled LoRaWAN sensor nodes, built for scalability and adaptability across industries. He will explore how this technology drives efficiency and digital transformation in IoT ecosystems. Expect to learn how AI improves data processing, real-world use cases, and innovations that boost cost-effectiveness.

Workshop: No-Code to Build Your First AI-Enabled LoRaWAN Vision Sensor

Host: Joey Jiang, VP of Seeed Studio
Time: 11:00 AM, September 26 (Thursday)
Venue: Workshop 1

Want to build your own AI-enabled LoRaWAN sensor node without coding? This hands-on workshop, led by Joey Jiang, is for you! You’ll learn to assemble a plug-and-play LoRaWAN sensor node using Seeed Studio’s kit, train and deploy an AI model with SenseCraft AI, and transmit detection outcomes via LoRaWAN to The Things Network—all without writing a single line of code. Ideal for both beginners and professionals, this workshop offers a practical introduction to AI and LoRaWAN integration. With only 25 seats available, don’t miss the chance for personalized guidance. Bring your laptop for this interactive session!

Roundtable Discussions

1. LoRaWAN in the Harsh Environment of Agriculture

Moderator: Joey Jiang 

Time: 3:00 PM, September 25

Venue: Roundtable Area

2. Do’s and Don’ts in Electronics Manufacturing for LoRaWAN Devices

Panelist: Violet Su

Time: 11:00 AM, September 25

Venue: The Things Podcast

Seeed Studio Partners and Onsite Campaigns

We are excited to have our partners alongside us too!

Join Us at The Things Conference 2024

The Things Conference is the premier event for LoRaWAN®, bringing together over 1,500 top IoT professionals, 70+ industry leaders, and expert speakers. Connect with the entire LoRaWAN® ecosystem, explore the latest IoT technologies, and gain practical insights through hands-on workshops.

Get your tickets (use our partner code to enjoy a 20% off discount: JOIN-TTC2024), and join us for an unforgettable two days of innovation, networking, and hands-on learning.

See you in Amsterdam at Booth B03!

The post Seeed Studio at The Things Conference 2024: Join Us for the Future of IoT appeared first on Latest Open Tech From Seeed.

Hands-on Workshop in Amsterdam: Meshtastic and No-Code AI with XIAO

✇Seeed
By: Kezang Loday

Hey community,

We have some exciting news to share. As we’re attending the upcoming The Things Conference 2024 in Amsterdam, we also got the pleasure of hosting a hands-on workshop thanks to the unwaving support of our local community partner Sensemakers on September 24, 2024 (Tuesday). Welcome to join us if you are in or visiting Amsterdam next week!

HandOnWorkshop pic

Time: 7:00 PM to 9:00 PM on September 24, 2024 (Tuesday) GMT+2

Place: Amsterdam Public Library (OBA)

Register: FREE, but registration required, and you can book it here.

Our VP Joey Jiang together with the amazing team Sensemakers will be hosting the workshop. During this 2-hour workhsop, you’ll explore the Meshtastic open-source, off-grid, decentralized LoRa mesh network using the SenseCAP T1000-E Tracker. Yes, we know the SenseCAP T1000-E Tracker for Meshtastic has been sold out and many people have been waiting. We are working on delivering more and faster! At the same time, we really want to offer the community to experience how easy and cool to set up your own Meshtastic network.

Moreover, you can expect to discover AI at your fingertips with the thumb-sized XIAO ESP32S3 Sense and the no-code SenseCraft AI Platform. You’ll be guided to train, deploy vision AI models without writing any code.

Everyone is welcome, and no experience or engineering background is required. Please do bring your laptop if you’d like to participate in the second session of XIAO with SenseCraft AI. Learn more details and reserve your spot here.

About Sensemakers:

SensemakersAMS is a volunteer based community dedicated to connecting people and sharing knowledge, ideas & hands-on experience related to new technology, mostly IoT and AI. They host community events, welcoming everyone to join, technical, non-technical or just interested. Learn more here: https://www.meetup.com/sensemakersams/

The post Hands-on Workshop in Amsterdam: Meshtastic and No-Code AI with XIAO appeared first on Latest Open Tech From Seeed.

❌