The M5Stack Module LLM is yet another box-shaped device from the company that provides artificially intelligent control without internet access. It is described as an “integrated offline Large Language Model (LLM) inference module” which can be used to implement local LLM-based solutions in smart homes, voice assistants, and industrial control. Module LLM is powered by the AX630C SoC, equipped with 4GB LPDDR4 memory, 32GB storage, and a 3.2 TOPS (INT8) or 12.8 TOPS (INT4) NPU. M5Stack says the main chip has an average runtime power consumption of 1.5W, making it suitable for long-term operation. It has a built-in microphone, speaker, microSD card slot, and USB OTG. The USB port can connect peripherals such as cameras and debuggers, and the microSD card slot supports cold and hot firmware updates. The M5Stack Module LLM joins the list of other offline, on-device LLM-based solutions, such as the SenseCAP Watcher, Useful Sensors’ AI in [...]

The post M5Stack releases AX630C-powered offline “Module LLM” for local smart home and AI applications appeared first on CNX Software - Embedded Systems News.