Seeed Studio's SenseCAP Watcher Combines Local TinyML with Cloud LLMs to Deliver Smart Monitoring
Applications for alpha testers now open, as the company looks to bring modern artificial intelligence to any room.
Seeed Studio has announced the impending launch of what it describes as a "physical AI [artificial intelligence] agent for smarter space," combining AI technology with the Internet of Things to build a smart gadget combining locally-running tinyML models with cloud-powered large language models (LLMs): the SenseCAP Watcher.
"We are incredibly excited to launch the SenseCAP Watcher at Embedded World 2024," says Seeed Studio Eric Pan, of the company's latest hardware release. "With the SenseCAP Watcher, we envision a more effortless way of interacting with and managing physical world. It pushes the boundaries of what a combination of tinyML at the edge and LLMs can enable, while retaining an open source and extensible design."
Designed for wall mount or desktop operation, the SenseCAP watcher includes a 1.46" circular color touchscreen display, front-facing camera and microphone, speaker, programmable RGB light, wheel interface, two USB Type-C connectors for power and charging its internal battery, and a Grove expansion slot for external add-on hardware.
The gadget is designed as a first-class device for Seeed's SenseCraft, a toolkit that combines on-device tinyML models with remote large language models — either running on remote cloud servers or on local edge devices, including Seeed's own Edge AI Box reComputer devices based on the NVIDIA Jetson system-on-module family.
The on-board models, Seeed explains, are used to monitor conditions around the device, including room occupancy and activities. For interaction, either using a companion mobile app or via voice control, the device can send queries to an LLM for natural language command operation. The company also claims the device is "self-learning and evolving," being able to train on locally-captured data, and can also be integrated into existing smart home systems.
While Seeed is showing off the device at Embedded World 2024 in Nuremberg this week, it has yet to announce pricing and availability — but is taking applications for alpha testers on its website, where interested parties can also interact with a simulated version of the SenseCAP Watcher dubbed "Nobody."