Meta, the parent entity of Facebook, has unveiled the open-source Muse Gadgets SDK, tailored for compatibility with ESP32 boards and Linux-based SBCs, including the Raspberry Pi.
This development warrants further explanation. Having just returned from a brief hiatus, I find myself catching up on recent events.
Notably, Meta introduced Muse on September 6, yet another addition to the domain of personal AI agents.
Earlier this month, Nat Friedman, the head of product at Meta Superintelligence Labs, disseminated an X post discussing the Muse Gadgets project, aimed at enabling the integration of ESP32 and Linux devices with Muse, thereby facilitating hardware AI monitors and physical AI implementations.
The Muse Gadgets SDK has been launched on GitHub under an Apache 2.0 license for the majority of the code, encompassing two primary directories:
- ESP32 Device SDK – Capable of displaying images, it supports audio input and output, as well as interfacing with sensors, actuators, buttons, and more.
- Linux Device SDK – Compatible with the Raspberry Pi and other Linux SBCs, it facilitates use cases such as managing sysadmin tasks or integrating with home automation systems.
A third directory houses a variety of skills compatible with an array of hardware, including Apple HomePod Mini, printers from Brother and Epson, ESPHome devices, 3D printers, and an assortment of smart home devices.reTerminal E1002 Muse integration
Meta recommends utilizing the Raspberry Pi 5 for Linux applications, the Waveshare ESP32-S3-Touch-AMOLED-1.75C development kit (featuring a 1.75” AMOLED touchscreen, speaker, microphone, and rechargeable battery), or the Seeed reTerminal E1002, which is equipped with a color e-ink display, to embark on this venture.
Nevertheless, alternative devices may suffice with some additional effort. An HDMI stick will also receive support, with specifics yet to be disclosed.
In addition, Meta has produced 5,000 Muse Home Link devices, which will be distributed free of charge to Muse subscribers in the United States in the coming weeks, subject to availability.
This device is based on an ESP32-C5 wireless MCU, offering dual-band WiFi 6, BLE, and 802.15.4 (Zigbee/Thread) connectivity.
It also features 8MB of flash memory and 8MB of PSRAM, accompanied by a USB-C port for power and programming and an LED indicator. Muse Home Link
To pair a Muse Gadget with the Muse app on iOS or Android (navigate to Settings > Devices), users must procure a Muse SDK token and review the Gadget SDK Terms.
Activating developer mode is a prerequisite, where users will encounter a device labeled “MuseGadget”.
Further insights can be found on the project’s website, which also facilitates claiming a complimentary Muse Home Link for eligible US-based subscribers.
JJ Englert exhibited a demonstration showcasing Muse integrated with a Waveshare ESP32 “Muse Gadget”.
Got my Muse working on my ESP32. Even gave him a voice. Really cool! https://t.co/xaA1REByRm pic.twitter.com/jlxzsaPnz6
— JJ Englert (@JJEnglert) October 3, 2026
Source link: Cnx-software.com.
