Ollie
Modified XiaoZhi firmware · SenseCAP Watcher and more

Ollie

Keeps an eye on your agents, and steers them.

Xiaozhi Ollie is based on the original XiaoZhi firmware, modified to turn the SenseCAP Watcher into a voice companion for your desk. Say “Hey Ollie” to check on your Claude Code and Codex sessions, approve a request, record a meeting or see how much of your plan is left. Clawd shows what is going on.

Base XiaoZhi v2.5.0 Chip ESP32-S3 · 32 MB flash · 8 MB PSRAM 4 languages English · Português · 中文 · Español Display 1.45″ round, 412 × 412 Build ESP-IDF v6.1
Mon, Oct 5 · 16:20
Clawd
Apps
keeps an eye on your agents
v0.1.0

The screen plays a demo on its own. Click the wheel or use the buttons to take over; scroll over the screen to turn the wheel.

Works with
  • Claude Code
  • Codex
  • herdr
  • macOS
Voice

Ask out loud, from anywhere.

The Watcher talks to your own server on your Mac through a private Tailscale address. Nothing goes through the xiaozhi.me cloud. Anything that changes something asks you to confirm by voice first. Ollie speaks English, Portuguese, Chinese and Spanish.

How are my sessions doing?

Lists your herdr sessions: which are waiting for you, which are working, which have subagents running and what they finished.

What is the checkout session doing?

Reads the session’s screen and sums it up in a sentence or two.

Tell the api session to run the tests.

Repeats the request, asks “confirm?”, and only then sends the instruction or approves the permission.

Ask Claude how the open PR is going.

Runs claude -p on your Mac in read-only mode, with your own skills and memory.

Open a Codex session on the docs repo to review the README.

Starts a new session in herdr.

How much of my Claude plan have I used?

Shows and reads out the 5-hour and weekly usage, and when each one resets.

Remember the team meeting is at three.

Saves it to Lembretes.md in iCloud Drive and to the offline memory on the microSD card.

Wheel

One wheel does it all.

The Watcher has a wheel on its corner that turns and clicks. The firmware counts the clicks and knows whether you are on the home screen or inside an app.

1 click

Talk. Click again to interrupt the answer.

2 clicks

Opens the app drawer; with it open, goes back one screen.

3 clicks

Closes the drawer from any screen. Clicks are configurable in Settings.

↺ ↻
Turn

Volume on the home screen. Navigation in the drawer and inside apps.

Hold 2 s

Powers off when the Watcher is not charging.

Hold 20 s

Factory reset. The original firmware used 10 s, which was too easy to trigger by accident.

App drawer

Apps on the wheel.

Click twice to open the drawer. Each app is one file in placa/apps/ plus one line in the registry, so adding your own is quick.

Mascot

Clawd reacts to everything.

Every reaction is a 128 px pixel-art GIF drawn by a Python script (mascote-clawd/gerar.py). The server picks an emotion for each answer, and the firmware switches states on its own while it listens, thinks and talks.

How it works

From the Watcher to your Mac.

The firmware is the front end. The smarts run on a server you host at home, so your keys and access stay under your control.

Device

SenseCAP Watcher running Xiaozhi Ollie

Detects “Hey Ollie” on the chip, shows speech in up to three lines and runs the apps in the drawer.

home Wi-Fi or phone hotspot · wss and https

Network

Tailscale Funnel

Only one secret path is public. The root returns 404.

Server

xiaozhi-server on your Mac

Listens on 127.0.0.1 only. Transcribes, thinks and speaks through any OpenAI-compatible API, such as OpenRouter.

voice → text → model → voice

Tools

MCP bridge

herdr sessions, claude -p, codex exec, Multica, macOS Shortcuts, weather, reminders and your Claude plan usage. No free-form shell.

Devices

Made for the Watcher. Works with other XiaoZhi devices.

The full firmware targets the SenseCAP Watcher. The Ollie server speaks the standard XiaoZhi protocol, so other devices running XiaoZhi can use the same voice assistant and agent tools.

Full support

SenseCAP Watcher

Seeed Studio. The complete Xiaozhi Ollie firmware: app drawer, wheel controls, Clawd, boot screen, round speech layout, microSD memory and alerts.

Voice and agent tools

Other XiaoZhi devices

Any board running XiaoZhi v2 can talk to the Ollie server: enter its address in the “Custom OTA URL” field of the Wi-Fi setup page. You get the voice assistant and the tools for Claude Code, Codex, herdr and macOS. The Watcher-only screens need porting.

  • Espressif ESP32-S3-BOX-3
  • M5Stack CoreS3
  • M5Stack AtomS3R with Echo Base
  • M5Stack Tab5
  • M5Stack Cardputer ADV
  • Waveshare ESP32-S3 Touch AMOLED 1.8
  • Waveshare ESP32-S3 Touch LCD 1.85
  • LILYGO T-Circle-S3

XiaoZhi v2.5.0 ships about 170 board configurations; these are a few examples. We have tested the Ollie server only with the SenseCAP Watcher so far.

Compared to XiaoZhi

What the firmware changes.

Ollie applies its changes as patches on top of a clean XiaoZhi v2.5.0, so new upstream versions can be followed without maintaining a fork.

AreaOriginal XiaoZhiXiaozhi Ollie
LanguagesMany interface languages; the assistant runs in the xiaozhi.me cloudEnglish, Portuguese, Chinese and Spanish end to end: screen, apps, alerts, voice and answers
Wake word“你好小智”“Hey Ollie”, or one of 8 agent names
Serverxiaozhi.meYour own server on your Mac, address built in
MascotNoto emojiClawd, as animated pixel-art GIFs
Boot screenXiaoZhi logoClawd waving, Ollie logo and version
Speech on screenOne line scrolling sidewaysUp to three lines, paced with the voice
FontNoto SansNoto Sans or JetBrains Mono, picked in Settings
Home screenTimeDay, date, time and a greeting with your name
WheelVolume and talkAlso the app drawer and back
microSDUnusedConversation log, meeting copies and offline memory
AlertsNoneSession waiting for you, task finished, meeting ready
Install

Build it from scratch.

Set up the server on your Mac first, then the firmware. The first flash backs up the device and leaves the factory partition alone.

You will need

  • A SenseCAP Watcher, ideally the “for XiaoZhi” edition
  • A Mac that stays on at home, with Tailscale
  • An OpenAI-compatible API key (OpenRouter, for example)
  • ESP-IDF v6.1 to build the firmware
  • Optional: a microSD card in FAT32 with MBR (ESP-IDF cannot read exFAT or GPT)

Prefer to let a coding agent do it? The install guide in docs/INSTALL.md has a ready-made prompt for Claude Code or Codex.

# Server (Mac)
servidor/instalar.sh                  # downloads, patches, creates .env
#   set API_KEY in servidor/.env
servidor/testar-api.sh                # real chat, voice and transcription
servidor/instalar-servico.sh instalar
servidor/configurar-funnel.sh ligar

# Firmware
firmwares/xiaozhi-ollie/compilar.sh
firmwares/gravar-xiaozhi.sh           # first flash: erases saved Wi-Fi
firmwares/atualizar-firmware.sh       # updates: keeps Wi-Fi