智能工作流

Captain Claw

An open-source AI agent with multi-agent orchestration, autonomous cognitive systems, and a full management dashboard. Runs locally, supports every major LLM provider, and ships with 44 built-in tools.

What's New in 0.4.27

Glasses Bridge. Captain Claw 0.4.27 introduces a mobile-web → agent → glasses-web pipeline that lets you talk to any Flight Deck agent from your phone and have its reply rendered (and spoken) on Meta Ray-Ban Display smart glasses. Plus Tavily as a web-search provider — thank you to the Tavily team for the excellent API.

• Glasses Bridge (captain_claw/flight_deck/glasses_bridge.py) — three pages tied together by a channel-based pub/sub bus in Flight Deck:
• Mobile bridge at /glasses/mobile — pick a process agent, type, optionally attach a photo, hit Send. Installable as a PWA on iOS (Share → Add to Home Screen) and Android (install prompt). Standalone mode, dark theme, scoped to /glasses/. Editable channel id in the URL so anyone with the link is in.
• Glasses view at /glasses/view?c=<channel> — floating HUD bar with brand pill + SSR freshness token + live indicator, last 3 messages rendered with full markdown including tables, prominent pulsing "thinking" state when the agent is busy, compact return when the answer arrives.
• Settings page at /glasses/settings?c=<channel> — tap-target button grids for voice (28) and language (60+), grouped by accent (Neutral / British / American-Spanish / Australian / Indian). Replaces native <select> dropdowns which are essentially unusable with Neural Band gestures.
• Soniox TTS streaming (WS /glasses/tts-stream) — first-audio latency 150–300 ms via PCM s16le chunks scheduled through Web Audio API; auto-fallback to one-shot MP3 (POST /glasses/tts) if streaming hiccups. Toggle stream/one-shot in the glasses header (📡 / 📦), persisted across reloads. 60+ languages, 28 multilingual voices.
• Voice off by default with an explicit 🔇 Voice is off — tap 🔊 to enable banner. Tapping 🔊 doubles as the user gesture that satisfies browser autoplay policy. Zero /glasses/tts* traffic while muted.
• Photo attachment — paperclip in the mobile composer triggers camera or gallery (capture="environment"); bridge proxies the multipart upload to the chosen agent's /api/image/upload and includes the resulting path in the chat. Agent sees the image as the familiar [Attached image: …] prefix.
• Hidden glasses system context — first message of every channel→agent binding gets a prepended [SYSTEM CONTEXT — do not echo] block telling the model the reply will render on a tiny HUD. Sent to the agent only; never broadcast to the channel bus.
• Captain Claw launcher icons — PNG icons (96 / 180 / 192 / 512) wired into the glasses view head and a separate /glasses/view-manifest.webmanifest so Meta's wearables runtime shows the brand mark instead of the default fallback (Meta does not accept SVG).
• Tavily web-search provider — web_search now supports provider: tavily alongside the default brave. Set TAVILY_API_KEY in env / .env or tools.web_search.tavily_api_key in config. Transparent to the agent — same tool, same query parameter.
• meta-glasses-test/ — standalone stdlib freshness probe for verifying the "fresh from server every load" behaviour of the glasses webview, separate from the agent stack.

Backward compatible — existing 0.4.26 setups keep working unchanged. Glasses Bridge is dormant unless you visit /glasses/*. Tavily is opt-in; the default web-search provider remains Brave. See RELEASE_NOTES_0.4.27.md for the full breakdown and the How to use the Glasses Bridge walkthrough.

See RELEASE_NOTES.md for the full changelog.