The Vulpine system

Vulpine as of 2026-11-14: the frontends on your screens and in your rooms; the Rust Voice Gateway, speech recognition, the voice and the optional decision model on a Mac in the house; your agent and its tools beside it

The Vulpine system Vulpine as of 2026-11-14: the frontends on your screens and in your rooms; the Rust Voice Gateway, speech recognition, the voice and the optional decision model on a Mac in the house; your agent and its tools beside it Frontends: your screens and rooms The gateway host: the voice The gateway host: your agent and its tools Outside You · voice and controls · Architecture component You voice and controls Web app · a browser tab, the Vigil look · Frontends: your screens and rooms · call frames Web app a browser tab, the Vigil look call frames Vulpine.app · the desktop app · Frontends: your screens and rooms · orb, panels, avatar Vulpine.app the desktop app orb, panels, avatar Room speaker · the Voice PE puck · Frontends: your screens and rooms · wake word on the puck Room speaker the Voice PE puck wake word on the puck Client Core · @voidfab/vulpine-voice-client · Frontends: your screens and rooms · mic + playback Client Core @voidfab/vulpine-voice-client mic + playback Speech recognition · Parakeet, CoreML · The gateway host: the voice · on the Neural Engine Speech recognition Parakeet, CoreML on the Neural Engine The voice · qwentts.cpp tts-server · The gateway host: the voice · :8850, on your Mac The voice qwentts.cpp tts-server :8850, on your Mac Voice Gateway · Rust, WebSocket :8780 · The gateway host: the voice · sessions, turns, verbs Voice Gateway Rust, WebSocket :8780 sessions, turns, verbs Decision model · decision.v1, optional · The gateway host: the voice · beside the turn, off by default Decision model decision.v1, optional beside the turn, off by default Vulpine Gateway.app · the Gateway window · The gateway host: the voice · owner-only socket Vulpine Gateway.app the Gateway window owner-only socket Your agent · Pi: pi --mode rpc · The gateway host: your agent and its tools · reasoning and tools Your agent Pi: pi --mode rpc reasoning and tools Docs site · these docs, with MCP · The gateway host: your agent and its tools · search_docs, get_page Docs site these docs, with MCP search_docs, get_page Adapter programs · homectl, roomctl, fleetctl, visionctl · The gateway host: your agent and its tools · verbs out, events in Adapter programs homectl, roomctl, fleetctl, visionctl verbs out, events in Model providers · hosted or on your Mac · Outside Model providers hosted or on your Mac Home hub · Home Assistant, cameras, speakers · Outside · your house Home hub Home Assistant, cameras, speakers your house speech speech PCM + frames protocol mic PCM reply text first words owner socket Pi RPC model calls MCP verbs + events HA, MQTT Legend Frontend Backend Database Cloud Security External

Who owns what

  • • The gateway owns sessions, turns and speech; it never calls a model itself
  • • A verb turn is settled by the gateway from its own list; every other turn goes to your agent
  • • Your agent owns reasoning, model access, tools and MCP servers

Integration seam

  • • Adapters keep upstream names and credentials; the gateway sees Vulpine's subjects
  • • roomctl speaks in rooms, homectl streams house events and acts on subjects
  • • fleetctl checks your hosts; visionctl reads a camera frame

What stays home

  • • Speech recognition and the voice run on the gateway host
  • • The gateway listens on loopback; Vulpine Gateway.app uses a socket only your account opens
  • • Only a turn's text goes to a hosted model, when your agent uses one