Skip to content
Vulpine
Esc
↑↓navigate↵open⌘Jpreview
On this page

Hardpoint: speech to text

The stt hardpoint slot 1.0: the built-ins (parakeet-silero, native-parakeet-silero, in-process-parakeet), what a user speech recognizer does (the STT worker wire, a WebSocket on loopback, declared audio_in), its probe (the wire opens within 5 s) and its fallback; the ANE authority lane never replaces a user recognizer.

Living doc, checked against the code 2026-11-14

hardpoint.stt.v1 — the stt slot: what a speech-recognition implementation must do to hear a session

  • Status: 1.0, built. The slot’s interface contract under hardpoint.v1 and ADR 0059 §2. A minor version only adds.
  • Owner: the gateway, at session bind. Budget leg: speech_end_to_commit in turn-budget.v1 (p50 1000 ms, p90 1200 ms). A text-only frontend binds no stt slot.

Built-ins

id what it is
parakeet-silero the default: the Parakeet relay worker over the STT worker wire
native-parakeet-silero the native Parakeet worker, with its deployment admission
in-process-parakeet Parakeet in the gateway’s own process

[shadow_stt] mode = "authority" puts the CoreML lane (ADR 0027) in front of a built-in. It does not replace a user implementation.

What an implementation does

A stt implementation receives the session’s PCM: mono, 16-bit, 24 kHz. It answers VAD, partial and final transcript frames on the STT worker wire, the WebSocket protocol parakeet-silero speaks (crates/voice_gateway/src/stt.rs). The gateway reads it through the same adapter as a built-in. A transition or a fault rebuilds it at the same endpoint.

Transports this build drives

transport wire endpoint
http_loopback the STT worker wire, a WebSocket ws://<loopback ip>:<port>/<path>

A server that speaks OpenAI’s Realtime transcription session (speech.cpp, LocalAI, paddock, mlx-audio) binds through the Realtime shim, crates/realtime_stt_shim. Its Catalog entry is catalog/hardpoints/speech-cpp-realtime/hardpoint.toml. mynah-asr’s streaming WebSocket (Nemotron 3.5, 16 kHz only) binds through the mynah shim, crates/mynah_stt_shim, which resamples 24 to 16 kHz as it streams. Its Catalog entry is catalog/hardpoints/mynah-nemotron/hardpoint.toml. Each shim is a separate process on this wire, and both share crates/stt_shim_wire. Wyoming ASR waits for its own minor.

The manifest must declare audio_in. The endpoint must be a loopback address: an implementation that receives raw audio stays local.

Qualification probe

The probe opens the worker wire within 5 s and closes it. Its ms is the connect time. A failed probe binds the manifest’s fallback, reported degraded {reason: qualification_failed}.

Was this page helpful?