SignalTech/AI
Launch HN: Respan (YC W24) – Open-source Rust AI gateway built around plugins
Open-source Rust AI gateway with plugin architecture signals developer-relevant launch.
Context
What happened: Respan launched an open-source Rust AI gateway built around plugins, with a small core that dispatches events and handles providers, protocols, modalities, and features as plugins. It is MIT or Apache-2.0 licensed and pre-alpha.
Key numbers: Wrapper code exceeded 100,000 lines; Mistral's provider file is 22 lines; the team has built on LiteLLM since 2024 and serves thousands
Why it matters: The team says patching LiteLLM is not sustainable after a January upgrade caused connection errors, so it redesigned the gateway and is seeking plugin contributions to build an ecosystem.
What changed
Respan launched an open-source Rust AI gateway built around plugins, with a small core that dispatches events and handles providers, protocols, modalities, and features as plugins. It is MIT or Apache-2.0 licensed and pre-alpha.
Why it matters
The team says patching LiteLLM is not sustainable after a January upgrade caused connection errors, so it redesigned the gateway and is seeking plugin contributions to build an ecosystem.