StockDuty ← Dashboard Oct 19, 2026 05:54 AM ET
SignalTech/AI

Show HN: Strot – Compile an LLM's intent once, run decisions locally

Local LLM decision compilation eliminates repeated inference costs, signaling efficiency gains.

What happened: A Show HN post introduces Strot, an open-source tool that uses an LLM once at compile time to build a frozen local artifact, then makes classification, scoring, and routing decisions on every record at runtime without further LLM calls. Key numbers: Grounded routing accuracy 92.5% compiled vs 74.8% naive on 398 records; AG News 86.7% vs 72.7%; ~60 ms latency, Why it matters: The author reports the compiler adds 18 percentage points over a naive approach on the same model, and low-confidence records abstain rather than guess. The project is MIT licensed and model-independent.
A Show HN post introduces Strot, an open-source tool that uses an LLM once at compile time to build a frozen local artifact, then makes classification, scoring, and routing decisions on every record at runtime without further LLM calls.
The author reports the compiler adds 18 percentage points over a naive approach on the same model, and low-confidence records abstain rather than guess. The project is MIT licensed and model-independent.
Sources