Everything so far has been a CLI. This project moves it to a FastAPI server that streams LLM responses over SSE, tracks token usage and cost per request in SQLite, and rate-limits callers per IP. This is the shape every real LLM-backed product takes — cost and abuse control aren’t optional extras, they’re the difference between a side project and something you could actually run.
Cost/latency tracking and rate-limiting are what interviewers and hiring managers actually probe for beyond 'can you call an LLM' — this project gives you concrete answers.