Production + how companies actually do it
Deploy, cost, latency, observability
Streaming APIs, cost logs, caching, traces, resilient clients, and a runbook for your service.
Milestone Deployed agent/SLM service with cost + traces.
Lessons in this module
- API + streamingProject: FastAPI + SSEOpen
- Cost accountingProject: Per-request cost logOpen
- Caching and latencyProject: Prompt cache experimentOpen
- Tracing tool/LLM spansProject: Simple waterfall from JSONLOpen
- Retries, rate limits, idempotencyProject: Resilient clientOpen
- RunbookProject: Ops checklist for your serviceOpen