Designing a Grounded Documentation Assistant
A build log on turning a documentation chatbot into a routed, source-grounded assistant that can also guide evaluation workflows.
Technical Notes
These notes are intentionally short and implementation-oriented. They are a place to document how I think about backend services, release gates, and operational debugging.
A build log on turning a documentation chatbot into a routed, source-grounded assistant that can also guide evaluation workflows.
Retrieval-augmented generation as an engineering problem: what each pipeline stage can get wrong, deterministic citations, split evaluation, and how prompt caching moves the long-context break-even.
What a metrics-architecture refactor taught me about singletons, mixins, cardinality, and why a metric name is a public API.
Strip away the hype and an agent is an LLM in a loop that can call tools, remember things, and ask for help. Everything else is engineering around that loop.
The mental model behind OTel — signals, resources, the API/SDK split, and how trace context turns three monitoring streams into one investigation workflow.
Layering and encapsulation are the whole trick — a compact map of the five-layer model with the details that matter in practice.
SSH is not 'log in with a key' — it is seven distinct stages, and every error message tells you exactly which one failed.
Deploying two FastAPI services on a local kind cluster with a production-shaped Helm chart — and why deliberately breaking the deployment taught me the most.
A practical outline for monitoring user-facing AI services with backend-friendly signals.
A short implementation note for turning a small Go service into a deployable Kubernetes workload.