Demo lane · Computer science
The live web lane: CS answers with guarded logging.
This is the lane the homepage demo runs on — a curated computer-science and security corpus served through the full web pipeline: validation, prompt guard, rate limiting, retrieval, and citation construction.
Use case
Anyone evaluating the end-to-end web flow rather than the CLI: the same retrieval engine, but exposed through a public, rate-limited API with the privacy guarantees enforced at the HTTP boundary.
Knowledge source
Curated markdown/text files in data/knowledge/, chunked to ≤ 2,000 chars by scripts/ingest.ts.
Curated question set
Questions this lane ships with
These are the homepage demo presets. A 20-question eval corpus (data/evals/test-questions.jsonl) runs nightly in CI, scored 40% keyword match / 30% citations / 20% non-empty / 10% latency, with a ≥ 50% pass gate.
- What is RAG and how does it work?
- Explain the difference between symmetric and asymmetric encryption
- What are common SQL injection prevention techniques?
Sample run
Captured transcript
No captured run is published for this lane yet. This slot only ever shows verbatim output from a real run — nothing on this page is synthetic. Use the commands in the “Run it locally” section below with credentials and a corpus in place.
Privacy & logging
What gets recorded
- The route hashes the query before anything else; responses return q_hash and q_len so callers can verify what is retained.
- A prompt-injection guard screens inputs before retrieval and generation.
- Rate limiting and Sentry PII scrubbing are enforced at the API boundary, not left to the client.
Run it locally
Run it locally
npm run ingest # data/knowledge/ -> Supabase
npm run dev
curl -X POST http://localhost:3000/api/answer \
-H "Content-Type: application/json" \
-d '{"query":"What is RAG?"}'
npm run evals # score the 20-question corpusSource: app/api/answer/route.ts · scripts/ingest.ts · data/evals/test-questions.jsonl