Gateway Ready
Ask any question against your indexed PDFs and warmed FAQ cache. Every response updates the Live Execution Graph on the right.
Test Presets
1. Indexed PDF Documents (Redis 8)
O(1) versioned invalidation
Upload or remove PDFs. Any change increments kb_version so stale cached answers are invalidated immediately.
Active Documents in Vector Index
Loading...
2. Semantic Cache FAQ Warmer
Pre-loads static FAQs plus 3 auto-generated paraphrases per question into Redis for sub-millisecond exact hits and $0 LLM semantic hits.
Cost Saved vs Frontier
0.0%
$0.000000 saved
Cache Hit Rate
0.0%
0 requests
Avg Latency
0 ms
End-to-end gateway
Guardrails & Failovers
0 / 0
PII scrubs / 503 retries
Live Query Execution Graph
Preview Mode
Click any node in the graph to inspect
app/main.py
Send a message on the left to trace its exact live path, or click a node above to inspect its implementation.
Retrieved PDF Context
0 chunksNo RAG retrieval triggered yet.
PostgreSQL Request Logs
| Cache | Model | Flags | Latency | Saved |
|---|---|---|---|---|
| Loading... | ||||