Applied LLM Systems

Fifteen AI systems you can run right here

Each page runs the real code on this server and shows you the actual output. Nothing is pre-recorded, and there is no API key behind any of it.

15 live demos   Source on GitHub   Portfolio

01

Production RAG Pipeline

Ask a question about a small product manual and watch the search find, reorder and cite its evidence.

02

Structured Output Engine

Paste model output that is broken in one of the usual ways and watch it get repaired, checked, and either fixed or safely replaced.

03

Context Assembly Service

Give the model a token budget and watch six sources of context compete for it.

04

LLM Evaluation Harness with a CI Quality Gate

Pick a version of the answering system, watch it get graded on 23 questions, and see whether the merge gate lets it through.

05

Semantic Cache Layer

Type two questions and see whether the cache reuses the first answer for the second, and whether it should.

06

Model Routing Gateway

Type a request and see which size of model it gets sent to, why, and what that choice costs against the alternatives.

07

Multi-Tenant LLM API Gateway

Act as one of three tenants on a shared API and watch the gateway decide what you are allowed to do.

08

Fine-Tuning Pipeline with LoRA

Pick an adapter size and watch a small model learn a new way of talking, then check what the shortcut cost.

09

Agent Memory System

Tell an assistant something early in a long chat, then ask about it thirty turns later.

10

Guardrails Middleware

Paste any prompt, including an attempt to hijack the assistant or a message with personal details in it, and see exactly which checks fire and what happens to the text.

11

Streaming, Backpressure and Resume

See what a token stream really sends, what happens when the reader is too slow, and how a dropped connection picks up where it left off.

12

Prompt Versioning and A/B System

Type a customer name and see which version of a prompt they get, and whether the new one earns its promotion.

13

LLM Observability Stack

Break a traced AI pipeline on purpose and see the traces, the bill, the latency and the alerts it produced.

14

Tool-Calling Framework

Ask for a calculation or a lookup and watch the request turn into a checked tool call, including the ones the sandbox refuses to run.

15

Self-Correcting RAG Agent

Ask anything, including something the documents cannot answer, and watch the system try again, then admit defeat.