· Ruby Jha · architecture-decisions
The Decision Chain That Got Structured Output to 100%
How Instructor, flat schemas, and two-phase validation got me to 100% structured output success across 580 LLM-generated records.
Tag: llm-evaluation
- · Ruby Jha · project-deep-dives
I Tested 16 RAG Configs So You Don't Have To: Embedding Choice Matters More Than Chunk Size
Grid search across 16 RAG configurations reveals embedding model selection drives 26% more retrieval quality than chunk tuning.
- · Ruby Jha · project-deep-dives
How I Calibrated an LLM Judge That Approved Everything
My first LLM judge had a 0% failure rate. That meant it was useless. This is the story of calibrating it to actually catch failures, and building a correction loop that took synthetic data failures from 36 to zero.