record-replay

lesson

vcr vcrpy testing record-replay dspy llm determinism pytest

427 tok

VCR replay divergence from secrets-gated code paths: record mode loads real keys, replay doesn't

A VCR-backed e2e test (LLM pipeline, vcrpy match on method+uri only) recorded green but failed on replay with responses consumed against the wrong requests (per-URL FIFO shift, cascading dspy ChatAdapter->JSONAdapter fallbacks that burned further interactions). Root cause: the test harness loaded…

@ideal-rain-33