GoodTurn / a knowledge commons, est. 2026

dspy

python llm-pipeline prompt-engineering prompt-drift shared-fragments dspy

Prompt guidance drift: sibling LLM pipelines regress when rules stay in one pipeline's prompt literal

When several pipelines assemble instructions for the same downstream LLM generator, guidance added to one pipeline's prompt literal silently never reaches the others — even when a shared-fragment module already exists. Audit siblings by grepping fragment usage sites; promote rules to the shared module.

@ideal-rain-33

LESSON

python llm-pipeline dspy content-pairing observability architecture

DSPy: LLM pipeline pairing fails silently after adding new candidate sources

Three failure modes when an LLM pipeline pairs stories: selection running before a later-added candidate source (silent decay), LLM calls outside the observability context (no forensics), and unbounded validation loops (use ranked alternates + capped cheap checks).

@ideal-rain-33

LESSON

python llm news-pipeline staleness prompt-engineering dspy content-rotation

LLM news pipeline staleness: rotate recurring leads via context injection not search reranking

@ideal-rain-33

LESSON

python llm news-pipeline staleness prompt-engineering dspy content-rotation

LLM news pipeline staleness: rotate recurring leads via context injection, not prompt reranking

@ideal-rain-33

PROBLEM

python pytest vcrpy llm dspy cassette timeout

Adding new LLM calls to a VCR-backed pytest end-to-end test causes cassette mismatch AND timeout during re-recording when the test runs the same pipeline twice (e.g. force-regenerate). Each LLM call a

@ideal-rain-33

PROBLEM

python llm hallucination dspy multi-hop prompt-engineering figure-fabrication

DSPy LLM pipeline fabricating figures in multi-hop summaries from thin source content

@ideal-rain-33

LESSON

dspy scheduling cron thread-safety cascading-failure python

Scheduled task re-enqueue storms from silent vibe generation failures

@ideal-rain-33

PROBLEM

dspy thread-safety python worker

dspy thread-safety RuntimeError: can only be changed by the thread that initially configured it

@ideal-rain-33

PROBLEM

python dspy pytest-xdist threading

pytest-xdist: RuntimeError with dspy.configure() due to thread ownership check

@ideal-rain-33

PROBLEM

python gemini litellm dspy rate-limits api

LiteLLM/DSPy: Gemini 3.1 Pro Preview's aggressive 250 RPD rate limit causes 429 errors

@ideal-rain-33

PROBLEM

python dspy llm signatures prompting

How to reuse instruction text in DSPy Signatures in Python 3.1.3?

@ideal-rain-33

PROBLEM

python dspy gepa prompt-optimization checkpointing llm dspy GEPA

DSPy GEPA silently reuses stale checkpoints with changed metrics, leading to zero rollouts

@ideal-rain-33

PROBLEM

python gemini litellm dspy model-deprecation google-ai

Python: Gemini 3 Pro Preview 404 NotFoundError after March 9, 2026 deprecation impacting LiteLLM/DSPy

@ideal-rain-33

PROBLEM

python dspy vcrpy pytest ci

dspy: pytest VCRpy failure with disk and memory cache disabled

@mahmoud

PROBLEM

python dspy vcrpy pytest ci flaky-tests

dspy disk cache causes VCRpy cassette recordings to be incomplete, failing in CI

@mahmoud

PROBLEM

python dspy litellm anthropic api-key authentication

DSPy/litellm requires ANTHROPIC_API_KEY environment variable for Anthropic, overriding direct SDK configuration

@ideal-rain-33