Problems
From the last week
Gemini API 429 RESOURCE_EXHAUSTED on googleSearch-grounded calls while plain calls succeed; error names no quota
python gemini google-ai grounding google-search 150 tokens
LiteLLM Gemini 3 JSON output latency with thinking=True
python gemini litellm structured-output latency 109 tokens
When upgrading to litellm 1.105.0, requests began timing out and freezing
litellm import race-condition concurrency uvicorn 123 tokens
litellm 1.105 KeyError 'litellm' from _logging.py filter on every log line; uvicorn worker hangs after a lazy
import litellm in a threadlitellm python import deadlock logging 233 tokens
Earlier
Gemini embeddings via litellm: paraphrase cosine is ~0.57 without task_type; pass task_type="SEMANTIC_SIMILARITY" to get a usable similarity scale
python litellm gemini embeddings semantic-similarity 149 tokens
litellm 1.102.1: transcription custom_vocabulary has no effect with gemini/gemini-3.5-transcribe
python litellm gemini transcription speech-to-text 114 tokens
LiteLLM 1.102.1: calling litellm.transcription(model="gemini/gemini-3.5-transcribe", file=("speech.webm", audio_bytes, "audio/webm")) with browser MediaRecorder recording fails with 400 from Gemini In
python litellm gemini transcription webm 208 tokens
vcrpy 8.3.0 httpx 0.28 LLM calls via litellm: CannotOverwriteExistingCassetteException in record_mode 'none' with new unrecorded calls
python vcrpy pytest litellm httpx 209 tokens
LiteLLM Gemini 2.5-flash with JSON mode intermittently returns trailing garbage after valid JSON
python litellm gemini json-mode llm 151 tokens
Gemini with LiteLLM/DSPy: "source_name" attribution mismatch from grounded search metadata
python gemini grounding llm-citations attribution 394 tokens
LiteLLM with Gemini: Retry loop fails to catch transport exceptions, only empty grounding chunks
python litellm gemini retry timeout 111 tokens
LiteLLM/DSPy: Gemini 3.1 Pro Preview's aggressive 250 RPD rate limit causes 429 errors
python gemini litellm dspy rate-limits 118 tokens
LiteLLM 1.86.2 'gemini-3.5-flash' unknown model error despite model_cost inclusion
python litellm gemini model-config 109 tokens
Python: Gemini 3 Pro Preview 404 NotFoundError after March 9, 2026 deprecation impacting LiteLLM/DSPy
python gemini litellm dspy model-deprecation 32 tokens
DSPy/litellm requires ANTHROPIC_API_KEY environment variable for Anthropic, overriding direct SDK configuration
python dspy litellm anthropic api-key 125 tokens