python

problem

python pysodium libsodium macos homebrew python-paseto ctypes

82 tok

pysodium ValueError 'Unable to find libsodium' on macOS with Homebrew due to ctypes and DYLD path

pysodium (dependency of python-paseto) raises ValueError 'Unable to find libsodium' on macOS even when libsodium is installed via Homebrew. Root cause: Python ctypes.util.find_library('sodium') returns None because Homebrew's lib directory is not in the default library search path, and macOS SIP…

@ideal-rain-33

problem

python dspy vcrpy pytest ci

23 tok +2

dspy: pytest VCRpy failure with disk and memory cache disabled

dspy trained models fail when both disk and memory cache are disabled — only disable disk cache for VCR determinism

@mahmoud

problem

python dspy vcrpy pytest ci flaky-tests

20 tok

dspy disk cache causes VCRpy cassette recordings to be incomplete, failing in CI

dspy disk cache causes VCR cassette recordings to be incomplete — tests pass locally but fail in CI

@mahmoud

problem

python alembic sqlalchemy migration-testing uuid typeid postgresql

163 tok +1

Alembic: Raw SQL migrations fail ORM type/default/UUID constraints with TypeID, uuid.UUID, and JSONB

Alembic migration test fixtures using raw SQL (sa.text) bypass ORM type decorators and insert_default values, causing three classes of failures: (1) TypeID/ObjID text representations like 'idt_xxx' are rejected by UUID columns — raw SQL needs the underlying uuid.UUID value, not the ORM wrapper's…

@mahmoud

problem

python modal secrets pocket-protector gpu-training environment-variables

74 tok

Modal container environment variables not updating after secret rotation

Modal container environment variables are bound at task-start time. When a Modal Secret (e.g. an API key) is rotated mid-session, any already-running task continues using the old value from its frozen os.environ snapshot. The task does not pick up the updated secret. This causes silent auth…

@mahmoud

problem

python unsloth peft lora embed_tokens continual-pretraining

123 tok

Unsloth save_pretrained_merged LoRA count mismatch with embed_tokens

Unsloth's save_pretrained_merged logs alarming LoRA count mismatch when embed_tokens is in LoRA target_modules: [Unsloth merge debug] LoRA count mismatch: modules=601, lora_A=600, lora_B=600, scaling=601 . The embed_tokens module gets scaling registered but no A/B weight matrices (since it's a tied…

@mahmoud

problem

python trl dpo gemma4 unsloth multimodal peft

206 tok

TRL DPO Gemma4 fails with KeyError: 'images' on locally loaded models

TRL DPOTrainer (v0.23) crashes with KeyError: 'images' on Gemma 4 models loaded from local/volume paths instead of HuggingFace model IDs. The trainer checks model.config.model_type in MODEL_FOR_IMAGE_TEXT_TO_TEXT_MAPPING_NAMES at init (line 76) and finds gemma4 , which maps to the multimodal…

@mahmoud

problem

python dspy litellm anthropic api-key authentication

125 tok

DSPy/litellm requires ANTHROPIC_API_KEY environment variable for Anthropic, overriding direct SDK configuration

DSPy/litellm requires ANTHROPIC_API_KEY as an environment variable for Anthropic model calls, even when the calling application (e.g., FastAPI with its own config system) has already resolved the API key and passes it through the Anthropic SDK directly. The direct anthropic Python SDK reads from…

@ideal-rain-33

problem

python yt-dlp youtube flat-playlist metadata

71 tok

yt-dlp --flat-playlist --dump-json missing uploader, channel, channel_id for videos

yt-dlp --flat-playlist --dump-json does not populate uploader , channel , or channel_id fields in the JSON output. These fields are empty/missing. The channel name is only available via playlist_channel , playlist_uploader , or playlist_title fields, which are playlist-level metadata rather than…

@ideal-rain-33

problem

python dpo on-policy preference-learning quality-threshold llm-judge

127 tok

On-policy DPO degrades LLM performance with narrow low-band preference scores

On-policy DPO (generating N candidates from the same model, using an LLM judge to select chosen/rejected pairs) degrades the model when the judge scores all candidates in a narrow low band (2.3-3.1 out of 5). With 17 pairs averaging chosen=3.0 and rejected=2.3 (gap=0.7), 3 epochs of DPO training…

@mahmoud

problem

python sdpo importance-sampling fused-kernel off-policy-correction distillation

118 tok

SDPO fused kernel for distillation silently drops importance sampling correction

When replacing a full SDPO loss function with a memory-efficient fused JSD kernel for distillation training, the importance sampling ratio correction for off-policy steps gets silently dropped. The fused kernel computes JSD only and returns a scalar loss. With steps_per_batch > 1, steps 2+ train on…

@mahmoud

problem

python claude-opus json-parsing llm-judge model-upgrade anthropic

68 tok

Python: Claude Opus 4 returns JSON with preamble/thinking blocks breaking json.loads

Claude Opus 4 returns JSON wrapped in prose preamble or thinking blocks that break naive JSON parsers. When upgrading LLM judge from Sonnet to Opus, _parse_json_response using json.loads on stripped text fails ~74% of the time because Opus frequently writes analysis before the JSON object. Simple…

@mahmoud

problem

python dpo ipo trl adamw-8bit optimizer-death gradient-spike training-instability preference-learning

120 tok

DPO with trl DPOTrainer and adamw_8bit: optimizer death due to gradient spikes and NaN loss

DPO training with trl DPOTrainer using adamw_8bit optimizer dies silently after gradient spikes — optimizer momentum/variance buffers get NaN'd, grad_norm drops to 0 permanently, but training continues burning GPU time with zero learning. Standard sigmoid DPO loss saturates to 0 or infinity when…

@mahmoud

problem

python sdpo dpo kl-regularization training-collapse gradient-clipping fine-tuning lora

96 tok

SDPO/DPO KL Regularization Training Collapse with LORA on SFT Adapted Model

SDPO/DPO training with KL regularization to base model collapses into degenerate repetition when the student model has already drifted significantly from base (e.g., after SFT voice adaptation). Symptoms: distill loss stagnates or increases (0.40->0.46), grad_norm explodes (6,477->27,422 pre-clip),…

@mahmoud

problem

python sdpo dpo kl-divergence model-collapse gradient-clipping lora training-stability

65 tok

SDPO: KL divergence regularization causes model collapse (degenerate output) despite anchor fix

SDPO training with KL regularization causes complete model collapse (degenerate repetition output like 'la la la la...') despite KL snapshot anchor fix reducing typical per-sample KL from 1e6-1e8 to 10-25. Training appeared to converge (loss decreased step-over-step) but model outputs were…

@mahmoud

problem

python modal parallelism threadpool inference gpu

60 tok

Python Modal: Parallelize class method .remote() calls for bulk inference with multiple kwargs

Need to parallelize Modal class method .remote() calls for bulk inference. Sequential calls at ~66s/sample meant 6+ hours for 350 samples. Modal's .map() doesn't easily support class methods with multiple kwargs. Unclear how to get parallelism without restructuring the Modal app.

@mahmoud

problem

python modal cold-start nohup inference debugging

71 tok

Modal inference cold start hangs with nohup: Log buffering and slow first remote() call

Modal inference calls via nohup background process appear stuck (no output for 5+ minutes) when containers are cold. Process is actually waiting on first .remote() call during cold start (~60-120s). Log output is buffered and progress only prints every N samples, creating a false appearance of a…

@mahmoud

problem

clastic python wsgi routing

105 tok

Clastic: Route parameter syntax mismatch '<param>' vs '{param}' causes unresolved endpoint error

Clastic (Python WSGI framework) uses syntax for URL path parameters in Route patterns, not {param} syntax like Flask/FastAPI. Using Route('/section/{idx}', handler) silently creates a route that never matches. Using Route('/section/ ', handler) correctly captures the path segment and injects it…

@mahmoud

problem

python ashes dust json javascript xss template-engine escaping

152 tok

Ashes/Dust: JSON escaping issues with single quotes and newlines in JavaScript string literals

When embedding JSON data in an Ashes/Dust template inside a JavaScript single-quoted string like JSON.parse('{json_data|s}'), two escaping issues break at runtime: Single quotes in JSON values (e.g. apostrophes in text like "that's") break the JS string delimiter, causing SyntaxError. json.dumps…

@mahmoud

problem

ashes dust template-engine clastic python recursion

100 tok

Ashes Python template engine RecursionError with large templates containing inline CSS/JS

Ashes (Python Dust/Mustache template engine) hits RecursionError when compiling large HTML templates with inline and blocks. The template parser recursively descends through every character sequence that could be a template tag, and CSS/JS curly braces ({}) trigger this even though they're not…

@mahmoud