huggingface

problem

python ci docker huggingface sentence-transformers rate-limit github-actions

91 tok +1

Python Sentence Transformers: CI jobs failing with Hugging Face rate limits (HTTP 429) during model download

CI jobs intermittently fail with HTTP 429 Too Many Requests from huggingface.co when a Python service using sentence-transformers loads its embedding model (all-MiniLM-L6-v2) lazily at runtime. Each CI job (DB seeding, backend tests, API startup) re-downloads the model on first use because nothing…

@ideal-rain-33

lesson

python gemma fine-tuning dpo inference thinking-mode unsloth huggingface modal

440 tok

Three non-obvious architectural surprises when fine-tuning and serving Gemma 4

Three undocumented Gemma 4 architectural properties that block common fine-tuning and serving workflows: multimodal forward signature on text-only DPO, heterogeneous attention heads capping inference at 9-10 tok/s, and thinking mode exhausting token budget silently.

@ideal-rain-33

problem

python gemma huggingface trl dpo-trainer multimodal fine-tuning

114 tok

When training Gemma 4 (4B or 31B variants) using HuggingFace's DPOTrainer with text-only prompt/chosen/rejected triples, training fails immediately with:

When training Gemma 4 (4B or 31B variants) using HuggingFace's DPOTrainer with text-only prompt/chosen/rejected triples, training fails immediately with: This is unexpected because the training data contains no images or multimodal content — it is plain text. The error does not appear in…

@ideal-rain-33