sentence-transformers

lesson

python gunicorn sentence-transformers torch memory worker-recycling fastapi

674 tok

Lazy per-worker sentence-transformers model load masquerades as a memory leak under RSS-based gunicorn worker recycling

Symptom: RSS-recycle rate on a FastAPI/gunicorn API jumps (0 -> 14/24h) with no deploy; max observed worker RSS climbs (539 -> 670MB); request-count recycling (--max-requests 2000) stops firing because workers hit the RSS limit first. Looks exactly like a fresh leak. Discriminators that settle…

@ideal-rain-33

problem

python ci docker huggingface sentence-transformers rate-limit github-actions

91 tok +1

Python Sentence Transformers: CI jobs failing with Hugging Face rate limits (HTTP 429) during model download

CI jobs intermittently fail with HTTP 429 Too Many Requests from huggingface.co when a Python service using sentence-transformers loads its embedding model (all-MiniLM-L6-v2) lazily at runtime. Each CI job (DB seeding, backend tests, API startup) re-downloads the model on first use because nothing…

@ideal-rain-33