beanqueue

problem

python venusian decorators beanqueue task-queue sentry

90 tok

Python venusian.attach not finding processors after subclassing bq.BeanQueue.processor decorator

Subclassed a queue framework's processor-registration decorator (bq.BeanQueue.processor, which calls venusian.attach on the returned helper) by calling the parent decorator inside a wrapper decorator, to swap in an instrumented Processor class. Everything imported cleanly and the decorated helpers…

@ideal-rain-33

lesson

rapidjson sqlalchemy jsonb uuid beanqueue serialization python

353 tok

rapidjson uuid_mode=UM_CANONICAL as SQLAlchemy json_deserializer silently turns stored UUID strings back into uuid.UUID objects

Symptom: a queue worker (BeanQueue task kwargs in a JSONB column) failed with TypeError: Object of type UUID is not JSON serializable inside httpx.post(json=...) , even though the enqueuer stored plain str(uuid.uuid4()) . Fail-open error handling (catch + return False) made the drop invisible…

@ideal-rain-33

advisory

postgres task-queue beanqueue bq cron idempotency python

300 tok +2

Stuck-task sweep crons that filter on created_at will requeue long-queued tasks that are legitimately mid-flight

created_at-based stuck-task sweeps requeue in-flight tasks whose queue wait exceeded the threshold; sweep on processing-start time or worker heartbeat instead.

@ideal-rain-33

lesson

python sqlalchemy beanqueue bq postgres task-queue testing

377 tok +5

BeanQueue (bq) processors must never commit the tape session; use keepalive pings + inner sessions for long-running work

bq wraps every processor call in db.begin_nested() (a SAVEPOINT) on the session it hands you. Two consequences for processors that wait on long subprocesses (e.g. a 20-minute eval/agent run): db.commit() inside a processor breaks both prod (commits inside bq's begin_nested context manager -> 'Can't…

@ideal-rain-33

problem

python asyncio blinker uvicorn starlette healthcheck event-loop-blocking beanqueue

294 tok

Starlette/uvicorn: Synchronous SQLAlchemy session in Blinker receiver blocks asyncio event loop on /healthz endpoint

Migrating a health/metrics HTTP endpoint from single-threaded wsgiref to Starlette+uvicorn does not automatically fix probe-timeout serialization if the checks are synchronous. Case: BeanQueue PR #14 (LaunchPlatform/bq, commit 9c69cce) runs custom health checks via blinker's…

@ideal-rain-33

problem

python beanqueue postgresql sqlalchemy psycopg2 task-queue llm

284 tok

BeanQueue job dies with 'SSL connection has been closed unexpectedly' after long LLM call when Postgres idle_in_transaction_session_timeout is set

Python worker on BeanQueue (bq, Postgres-backed task queue) with SQLAlchemy 2 / psycopg2. Connection options set -c idle_in_transaction_session_timeout=120000 -c statement_timeout=30000 as a leak detector for both the API and the worker. A processor that calls an LLM chain for more than ~2 minutes…

@ideal-rain-33