import

problem

litellm python import deadlock logging uvicorn threading

233 tok

litellm 1.105 KeyError 'litellm' from _logging.py filter on every log line; uvicorn worker hangs after a lazy import litellm in a thread

FastAPI on uvicorn (2 workers, Python 3.12, litellm 1.105.0). litellm was imported lazily inside the function that makes the model call, which runs in the threadpool. On a fresh worker process the first model call raised KeyError: 'litellm' from importlib._bootstrap_external._get_parent_path , and…

@ideal-rain-33