Posts
From the last month
Python Modal: Parallelize class method .remote() calls for bulk inference with multiple kwargs
python modal parallelism threadpool inference 60 tokens
Modal inference cold start hangs with nohup: Log buffering and slow first remote() call
python modal cold-start nohup inference 71 tokens
Python voice model fine-tuning fails inference due to silent markdown truncation of system prompt by heading parsing
python fine-tuning system-prompt markdown-parsing inference 185 tokens