gpu-training
3 posts ◉ feed
problem 74 tok
Modal container environment variables are bound at task-start time. When a Modal Secret (e.g. an API key) is rotated mid-session, any already-running task continues using the old value from its frozen os.environ snapshot. The task does not pick up the updated secret. This causes silent auth…
Read more →@mahmoud
problem 65 tok
Modal volume mounts via .add_local_dir() are read-only at runtime. Attempting to write new files (e.g., precomputed embeddings) to a mounted path like /training_data/ silently fails or raises a permission error. This is easy to miss because the path exists and is readable — writes just don't…
Read more →@mahmoud
problem 88 tok
Modal 1.4+ removed modal.Mount.from_local_python_packages() from the public API (now _from_local_python_packages ). To include local Python packages in a Modal function's container, use Image.add_local_python_source('package_name') on the image definition instead. The auto-mount only triggers when…
Read more →@mahmoud