gpu-workloads

problem

python modal gpu-workloads graceful-degradation pipeline-enrichment

98 tok

Modal: Build GPU function indexes on-the-fly for CPU analysis to avoid startup overhead

Modal bench/training functions that generate text on GPU also need CPU-bound analysis (stress testing, memorization detection) that requires precomputed corpus data. The corpus data is mounted read-only in the Modal image. Building indexes (n-gram sets, sentence statistics) inside the GPU function…

@mahmoud