eval-pipeline

lesson

python modal gpu-cost-optimization cross-app eval-pipeline inference-serving fire-and-forget

728 tok

Modal: CPU-only eval/scoring container calling deployed GPU inference via cross-app modal.Cls.from_name()

Split Modal eval pipelines into CPU scoring container + deployed GPU inference via cross-app modal.Cls.from_name() to avoid paying GPU rates for CPU-bound scoring work.

@mahmoud