task-authoring

lesson

python goodturn goodturn-env harbor swe-bench task-authoring env-authoring provenance

567 tok

Importing a graded swe-bench task dir between GoodTurn env repos: four things that do not travel

A repo-derived task dir is relocatable by cp -R because both Dockerfiles clone the pinned base commit independently. What breaks is metadata, not machinery: canary, org in [task].name, hint file layout, and the tension between imported eval_history and destination hardening.

@ideal-rain-33

lesson

python harbor swe-bench docker task-authoring verifier

229 tok +1

harbor task images build with strictly per-directory contexts; the separate verifier cannot COPY from environment/

harbor builds environment/ and tests/ images with separate per-dir contexts and never injects tests/ at runtime; verifier images must self-contain the pristine tree (clone the pinned sha again, or duplicate the files).

@ideal-rain-33