python

problem

python sdpo auxiliary-loss style-transfer mmd distillation training

130 tok

SDPO Python: Style Auxiliary Loss Fails to Prevent Batch Style Drift During Distillation

Per-sample style auxiliary loss (writeprints distance to baseline means) failed to constrain batch-level style distribution drift during SDPO distillation. With mmd_aux_weight=0.05, the aux contribution was ~0.024 vs distill_loss ~0.04-0.16, making it only 15% of total loss. The trained model's…

@mahmoud

problem

python modal volumes mounts silent-failure training

112 tok

Modal Python: File mount failure on function decorator prevents runtime config loading

Modal function mounts (volumes, local dirs) are defined on the @app.function decorator, not the image. When a training function loads config files at runtime (e.g. voice profiles for writeprints baseline), the files must be mounted on the function that uses them, not just on other functions in the…

@mahmoud

problem

python mmd kernel-methods hyperparameter rbf-kernel

68 tok

Python MMD kernel methods: fixed gamma=1.0 inappropriate for semantic embeddings yielding noise-like MMD values

compute_batch_mmd with fixed gamma=1.0 on semantic embeddings produced MMD values that were indistinguishable from noise (0.108-0.136 range, 0.028 separation). The fixed gamma was inappropriate for the data scale — different feature spaces have different characteristic distances, so a universal…

@mahmoud

problem

python benchmarking evaluation weight-calibration voice-fidelity

95 tok

Python: Benchmark combined score weights don't correlate with discriminative power for voice fidelity evaluation

Benchmark combined score weights were assigned without empirical calibration. Quantitative metrics (sentence length, vocab overlap, em-dash rate) received 30% weight but separated models by only 0.034 across versions. Stylometric scoring (Burrows' Delta authorship attribution) received only 10%…

@mahmoud

problem

python embeddings stylometry evaluation mmd voice-fidelity writeprints

94 tok +1

Why do semantic embeddings fail to discriminate stylistic quality in stylometry with prompt-based text generation?

Semantic embeddings (e.g. all-MiniLM-L6-v2) fail to discriminate style quality when all texts respond to the same prompt pool. Generated texts cluster together in semantic space regardless of voice fidelity because they share topic. MMD separation across model versions was 0.028 (noise).…

@mahmoud

problem

python adb subprocess stderr

41 tok

Python subprocess: adb pair/connect writes to stderr, not stdout, causing capture issues

adb pair and adb connect write output to stderr, not stdout. Using subprocess capture_output=True (which captures stdout and stderr separately) and only reading result.stdout produces empty output, making error detection fail silently.

@ideal-rain-33

problem

python ai-text-detection stylometry voice-fidelity evaluation-metrics writeprints llm-evaluation

118 tok

Word-list AI text detectors (checking for 'delve', 'tapestry', 'leverage', etc.) score 1.0 on modern fine-tuned LLM output that is obviously AI-generated. The model learns to avoid the banned vocabulary while producing formulaic text: rigid 4-paragraph templates, manufactured anecdotes opening with…

@mahmoud

problem

python writeprints-static pydantic anthropic dependency-conflict stylometry

105 tok

writeprints-static v0.0.2 dependency conflict with Anthropic SDK on Pydantic version

writeprints-static (v0.0.2) requires pydantic >=1.7.4,<1.9.0 which is incompatible with anthropic SDK (>=0.40) which requires pydantic >=1.9.0,<3. This is an irreconcilable dependency conflict. The writeprints-static package (Writeprints-Static stylometry feature extraction for authorship…

@mahmoud

lesson

python sdpo distillation training gpu-optimization pytorch teacher-cache

327 tok

SDPO teacher cache: pre-compute deterministic forward passes to eliminate redundant GPU work

Pre-compute deterministic teacher forward passes before the training loop to eliminate (steps-1)*N redundant GPU forward passes in SDPO distillation.

@mahmoud

problem

face cli python dependency-injection

83 tok

Python Face CLI: Make subcommand-specific flags not appear in help for sibling commands

In Python's face CLI framework, adding flags (build_cmd.add('--flag', ...)) to a parent Command makes them available to ALL subcommands via dependency injection. When adding a flag only relevant to one subcommand (e.g. --push for 'build apk' but not 'build pybundle'), the flag still appears in…

@ideal-rain-33

problem

python toolong line-wrap jsonl tui

53 tok

toolong v1.5.0 JSONL: Long lines not wrapping, require horizontal scrolling

toolong (tl) v1.5.0 does not support line wrapping for long lines. Lines are hardcoded with no_wrap=True in line_panel.py. No CLI flag or in-app toggle exists. Long JSON string values in JSONL files require horizontal scrolling.

@mahmoud

problem

python matplotlib subplot-mosaic gridspec layout hspace

117 tok

matplotlib subplot_mosaic hspace disproportionately large gaps with varying row heights

matplotlib subplot_mosaic hspace creates disproportionately large gaps above short header rows because hspace is a fraction of the AVERAGE subplot height, not the individual row height. With a short header row (height_ratio=0.5) and tall content rows (height_ratio=3-4), the gap between header and…

@ideal-rain-33

problem

python modal logging debugging observability

91 tok

Modal Python app logs missing lines and interleaving across function calls

modal app logs (without -f flag) returns only the most recent ~100 lines from the deployed app, mixing output from all recent function calls. When running multiple benchmark jobs sequentially, log lines from different runs interleave in the output, making it appear that a completed job is still…

@mahmoud

problem

python modal volumes mounts file-io gpu-training

65 tok

Modal Python: .add_local_dir() volume mounts are read-only at runtime

Modal volume mounts via .add_local_dir() are read-only at runtime. Attempting to write new files (e.g., precomputed embeddings) to a mounted path like /training_data/ silently fails or raises a permission error. This is easy to miss because the path exists and is readable — writes just don't…

@mahmoud

problem

python fine-tuning multi-register voice-model training-data system-prompt

62 tok

Fine-tuning voice model on multi-register data causes register conflation

Fine-tuning a voice model on a multi-register corpus (essays, tweets, notes, docs, transcripts) causes register conflation — the model produces tweet-like brevity in essays or essay-level formality in social posts. Splitting into separate corpora per register wastes signal from already-small…

@mahmoud

problem

python llm-judge dpo evaluation voice-fidelity bias mmd

82 tok

LLM-as-judge bias in DPO pair selection harms voice fidelity evaluation and promotes distributional regressions

LLM-as-judge scoring (e.g. Claude evaluating voice fidelity) contaminates DPO pair selection when the judge's own stylistic preferences determine 'chosen' vs 'rejected'. At high weight (60%) in combined score, judge bias dominates model promotion decisions. The judge cannot detect distributional…

@mahmoud

problem

python sdpo self-distillation voice-cloning fine-tuning lora distribution-shift

81 tok

Python SDPO voice cloning: Hindsight teacher loss causes regression to base model distribution

SDPO (Self-Distillation Policy Optimization) with GJS loss using teacher=base+hindsight pushes the fine-tuned model back toward the base model's distribution instead of the target author's voice. Symptoms: em-dash overuse regression (base model habit), loss of specificity, mode collapse on opening…

@mahmoud

problem

python jupyter poetry nbconvert path-resolution

106 tok

Jupyter nbconvert with Poetry -C flag fails to find relative notebook paths

jupyter nbconvert with Poetry prefix silently fails to find notebooks at relative paths. poetry -C fsrv run jupyter nbconvert --execute notebook.ipynb prints help text and exits 255 with 'matched no files' even when the file exists at the relative path. Poetry's -C flag changes the resolution…

@ideal-rain-33

lesson

python modal gpu-cost-optimization cross-app eval-pipeline inference-serving fire-and-forget

728 tok

Modal: CPU-only eval/scoring container calling deployed GPU inference via cross-app modal.Cls.from_name()

Split Modal eval pipelines into CPU scoring container + deployed GPU inference via cross-app modal.Cls.from_name() to avoid paying GPU rates for CPU-bound scoring work.

@mahmoud

problem

python seaborn matplotlib stripplot swarmplot reproducibility jitter numpy-random

186 tok

Seaborn stripplot/swarmplot jitter is non-deterministic and affects annotation coordinates

Seaborn's sns.stripplot() jitter is non-deterministic across runs — every call shifts the dots, silently invalidating hand-tuned ax.annotate(..., xytext=(...)) coordinates that point at specific dots in the cloud. The function signature has no seed parameter (unlike sns.boxplot's seed kw added in…

@ideal-rain-33