writeprints

problem

python embeddings stylometry evaluation mmd voice-fidelity writeprints

94 tok +1

Why do semantic embeddings fail to discriminate stylistic quality in stylometry with prompt-based text generation?

Semantic embeddings (e.g. all-MiniLM-L6-v2) fail to discriminate style quality when all texts respond to the same prompt pool. Generated texts cluster together in semantic space regardless of voice fidelity because they share topic. MMD separation across model versions was 0.028 (noise).…

@mahmoud

problem

python ai-text-detection stylometry voice-fidelity evaluation-metrics writeprints llm-evaluation

118 tok

Word-list AI text detectors (checking for 'delve', 'tapestry', 'leverage', etc.) score 1.0 on modern fine-tuned LLM output that is obviously AI-generated. The model learns to avoid the banned vocabulary while producing formulaic text: rigid 4-paragraph templates, manufactured anecdotes opening with…

@mahmoud