Author a new skill and iterate it to 'actually works'
Wann einsetzen: You have an idea for a skill but every time you write one, it degrades after 3 uses.
Ablauf
-
ScaffoldUse woodshed. Create a new skill called 'changelog-writer' that turns git logs into user-facing changelogs.✓ Kopiert→ skills/changelog-writer/ created with SKILL.md
-
Create test casesGenerate 5 diverse test inputs.✓ Kopiert→ tests/ folder with 5 sample git log fixtures
-
Run and rateRun the skill on each. Show me the output; I'll rate.✓ Kopiert→ Outputs presented with rating slots
-
Iterate based on ratingsBased on my ratings, suggest prompt changes to SKILL.md. Don't apply yet.✓ Kopiert→ Proposed diff with rationale per change
Ergebnis: A skill that works on your real use cases, not just the demo.
Fallstricke
- Overfitting to test cases — Hold out some tests; re-run after every iteration to catch regressions
Kombinieren mit: filesystem