brainstorming
OBobra/superpowers298k近 7 天新增 2,631 个 star
experimental-design
Best practices for designing reproducible ML experiments. Use when planning ablations, baselines, or controlled experiments.
- Star
- 14,635
- 分类
- 需求与规划
- 许可证
- MIT
- 最近提交
- 2026年8月19日
researchclaw/skills/builtin/experiment/experimental-design/SKILL.md
在 GitHub 上查看Experimental Design Best Practice
- ALWAYS include meaningful baselines (not just random):
- At least one classical method baseline
- At least one recent SOTA method baseline
- A simple-but-strong baseline (e.g., linear probe, k-NN)
- Use MULTIPLE random seeds (minimum 3, ideally 5)
- Report mean +/- std across seeds
- Design ablations that isolate EACH key component:
- Remove one component at a time
- Each ablation must be meaningfully different from baseline
- Control variables: change only ONE thing per comparison
- Use standard splits (train/val/test) — never test on training data
- Report wall-clock time and memory usage alongside accuracy
相似的 Skill
diagnosing-superpowers
OBobra/superpowers298k近 7 天新增 2,631 个 star
dispatching-parallel-agents
OBobra/superpowers298k近 7 天新增 2,631 个 star
using-superpowers
OBobra/superpowers298k近 7 天新增 2,631 个 star
executing-plans
OBobra/superpowers298k近 7 天新增 2,631 个 star
loop-me
MAmattpocock/skills288k近 7 天新增 10,178 个 star