subagent-driven-development
OBobra/superpowers298k近 7 天新增 2,631 个 star
nlp-pretraining
Best practices for language model pretraining and fine-tuning. Use when generating or reviewing NLP training code.
- Star
- 14,635
- 分类
- 扩展智能体
- 许可证
- MIT
- 最近提交
- 2026年8月19日
researchclaw/skills/builtin/domain/nlp-pretraining/SKILL.md
在 GitHub 上查看NLP Pretraining/Fine-tuning Best Practice
Fine-tuning recipe:
- Use pre-trained checkpoints (HuggingFace hub)
- AdamW optimizer, lr=2e-5 to 5e-5
- Linear warmup (6% of total steps) + linear decay
- Batch size: 16-32 (use gradient accumulation for larger effective batch)
- 3-5 epochs for classification, 1-2 for generation
- Weight decay: 0.01
Parameter-efficient methods:
- LoRA: r=8-64, alpha=16-128, apply to q/v projections
- Prefix tuning: 10-20 prefix tokens
- Adapters: bottleneck dimension 64-256
Evaluation:
- Classification: accuracy, F1 (macro for imbalanced)
- Generation: perplexity, BLEU/ROUGE, human evaluation
- Use multiple seeds and report mean +/- std
相似的 Skill
chief-of-staff
MAmattpocock/skills288k近 7 天新增 10,178 个 star
setup-matt-pocock-skills
MAmattpocock/skills288k近 7 天新增 10,178 个 star
ask-matt
MAmattpocock/skills288k近 7 天新增 10,178 个 star
agent-eval
AFaffaan-m/ECC278k近 7 天新增 4,046 个 star
autonomous-agent-harness
AFaffaan-m/ECC278k近 7 天新增 4,046 个 star