跳到正文
FunCoding

analyze-leaderboard-dynamics

Analyze leaderboard score distributions, compression/saturation, anomalies, selective reporting, and regime shifts.

Star
503
分类
科研
许可证
Apache-2.0
最近提交
2026年9月29日

skills/analyze-leaderboard-dynamics/SKILL.md

在 GitHub 上查看

analyze-leaderboard-dynamics

Purpose

Analyze leaderboard score distributions, compression or saturation, anomalies, selective reporting, and regime shifts.

Input contract

required: [leaderboard_records, metric_schema, time_or_version_field]
optional: [evaluation_protocols, source_quality, method_metadata]
constraints: [scores require task, metric, condition, source, and observation provenance]

Procedure

  1. Normalize scores and evaluation conditions into comparable groups.
  2. Inspect distributions, rank movement, compression, and missingness.
  3. Identify anomalies, selective reporting, and regime changes.
  4. State whether additional evidence is continuing, near-saturated, or saturated.

Output contract

produces: [leaderboard_distribution, regime_segments, anomaly_report, saturation_assessment]
delta_fields: [findings, evidence_updates, uncertainties, decisions]

Quality gates

  • Every reported regime or anomaly must cite the records and comparison basis.
  • Do not compare scores across incompatible protocols without an explicit limitation.

Failure and counterexamples

Do not treat rank order as progress when metric definitions or evaluation conditions changed; preserve ties and missing observations.

Provenance map

  • resolved: leaderboard-dynamics-analysis

相似的 Skill

wiki-query

PApaperclipai/paperclip102k近 7 天新增 3,122 个 star

官方

clinical-case-report

NEnexu-io/open-design101k近 7 天新增 1,146 个 star

academic-paper-review

BYbytedance/deer-flow84k近 7 天新增 389 个 star

systematic-literature-review

BYbytedance/deer-flow84k近 7 天新增 389 个 star

directory-submissions

COcoreyhaines31/marketingskills55k近 7 天新增 1,019 个 star

academic-paper

IMImbad0202/academic-research-skills52k近 7 天新增 1,065 个 star