Skip to content
FunCoding

analyze-leaderboard-dynamics

Analyze leaderboard score distributions, compression/saturation, anomalies, selective reporting, and regime shifts.

Star
503
Category
Science
License
Apache-2.0
Last commit
Sep 29, 2026

skills/analyze-leaderboard-dynamics/SKILL.md

View on GitHub

analyze-leaderboard-dynamics

Purpose

Analyze leaderboard score distributions, compression or saturation, anomalies, selective reporting, and regime shifts.

Input contract

required: [leaderboard_records, metric_schema, time_or_version_field]
optional: [evaluation_protocols, source_quality, method_metadata]
constraints: [scores require task, metric, condition, source, and observation provenance]

Procedure

  1. Normalize scores and evaluation conditions into comparable groups.
  2. Inspect distributions, rank movement, compression, and missingness.
  3. Identify anomalies, selective reporting, and regime changes.
  4. State whether additional evidence is continuing, near-saturated, or saturated.

Output contract

produces: [leaderboard_distribution, regime_segments, anomaly_report, saturation_assessment]
delta_fields: [findings, evidence_updates, uncertainties, decisions]

Quality gates

  • Every reported regime or anomaly must cite the records and comparison basis.
  • Do not compare scores across incompatible protocols without an explicit limitation.

Failure and counterexamples

Do not treat rank order as progress when metric definitions or evaluation conditions changed; preserve ties and missing observations.

Provenance map

  • resolved: leaderboard-dynamics-analysis

Similar Skills

wiki-query

PApaperclipai/paperclip102k3,122 new stars in the last 7 days

Official

clinical-case-report

NEnexu-io/open-design101k1,146 new stars in the last 7 days

academic-paper-review

BYbytedance/deer-flow84k389 new stars in the last 7 days

systematic-literature-review

BYbytedance/deer-flow84k389 new stars in the last 7 days

directory-submissions

COcoreyhaines31/marketingskills55k1,019 new stars in the last 7 days

academic-paper

IMImbad0202/academic-research-skills52k1,065 new stars in the last 7 days