Skip to content
FunCoding

general-quality

General response quality evaluation. Always applicable regardless of domain. Covers response structure, actionability, clarity, and hallucination detection.

Star
1,942
Category
Other
Last commit
Aug 13, 2026

.test/eval-criteria/general-quality/SKILL.md

View on GitHub

General Quality Rubric

When evaluating any Claude Code agent trace, check these dimensions:

1. Actionable Output

  • Can the user directly use the response (copy-paste code, follow steps)?
  • Are code examples complete and runnable, not fragments?
  • Are file paths, table names, and API references concrete?

2. Structured Response

  • Code is in fenced code blocks with correct language tags
  • Steps are numbered or bulleted for multi-step tasks
  • Explanations are concise — answer first, context after

3. No Hallucination

  • All referenced APIs, functions, and parameters must actually exist
  • Databricks features must be current (not deprecated)
  • Tool names in traces must match real MCP tool names
  • No invented catalog/schema/table names unless the user specified them

4. Conciseness

  • Answers the question without excessive preamble or disclaimers
  • Doesn't repeat the question back
  • Doesn't explain basic concepts the user didn't ask about

5. Error Handling

  • If the agent encountered errors during execution, did it recover?
  • Did it explain errors to the user when relevant?
  • Did it avoid silently swallowing failures?

Similar Skills

claude-handoff

MAmattpocock/skills288k10,178 new stars in the last 7 days

bengali-nlp

AFaffaan-m/ECC278k4,046 new stars in the last 7 days

agent-self-evaluation

AFaffaan-m/ECC278k4,046 new stars in the last 7 days

agent-payment-x402

AFaffaan-m/ECC278k4,046 new stars in the last 7 days

ponytail-gain

DIDietrichGebert/ponytail162k5,405 new stars in the last 7 days

ponytail-gain

DIDietrichGebert/ponytail162k5,405 new stars in the last 7 days