swe-re-expert

🏆 Quality Bar & Validation Standards

To transform Agentic Awesome Skills from a collection of scripts into a trusted platform, every skill must meet a specific standard of quality and safety.

What validation establishes

The following checks describe contributor expectations. Passing a structural check does not award a general reliability badge. Semantic review must identify its exact content, scope, reviewer or process, actual checks and remaining limitations.

1. Metadata Integrity

The SKILL.md frontmatter must be valid YAML and contain:

2. Clear Triggers (“When to use”)

The skill MUST have a section explicitly stating when to trigger it.

3. Safety & Risk Classification

Every skill must declare its risk level:

4. Copy-Pasteable Examples

At least one code block or interaction example that a user (or agent) can immediately use.

5. Explicit Limitations

A list of known edge cases or things the skill cannot do.

6. Instruction Safety Review

If a skill includes command examples, remote fetch steps, secrets, or mutation guidance, the PR must document the risk and pass npm run security:docs in addition to normal validation.

For pull requests that add or modify SKILL.md, GitHub also runs the automated skill-review workflow. Treat that review as part of the normal PR quality gate and address any actionable findings before merge. A successful result is reused when a later push has the identical changed-skill content; if Tessl credits are unavailable, the workflow records manual-review-required for exact-head maintainer attestation instead of pretending an automated review passed. Automated checks are necessary, but they do not replace manual reviewer judgment on logic, safety, and likely failure modes.

npm run security:docs enforces a repo-wide scan for:

Additional Maintainer Audit

Use npm run audit:skills when you need a repo-wide report that goes beyond schema validation and answers:

Risk labels remain declared metadata. The audit validates their presence and shape, while ambiguous risk: unknown cases require semantic review rather than lexical inference.


Provenance, compatibility and review evidence

Source attribution identifies origin; it does not prove current maintenance, efficacy or security. Do not infer reliability from “official”, “community”, a risk label or an unqualified “verified” badge. Keep original attribution and license notices when editing; record modifications without inventing upstream endorsement.

The compatibility map explicitly records retained duplicate IDs. Aliases keep complete local instructions and support files for offline use; they are not separate capabilities, recommendations or eligibility rules. Correct the primary editorial path and every alias together, and verify their body/bundle equality. Do not remove callable IDs or omit support files simply to improve duplicate counts.

The 2026-09-05 content review records a bounded cohort, file fingerprints, actual checks, retained aliases and remaining whole-corpus debt. A content fingerprint binds bytes, not truth or effectiveness. Review evidence becomes stale when those bytes change and cannot replace the exact-head merge gate.


How to Validate Your Skill

The canonical validator is tools/scripts/validate_skills.py, but the recommended entrypoint is npm run validate before submitting a PR:

npm run validate
npm run audit:skills
npm run validate:references
npm test
npm run security:docs

Notes: