source-evaluation
Source evaluation: classify FACT/INFERENCE/ASSUMPTION/RECOMMENDATION/UNKNOWN. Evidence before confidence; cross-check community vs authority.
Files1
View on GitHubSKILL.mdskills/research/source-evaluation/SKILL.md
GitHubsource-evaluation
Label everything you believe: FACT, INFERENCE, ASSUMPTION, RECOMMENDATION, UNKNOWN. Never promote upward without new evidence.
Activate when
- Any research output feeds an implementation decision; conflicting sources; uncertain claims.
Do NOT activate for
- Direct official-doc lookups with clear answers (still cite, but no ceremony).
Inspection
Collect the claim, its source, the source's level (L1–L8 per documentation-search), and any corroboration or contradiction.
Decision rules
- FACT: verified in official docs/tests for the installed version, or reproduced locally. INFERENCE: logically derived from facts (show the chain). ASSUMPTION: unverified but necessary (mark owner + expiry). RECOMMENDATION: judgment call (show trade-offs). UNKNOWN: insufficient evidence — triggers more research, never implementation.
- Official sources beat community 1:1; community needs either official corroboration or local reproduction to promote.
- Two agreeing low-level sources ≠ one high-level source. Count levels, not links.
Procedure
- Classify each load-bearing claim before coding.
- Resolve conflicts via the docs-vs-observed reconciliation (see documentation-search); record the outcome.
- ASSUMPTIONs get explicit owners and re-check points; UNKNOWNs block the dependent decision.
- Verify: decision record complete (see documentation-search templates), no UNKNOWN feeding code, assumptions tracked.
Failure modes
- Snippet-as-fact; version-mismatched facts; silent promotion of assumptions; cherry-picked corroboration; "everyone does it" as evidence.
Escalation
Ambiguous officials → source fallback chain in documentation-search; high-stakes calls → ask the user with options and evidence.
References
- Related:
../../research/documentation-search/,../technology-evaluation/.