AwardGrade Methodology
AwardGrade evaluates business and professional recognition programs so that entrants (founders, professionals, and the agencies that represent them) can make informed decisions before spending money or attaching their reputation to a program. The same three-state scoring model and grade bands apply across every content type below; only the category set differs.
1. Why Scored Separately
A ranking is a list, not a contest. Nobody "wins" a ranking, so the Awards rubric’s selectivity and winner-rate logic does not apply; a "Top 100" is not more or less legitimate for naming 100 rather than 10. The question is whether the list was built honestly: is there a real method, is the underlying data sound, is the ranker independent of those it ranks, and is placement free of pay-for-play.
This methodology replaces the Awards rubric’s selectivity category with methodology and data integrity as the load-bearing measure, and raises pay-for-placement to a category of its own. The scoring mechanics, grade bands, Automatic-F logic, and Insufficient-Disclosure designation are identical to the Awards and Certifications methodologies, so grades remain comparable across content types. Only the categories differ.
2. Design Principles
Shared with the Awards methodology and applied identically: mechanical scoring; evidence-cited and archived sources; charging fees is not penalized (we score disclosure and structure); disclosure can never hurt more than concealment; opacity is Insufficient Disclosure, not misconduct; facts first, opinion labeled; no double counting. Three-state scoring: verified-good (full points), documented-bad (0), or undisclosed (removed from both numerator and denominator).
3. The Rubric: 100 Points
Category 1: Methodology & Data Integrity, 30 points
Disclosed, substantive method exists: 8 pts
An actual methodology, not an editor’s pick with no stated basis.
Built on measured data, not self-report or vote: 10 pts (tiered)
Pure self-nomination or public vote = 0 → self-reported survey = 4 → mix of measured and reported = 7 → independently measured or audited data = 10.
Sample / coverage is adequate: 7 pts
Assesses a real universe of candidates, not just whoever responded or paid attention.
Method applied consistently across entries: 5 pts
The same criteria and weights for everyone on the list.
Category 2: Independence from the Ranked, 20 points
Ranker independent of those ranked: 8 pts
Not a trade body ranking its own members, not a vendor ranking its own customers.
Placement not influenced by advertising or relationship: 8 pts
Buying ads or a media relationship does not move a subject up the list.
No consult-and-rank conflict: 4 pts
The ranker does not sell services to the entities it ranks.
Category 3: Pay-for-Placement & Commercial Conflict, 20 points
Inclusion/rank not contingent on payment: 8 pts
No one pays to appear, and no one can pay to rank higher.
Sponsored entries clearly separated from earned: 6 pts
If paid placements exist, they are visually and explicitly distinguished from earned ones.
Badge/reprint licensing not required and doesn’t affect rank: 3 pts
Placement does not hinge on buying the badge or reprint rights.
Fees (if any) disclosed and within norms: 3 pts
Any fees are published and comparable to legitimate rankings.
Category 4: Transparency & Verifiability, 15 points
Methodology published: 5 pts
The method is publicly available, not proprietary-secret.
Weights / criteria disclosed: 4 pts
What factors count and how much they weigh is published.
Data sources citable: 3 pts
The inputs can be identified and, ideally, checked.
Placement reproducible / verifiable: 3 pts
A third party could broadly reproduce or sanity-check the ordering.
Category 5: Publisher Credibility & Ethics, 15 points
Established publisher: 6 pts
A real, durable outlet or institution behind the list.
No false or misleading marketing: 5 pts
The list does not overstate its rigor or independence.
Corrections / update policy: 4 pts
There is a stated way errors get fixed and the list gets refreshed.
4. Grade Bands
The numeric score is always displayed alongside the letter. Automatic F is displayed distinctly from a scored F.
5. Automatic F: Overrides Any Score
- Pay-to-be-listed. Placement is bought outright: pay to appear, or pay more to rank higher.
- No method at all. The list is arbitrary or self-nomination-only with no assessment.
- Fabricated or misrepresented data or credentials.
6. Structural Cap: Undisclosed Sponsorship
If a ranking mixes paid and earned placements without visually distinguishing them, the grade is capped at C regardless of methodological strength elsewhere. An undisclosed-sponsorship list actively misleads the reader: it presents bought positions as if earned. That is a more corrosive defect than a weak-but-honest method, so it caps the ceiling even when the rest of the process is sound. It stops short of Automatic F, which is reserved for outright pay-to-list.
7. Insufficient Disclosure (ID)
If more than 40% of the total points are undisclosed (no published method, no data source, no criteria), the ranking cannot be responsibly graded and receives the ID designation instead of a letter. ID is neutral and lists exactly what is undisclosed.
8. Language Standards
AwardGrade does not render its own verdict-in-words about a ranking. It states what the method is and what the record shows, and lets the grade carry the conclusion.
“The list is built on a disclosed methodology combining self-reported survey data and independently measured revenue figures; sponsored placements are not visually distinguished from earned ones.”