Rubric Pattern

The concept of rubric patterns draws from educational assessment, where rubrics have been used for decades to standardize evaluation. In education, a rubric defines the criteria for assessment, the performance levels (excellent, proficient, developing, beginning), and the descriptors for each level. This ensures that different evaluators score the same work consistently and that students understand what is expected. Decision analysis rubric patterns extend this concept to multi-criteria evaluation of alternatives.

Different decision problems call for different scoring methodologies. Some decisions are best evaluated with absolute ratings — each alternative is scored independently on a fixed scale (1-5 or 1-10) for each criterion. Others benefit from pairwise comparison — alternatives are compared two at a time on each criterion, producing relative rather than absolute rankings. Still others require binary evaluation — does the alternative meet the criterion threshold or not? And some need distance-based scoring — how far is each alternative from the ideal on each criterion?

Rubric patterns can be categorized by their scoring mechanism. Weighted-sum patterns assign scores and multiply by weights (the classic decision matrix). Pairwise patterns compare alternatives in pairs and derive priorities from the comparison matrices (AHP-style). Distance patterns measure proximity to ideal and anti-ideal reference points (TOPSIS-style). Outranking patterns determine whether one alternative is at least as good as another on most criteria (ELECTRE, PROMETHEE). Threshold patterns evaluate whether alternatives meet minimum requirements before ranking those that pass (satisficing). Ordinal patterns rank alternatives on each criterion without numerical scores (Borda count, Condorcet method).

The choice of rubric pattern significantly influences the results. Different patterns handle ties, near-ties, and incomparabilities differently. Weighted-sum patterns always produce a total ordering with precise numerical differences. Outranking patterns may declare alternatives incomparable if neither dominates the other. Distance patterns emphasize balance across criteria (an alternative that is good on everything beats one that is excellent on some things and poor on others). Understanding these structural differences is essential for choosing the right analytical approach.

In professional practice, the most robust analyses apply multiple rubric patterns to the same decision and compare the results. If the same alternative wins regardless of whether you use weighted-sum, pairwise comparison, or distance-based scoring, the recommendation is robust. If different patterns produce different winners, the choice of methodology matters — and that methodological sensitivity itself is a valuable finding that should inform the decision process.