Criteria for Selecting Indicators
Result Area:
Indicator = A measure that helps quantify achievement of a result.
Indicators allow us to measure progress toward the desired result and tell if we have accomplished the result.
Use of this Tool:
To analyze and select the strongest indicators possible for measuring desired results for children or families.
Instructions:
Rate each candidate indicator as high (3), medium (2) or low (1) for each factor or consideration. Indicate areas of particular concern (*) or where information is not known or available (?). Averaging the rating for each category allows you to consider each candidate indicator’s relative strengths and weaknesses. The overall average rating helps select the strongest indicator for the desired result.
I. Assessing Indicator Power
CANDIDATE INDICATOR: _________________________________
A. Data Power
_____ A.1. Accurate. (From a credible source.)
_____ A.2. Available nationally and for all 50 states.
_____ A.3. Multiple years of data. (At least three years, ideally more.)
_____ A.4. Up-to-date. (As recent as possible, ideally the most recent data point no more than 3 years old.)
_____ A.5. Missing data or gaps not significant or insurmountable.
_____ A.6. Can be disaggregated by race and/or ethnicity
_____ Average Data Power Rating
B.
Proxy Power
_____ B.1. Clearly central to the result we want to measure (E.g. low birth-weight rates are clear measure of healthy births.)
_____ B.2. Suggests or points to other indicators. (E.g., percentage of third graders reading at or above proficient level is indicative of school attendance and other crucial indicators.)
_____ B.3. Progress is likely to positively impact other indicators or results.
_____ Average Proxy Power Rating
C.
Communication Power
_____ C.1. Clearly understood and meaningful to lay people.
_____ C.2. Appeals to a broad range of constituencies.
_____ Average Communication Power Rating
_____ Overall Power of the Indicator
II. Prioritizing Indicators
Often there is strong agreement that more than one measure qualifies as a strong indicator. However, too many indicators can dilute their power and usefulness. The following considerations can help prioritize among the candidate indicators.
D.
Likelihood of Impact
_____ D.1.
Abundance of research evidence or practice experience that indicator can be improved through known, research-informed strategies.
_____ D.2.
Progress can be demonstrated with actual state examples/success stories.
_____ Average Likelihood of Impact Rating
E.
Potential for Cost Effectiveness
_____ E.1.
Cost of bad outcomes can or has been identified.
_____ E.2.
Cost benefit or cost containment can be identified.
_____ E.3.
Progress is linked to positive return on investment.
_____ E.4.
Low cost or no cost strategies possible.
_____ Average Potential for Cost Effectiveness Rating
F.
Political Power
_____ F.1.
Can be used to mobilize constituents.
_____ F.2.
Public interest or attention is evident.
_____ F.3.
Has bipartisan appeal, or not identified exclusively with one party or coalition.
_____ F.4.
Can be framed in alignment with or connected to priorities of institutional or political leaders.
_____ F.5.
Of significant interest to potential partners.
_____ F.6.
Not ideological or viewed as ideological.
_____ F.7.
Political timing, alignment with a focusing event. (E.g., media attention on related issue, election platforms.)
_____ Average Political Power Rating
G.
Scope
_____ G.1.
Progress contributes to racial equity.
_____ G.2.
Affects children of all races (even if to varying degrees).
_____ G.3.
Affects children and families in all states (even if to varying degrees).
_____ G.4.
Affects both rural and urban populations.
_____ Average Scope Rating
Which 3 or 4 measures appear to be the most powerful indicators for this result?
1.
2.
3.
4.
If there are more than 3 or 4 powerful indicators, are there “clusters” of indicators that should be considered?