Standard Group Report Calculation Reference Guide

This guide outlines how the calculations in our standard 360-degree feedback PDF group reports are generated. Note that if you have enlisted EchoSpan to build custom reports for your company, some or all of the calculation methods below may be overridden by your own rules.

EchoSpan Standard Group Report

Results are calculated by taking the results from each individual Target’s report scores and averaging them together as a group. The resulting group scores will be the same as if you took each Target’s PDF report and averaged scores across Targets together. In other words, this method weights each Target in the group evenly. 

Item-level Scores

Item Scores for a "Relationship Group"
Item scores are calculated for each Rater group by taking the average of all Respondents in a particular group (Peers, Direct Reports, etc.). In order for a score to be calculated, the following criteria must be met for each rating:

1. The Rater must be in an "In Progress" or "Finished" status.
2. The review question must be a rated item, reverse-scored item or a behavioral anchor item.
3. The response must be non-zero (calculations exclude "not observed" or "not applicable" ratings).
4. The question cannot be a "hidden" item.
5. The number of responses to the item cannot be below the minimum response filter value (optional).

Item Scores for the "Self-Rater"
Item scores for the "Self-Rater" are presented as entered and must meet the following criteria:

1. The review question must be a rated item, reverse-scored item or a behavioral anchor item.
2. The response must be non-zero (calculations exclude "not observed" or "not applicable" ratings).
3. The question cannot be a "hidden" item.

Item Scores for the "Overall" or "All Raters" Group
Item scores for "All Raters" are calculated by taking the average of all Respondents as if they were part of a single relationship group. In order for a score to be calculated, the following criteria must be met for each rating:

1. The Rater is not a Self-Rater.
2. The Rater must be in an "In Progress" or "Finished" status.
3. The review question must be a rated item, reverse-scored item or a behavioral anchor item.
4. The response must be non-zero (calculations exclude "not observed" or "not applicable" ratings).
5. The question cannot be a "hidden" item.

Item Scores for the "Benchmark"
Item scores for "Benchmark" are calculated by taking the average of all Respondents as if they were part of a single relationship group for all Targets in the review project. If Target-level benchmark “profiles” are in place (an advanced feature), they will be ignored during the calculation of group report benchmarks. In order for a score to be calculated, the following criteria must be met for each rating:

1. The Rater is not a Self-Rater.
2. The Rater must be in an "In Progress" or "Finished" status.
3. The review question must be a rated item, reverse-scored item or a behavioral anchor item.
4. The response must be non-zero (calculations exclude "not observed" or "not applicable" ratings).
5. The question cannot be a "hidden" item.

Competency-level Scores

Competency Scores for a "Relationship Group"
Competency scores for each "Relationship Group" are calculated by taking the average of all item scores for that "Relationship Group" (Peers, Direct Reports, etc). This way, all item scores bear the same weight regardless of the number of Respondents to each in calculating the competency score. Blank or "0" item scores are omitted. Competencies must be a "scored" competency (not classified as a comments-only review section. This is the default setting, but should be checked if report output is unexpected.)

Competency Scores for the "Overall" or "All Raters" Group
Competency scores for "All Raters" are calculated by taking the average of all item scores for the "Overall" or "All Raters" group. This way, all item scores bear the same weight regardless of number of Respondents to each in calculating the competency score. Blank or "0" item scores are omitted. Competencies must be a "scored" competency (not classified as a comments-only review section. This is the default setting, but should be checked if report output is unexpected.)

Competency Scores for the "Benchmark"
Competency scores for the "Benchmark" group (all Targets in the review project) are calculated by taking the average of all item scores for the "Benchmark" group. This way, all item scores bear the same weight regardless of number of Respondents to each in calculating the competency score. Blank or "0" item scores are omitted. Competencies must be a "scored" competency (not classified as a comments-only review section. This is the default setting, but should be checked if report output is unexpected.)

Overall Review Score

The Overall Review Score for the review can be calculated for the "Overall" or "All Raters" group, as well as for each individual Rater group. In either case, it is equal to the average of all overall item scores in the entire review or the item scores for a particular respondent group, respectively. Note that the n value for the Overall Review Score is equal to the smallest "All Raters" n value on any particular review item. So, for example, if there are 10 raters responding to a particular target, but only 3 answer a particular question, then the n value for the Overall Score is 3. This is in an effort to be highly conservative in protecting rater anonymity. This is particularly important when using minimum response filters in your reports, as this may sometimes cause the Overall Review Score to not display in some cases.

EchoSpan Legacy Group Report (Old Scoring Method)

Results for a group of Targets are calculated as if all Targets were a single Target. This means that all ratings are combined together and averaged as a whole. Targets with more raters are weighted more heavily in these calculations. This remains the calculation method on all legacy group report templates, but has been superseded by the evenly-weighted scoring methodology in use in the current group report model