Choosing a report
There are twelve different reports provided by Perception. Each report has been built to analyze assessment result data in a different way.
The following table can help you to decide which report is most appropriate for your requirements.
|To report on...||Use the...||Can analyze...|
|Assessment statistics||Assessment Overview Report||Single or multiple assessments|
|Test Analysis Report||Single assessment|
|Results for a single assessment||Score List Report||Single assessment|
|Export for Excel Report||Single assessment|
|Results for participants||Coaching Report||Single assessment or multiple participants|
|Grade Book Report||Multiple assessments or multiple participants|
|Transcript Report||Single participant|
|A comparison of two groups of participants||Gap Report||Single assessment / two groups|
|Results for questions||Question Statistics Report||Single assessment or single topic|
|Item Analysis Report||Single assessment|
|Results for surveys||Survey Report||Single assessment|
|Assessment and question results to be exported||Export to ASCII Report||Single or multiple assessments|
|Export for Excel Report||Single assessment|
This section provides an overview of each report type.
Provides an overview of results for one or more assessments. This can be a convenient overall summary of assessment results that can help flag potential problems and provide direction for drilling down into a more detailed analysis using other reports.
This report provides the following information:
- Number of participants who have started and finished the assessment
- Minimum, maximum and average scores and time taken of participants who have finished
- Minimum, maximum and average scores for each topic in the assessment
The report can also include histograms on:
The numbers reaching each assessment outcome (score band), for example those who passed and failed.
This shows you at a glance the range of distributions of each assessment outcome
Assessment scores showing the numbers in each 10%, 20% or other band scores.
This tells you the distribution of participants with different scores, and can be used as a guide to setting cut or pass scores
|Each topic in the assessment showing the numbers in each band. This can highlight score distributions in each topic|
|Click here to see a more detailed example of an Assessment Overview Report.|
Provides detailed results for one participant taking one assessment. Can be used for coaching participants and providing feedback on their performance. It can also be used for reference purposes, for example to produce a print-out that is permanently filed as a record of the assessment results for a participant. The Coaching Report is divided into three parts, called reportlets. These are:
- Question reportlet - provides information on each question in an assessment and how the participant performed when answering them
- Topic reportlet - provides a comparison of the participant's performance in each topic with a benchmark score. Also includes a comparison of the participant's overall performance in the assessment when compared to a benchmark score
- Comparison reportlet - provides a comparison of the participant's performance with other participants. You can have zero, one or more comparisons in a Coaching Report. Each of these compares the individual participant's result against a set of results.
The following example shows how a participant's performance in a particular topic as well as overall assessment performance can be compared with the minimum, maximum and average of other participants who have taken the assessment.
Click here to see a more detailed example of a Question reportlet.
Click here to see a more detailed example of a Topic reportlet.
Click here to see a more detailed example of a Comparison reportlet.
Provides a list of results for a single assessment exported directly into a Microsoft Excel document. Depending on the report template used, the report can display summary results or answers or scores to each question in the assessment
Click here to see an example of an Export for Excel Report.
Provides the ability to export data from the answer database in a comma-separated format suitable for import into SPSS, Microsoft Access, Microsoft Excel and other systems. The content of the data file produced can be determined by the options selected when the export template is created.
Click here to see an example of an Export to ASCII Report without question details.
Click here to see an example of an Export to ASCII Report with question details.
Provides a comparison of two sets of results to reveal the difference between them. The report allows the investigation of differences achieved at a question, topic, or assessment level.
Click here to see an example of a Gap Report.
Provides a table of participants and assessments showing the scores achieved. Can calculate a weighted total or average score on all the assessments. If you have a series of assessments that each contribute to an overall course grade, the Grade Book Report can enable you to see all results in one report.
This figure shows a simple Grade Book Report.
In the example, there are three participants who have taken two assessments, and a total score is calculated by averaging the results.
Click here to see a detailed example of a Grade Book Report.
Provides Item (question) analysis calculated according to classical test theory, for use by professional test analysts. Has a fixed format and does not use report templates. The minimum number of results necessary to compile an Item Analysis Report is 25.
This report provides:
- Item Difficulty Level Histograms and Discrimination Indices Histograms
- Detailed statistical information on the questions in an assessment
- Statistical information useful for understanding the difficulty of questions
Click here to see an example of Item Difficulty Level Histograms and Discrimination Indices Histograms.
Click here to see an example of statistical information on the questions in an assessment.
Provides an analysis of scores and outcomes from an assessment and displays statistics on the results, enabling you to evaluate the quality of your questions, and find poor or ambiguous ones. You can report on all questions in an assessment, or all questions in a topic.
The following table from a Question Statistics Report displays summary information on questions.
The Question Statistics Report can also show detailed information on the statistics for each outcome of the question. The figure below shows an extract from the report, giving the outcome analysis for the Alabama question.
|Click here to see a more detailed example of a Question Statistics Report.|
Provides a list of participant results for a single assessment.
|Click here to see a more detailed example of a Score List Report.|
Provides analysis of survey results including question analyses and frequency graphs of answers. The generated reports typically use the bar chart or pie chart reporting formats, although an extensive range of reporting options is provided.
The following screenshot displays an Outcome Bar Chart that illustrates frequency analysis of question outcomes, encompassing basic analysis of the question.
The following screenshots illustrate some of the different reportlets that comprise the Survey Report:
Provides analysis of the statistical performance of an assessment including the internal consistency reliability (Cronbach's Alpha). This report is highly useful when verifying the psychometric quality of high-stakes assessments, such as those used for University entrance exams.
|Click here to see a more detailed example of a Test Analysis Report.|
Provides a list of results for a single participant across assessments. This can be useful if an administrator wants to see all assessment results for a single participant.
|Click here to see a detailed example of a Transcript Report.|