Choosing a report | Questionmark

Choosing a report

Applies to the following products: 
Questionmark Perception
Applies to the following Perception versions: 
Perception 5.7
Perception 5.4
Perception 5.1

There are twelve different reports provided by Perception. Each report has been built to analyze assessment result data in a different way.

The following table can help you to decide which report is most appropriate for your requirements.

To report on... Use the... Can analyze...
Assessment statistics Assessment Overview Report Single or multiple assessments
Test Analysis Report Single assessment
Results for a single assessment Score List Report Single assessment
Export for Excel Report Single assessment
Results for participants Coaching Report Single assessment or multiple participants
Grade Book Report Multiple assessments or multiple participants
Transcript Report Single participant
A comparison of two groups of participants Gap Report Single assessment / two groups
Results for questions Question Statistics Report Single assessment or single topic
Item Analysis Report Single assessment
Results for surveys Survey Report Single assessment
Assessment and question results to be exported Export to ASCII Report Single or multiple assessments
Export for Excel Report Single assessment

This section provides an overview of each report type.

Assessment Overview Report

Provides an overview of results for one or more assessments. This can be a convenient overall summary of assessment results that can help flag potential problems and provide direction for drilling down into a more detailed analysis using other reports.

This report provides the following information:

  • Number of participants who have started and finished the assessment
  • Minimum, maximum and average scores and time taken of participants who have finished
  • Minimum, maximum and average scores for each topic in the assessment

The report can also include histograms on:

The numbers reaching each assessment outcome (score band), for example those who passed and failed.

This shows you at a glance the range of distributions of each assessment outcome

Assessment scores showing the numbers in each 10%, 20% or other band scores.

This tells you the distribution of participants with different scores, and can be used as a guide to setting cut or pass scores

Each topic in the assessment showing the numbers in each band. This can highlight score distributions in each topic
Click here to see a more detailed example of an Assessment Overview Report.

Coaching Report

Provides detailed results for one participant taking one assessment. Can be used for coaching participants and providing feedback on their performance. It can also be used for reference purposes, for example to produce a print-out that is permanently filed as a record of the assessment results for a participant. The Coaching Report is divided into three parts, called reportlets. These are:

  • Question reportlet - provides information on each question in an assessment and how the participant performed when answering them
  • Topic reportlet - provides a comparison of the participant's performance in each topic with a benchmark score. Also includes a comparison of the participant's overall performance in the assessment when compared to a benchmark score
  • Comparison reportlet - provides a comparison of the participant's performance with other participants. You can have zero, one or more comparisons in a Coaching Report. Each of these compares the individual participant's result against a set of results.

The following example shows how a participant's performance in a particular topic as well as overall assessment performance can be compared with the minimum, maximum and average of other participants who have taken the assessment.

Click here to see a more detailed example of a Question reportlet.

Click here to see a more detailed example of a Topic reportlet.

Click here to see a more detailed example of a Comparison reportlet.

Export for Excel Report

Provides a list of results for a single assessment exported directly into a Microsoft Excel document. Depending on the report template used, the report can display summary results or answers or scores to each question in the assessment

Click here to see an example of an Export for Excel Report.

Export to ASCII Report

Provides the ability to export data from the answer database in a comma-separated format suitable for import into SPSS, Microsoft Access, Microsoft Excel and other systems. The content of the data file produced can be determined by the options selected when the export template is created.

Click here to see an example of an Export to ASCII Report without question details.

Click here to see an example of an Export to ASCII Report with question details.

Gap Report

Provides a comparison of two sets of results to reveal the difference between them. The report allows the investigation of differences achieved at a question, topic, or assessment level.

Click here to see an example of a Gap Report.

Grade Book Report 

Provides a table of participants and assessments showing the scores achieved. Can calculate a weighted total or average score on all the assessments. If you have a series of assessments that each contribute to an overall course grade, the Grade Book Report can enable you to see all results in one report.

This figure shows a simple Grade Book Report.

In the example, there are three participants who have taken two assessments, and a total score is calculated by averaging the results.

Click here to see a detailed example of a Grade Book Report.

Item Analysis Report

Provides Item (question) analysis calculated according to classical test theory, for use by professional test analysts. Has a fixed format and does not use report templates. The minimum number of results necessary to compile an Item Analysis Report is 25.

This report provides:

  • Item Difficulty Level Histograms and Discrimination Indices Histograms
  • Detailed statistical information on the questions in an assessment
  • Statistical information useful for understanding the difficulty of questions

Click here to see an example of Item Difficulty Level Histograms and Discrimination Indices Histograms.

Click here to see an example of statistical information on the questions in an assessment.

Question Statistics Report

Provides an analysis of scores and outcomes from an assessment and displays statistics on the results, enabling you to evaluate the quality of your questions, and find poor or ambiguous ones. You can report on all questions in an assessment, or all questions in a topic.

The following table from a Question Statistics Report displays summary information on questions.

The Question Statistics Report can also show detailed information on the statistics for each outcome of the question. The figure below shows an extract from the report, giving the outcome analysis for the Alabama question.

Click here to see a more detailed example of a Question Statistics Report.

Score List Report

Provides a list of participant results for a single assessment.

Click here to see a more detailed example of a Score List Report.

Survey Report

Provides analysis of survey results including question analyses and frequency graphs of answers. The generated reports typically use the bar chart or pie chart reporting formats, although an extensive range of reporting options is provided.

The following screenshot displays an Outcome Bar Chart that illustrates frequency analysis of question outcomes, encompassing basic analysis of the question.

The following screenshots illustrate some of the different reportlets that comprise the Survey Report:

Test Analysis Report

Provides analysis of the statistical performance of an assessment including the internal consistency reliability (Cronbach's Alpha). This report is highly useful when verifying the psychometric quality of high-stakes assessments, such as those used for University entrance exams.

Click here to see a more detailed example of a Test Analysis Report.

Transcript Report

Provides a list of results for a single participant across assessments. This can be useful if an administrator wants to see all assessment results for a single participant.

Click here to see a detailed example of a Transcript Report.