+44 (0)2 0718 39207
info@enovationsolutions.co.uk
  • Client Support
  • FR
  • IE
EnovationEnovationEnovationEnovation
+44 (0)2 0718 39207
  • WHAT WE DO
    • OUR SERVICES
      • Consultancy
      • Content Creation
      • Build & Design
      • Training
      • Hosting
      • Support & Maintenance
    • OUR SOLUTIONS
      • Moodle
      • The LMS Totara Learn
      • Totara Social
      • Aura Talent
      • Mahara
  • WHO WE ARE
    • About Enovation
    • Careers
  • CASE STUDIES
    • Smyths Toys
    • Tata Chemicals Europe
    • Courts Service of Ireland
    • OpenJaw
    • New College Lanarkshire
  • OUR PARTNERS
    • IntelliBoard
    • BigBlueButton
  • INSIGHTS
  • CONTACT US

Statistical Analysis of Moodle Quizzes

    Home Blog Statistical Analysis of Moodle Quizzes

    Statistical Analysis of Moodle Quizzes

    Mark Melia | Blog, News | 5 April, 2012

    I am a massive fan of Moodle Quiz. It really is one of the most powerful and comprehensive pedagogical tools in Moodle. From its multiple question types (http://docs.moodle.org/20/en/Question_types) to its many configuration and grading options, its various methods of giving students targeted feedback and its comprehensive reporting, it leaves most other quiz engines in the shade.

    Reporting is one of Moodle Quizzes biggest strengths and an aspect of the quiz that I think people overlook. Today I want to take some timeout just to do some justice to Moodle quiz and share with the world just how fantastic it is.

    Very generally there are two types of reports that can be generated for Moodle quizzes, student report and statistics report. Lets look at each of these reports in a little detail.

    Student Report

    The student report (grades) allows the teacher to see how students are performing in the quiz. The student report allows the teacher to see at a glance averages for questions and students but also allows the teacher to drill down to individual students to individual question and view a log for a student’s behaviour in a given question.

    The screen shot below demonstrates a simple example of how summative information for a quiz is displayed.

    Grade report for Moodle Quiz

    Grade report for Moodle Quiz

    For a teacher to review an individual learners attempt he or she just needs to click on one of the marks. This will bring up the question and outline the students response to the question including a log of what the student did while answering the question.

    Question level logs

    Question level logs

    Teachers need to not only know how their students are performing but they also need to know how well their quizzes are performing. Moodle provides a “statistics” report providing basic psychometric analysis of quizzes to do this.

    Statistics Report

    The statistics report is broken into two parts; quiz information, which provides summative stats on the quiz, and quiz structure analysis, which provides detailed information about the quiz’s questions.

    Quiz information contains the following information about a given quiz:

    • Quiz name
    • Course name
    • Open and close dates for the quiz
    • Total number of first/graded attempts
    • Average grade for first/all attempts
    • Median grade
    • Standard deviation of grades
    • Score distribution skewness (for first attempts) – indicating whether there is a long tail on the distribution curve to the left (negative skew) or right (positive skew)
    • Coefficient of internal consistency (sometimes called Cronbach Alpha) – This is a measure of whether all the items in the quiz are testing basically the same thing. Thus it measures the consistency of the text, which is a lower bound for the validity. Higher numbers here are better [1].
    • Error ratio – the variation in the grades comes from two sources. First some students are better than others at what is being tested, and second there is some random variation. We hope that the quiz grades will largely be determined by the student’s ability, and that random variation will be minimised. The error ratio estimates how much of the variation is random, and so lower is better [1].
    • Standard error – this is derived from the error ratio, and is a measure of how much random variation there is in each test grade. So, if the Standard error is 10%, and a student scored 60%, then their real ability probably lies somewhere between 50% and 70% [1].
    The screen shot below outlines how this information is displayed to the teacher.
    Quiz statistics display
    Statistics are also generated for each question. The following looks at the types of statistics that you can expect for each question in your quiz (source: [1]):
    • Q# – shows the question number (position), question type icon, and preview and edit icons
    • Question name – the name is also a link to the detailed analysis of this question (See Quiz Question Statistics below).
    • Attempts – how many students attempted this question.
    • Facility Index – the percentage of students that answered the question correctly.
    • Standard Deviation – how much variation there was in the scores for this question.
    • Random guess score – the score the student would get by guessing randomly
    • Intended/Effective weight – Intended weight is simply what you set up when editing the quiz. If question 1 is worth 3 marks out of a total of 10 for the quiz, the the intended weight is 30%. The effective weight is an attempt to estimate, from the results, how much of the actual variation was due to this question. So, ideally the effective weights should be close to the intended weights.
    • Discrimination index – this is the correlation between the score for this question and the score for the whole quiz. That is, for a good question, you hope that the students who score highly on this question are the same students who score highly on the whole quiz. Higher numbers are better.
    • Discriminative efficiency – another measure that is similar to Discrimination index.
      • Where random questions are used, there is one row in the table for the random question, followed by further rows, one for each real question that was selected in place of this random question.
      • When quiz questions are randomized for each quiz, the quiz module determines a default position.
      • Quiz statistics calculations gives further details on all these quantities.
    Conclusion
    So there you have it, Moodle quiz allows you to see how well your students are performing and how well your quiz itself is performing. This is very powerful stuff giving you the information to create better questions and better quizzes that truly evaluate a students knowledge. 

    References:

    1. http://docs.moodle.org/22/en/Quiz_statistics_report
    Next Previous
    No tags.

    Related Post

    • UX meets Learner Experience meets LMS 2019

      Enovation Admin | Featured News, News | 23 January, 2019

      The ease and intuitiveness which learners are directed to and through learning programmes plays an important role in achieving successful learning outcomes.

    • Totara Learn 12

      Webinar: Totara Learn 12 Enhanced Features and Improved Functionality

      Enovation Admin | Featured News, News | 2 January, 2019

      Join our Totara Learn version 12 webinar and explore the enhanced features and improved functionality with us.

    • L&D Trends 2019 Image

      5 e-Learning Trends to Watch in 2019

      Enovation Admin | Featured News, News | 20 December, 2018

      It’s that time of year again which can only mean one thing; In this short blog post I have picked five key trends that we would expect to have an impact on eLearning in 2019.Read more

    • Webinar: Adaptive Learning with Moodle & Totara Learn

      Audrey Colmer | News | 5 October, 2018

      Learning through Moodle or Totara Learn can be made more enjoyable by using adaptive learning methods. Join our webinar to find out more.

    • Five Essentials of Talent Management

      Mark Melia | Featured News, News | 4 October, 2018

      A post on how to improve your talent management process by linking your talent management system to your LMS.

    • Webinar: How to create powerful reports with Totara Learn built-in Report Builder

      Audrey Colmer | News | 29 September, 2018

      Totara Learn built-in Report Builder allows you to create and edit powerful customised reports to keep track of your learners’ progress.

    • World of Learning: Career planning and tapping into each employees potential

      Audrey Colmer | News | 25 September, 2018

      Enovation will be speaking at the World of Learning Conference and will give you tips to help you simplify your career planning process.

    • Make your eLearning Courses Pop with Interactivity using H5P

      Paddy O'Connor | Featured News, News | 21 September, 2018

      As educators we are constantly looking for ways to make our courses more interactive, engaging and with better learner experience. H5P is a plugin for the Moodle and Totara LMS that helps us to do this.

    NextPrevious

    Latest Insights

    • 23 January, 2019
      Comments Off on UX meets Learner Experience meets LMS 2019

      UX meets Learner Experience meets LMS 2019

    • Totara Learn 12
      2 January, 2019
      Comments Off on Webinar: Totara Learn 12 Enhanced Features and Improved Functionality

      Webinar: Totara Learn 12 Enhanced Features and Improved Functionality

    • L&D Trends 2019 Image
      20 December, 2018
      Comments Off on 5 e-Learning Trends to Watch in 2019

      5 e-Learning Trends to Watch in 2019

    • 5 October, 2018
      Comments Off on Webinar: Adaptive Learning with Moodle & Totara Learn

      Webinar: Adaptive Learning with Moodle & Totara Learn

    Archives

    • January 2019
    • December 2018
    • October 2018
    • September 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • January 2017
    • November 2016
    • October 2016
    • June 2016
    • March 2016
    • February 2016
    • January 2016
    • December 2015
    • November 2015
    • October 2015
    • September 2015
    • July 2015
    • June 2015
    • May 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
    • September 2014
    • June 2014
    • May 2014
    • January 2014
    • August 2013
    • April 2013
    • March 2013
    • February 2013
    • September 2012
    • July 2012
    • May 2012
    • April 2012
    • February 2012
    • December 2011
    • November 2011
    • June 2011
    • May 2011
    • April 2011
    • March 2011
    • February 2011
    • January 2011
    • December 2010

    Sign-up to get our insights direct to your inbox

    Enovation Square

    Enovation Solutions Ltd.,
    T: +44 (0) 2071839207

    Partners & Certifications

    Totara Partner Logo

    Latest Insights

    • UX meets Learner Experience meets LMS 2019

      The ease and intuitiveness which learners are directed to and through learning programmes plays an important role in achieving successful learning outcomes.

      23 January, 2019
    • Totara Learn 12

      Webinar: Totara Learn 12 Enhanced Features and Improved Functionality

      Join our Totara Learn version 12 webinar and explore the enhanced features and improved functionality with us.

      2 January, 2019
    • L&D Trends 2019 Image

      5 e-Learning Trends to Watch in 2019

      It’s that time of year again which can only mean one thing;

      20 December, 2018

    Latest Tweets

    Tweets by @EnovationIRE
    • Legal Information
    © 2019 Enovation Your eLearning Partner
    • WHAT WE DO
      • OUR SERVICES
        • Consultancy
        • Content Creation
        • Build & Design
        • Training
        • Hosting
        • Support & Maintenance
      • OUR SOLUTIONS
        • Moodle
        • The LMS Totara Learn
        • Totara Social
        • Aura Talent
        • Mahara
    • WHO WE ARE
      • About Enovation
      • Careers
    • CASE STUDIES
      • Smyths Toys
      • Tata Chemicals Europe
      • Courts Service of Ireland
      • OpenJaw
      • New College Lanarkshire
    • OUR PARTNERS
      • IntelliBoard
      • BigBlueButton
    • INSIGHTS
    • CONTACT US
    Enovation
    +44 (0)2 0718 39207