+44 (0)2 0718 39207
info@enovationsolutions.co.uk
  • Client Support
  • FR
  • IE
EnovationEnovationEnovationEnovation
+44 (0)2 0718 39207
  • WHAT WE DO
    • OUR SERVICES
      • Consultancy
      • Content Creation
      • Build & Design
      • Training
      • Hosting
      • Support & Maintenance
    • OUR SOLUTIONS
      • Moodle
      • Moodle Workplace
      • The LMS Totara Learn
      • Aura Talent
  • WHO WE ARE
    • About Enovation
    • Careers
  • CASE STUDIES
    • Smyths Toys
    • Tata Chemicals Europe
    • Courts Service of Ireland
    • OpenJaw
    • New College Lanarkshire
  • OUR PARTNERS
    • IntelliBoard
    • BigBlueButton
  • INSIGHTS
  • CONTACT US

Statistical Analysis of Moodle Quizzes

    Home Blog Statistical Analysis of Moodle Quizzes

    Statistical Analysis of Moodle Quizzes

    Mark Melia | Blog, News | 5 April, 2012

    I am a massive fan of Moodle Quiz. It really is one of the most powerful and comprehensive pedagogical tools in Moodle. From its multiple question types (http://docs.moodle.org/20/en/Question_types) to its many configuration and grading options, its various methods of giving students targeted feedback and its comprehensive reporting, it leaves most other quiz engines in the shade.

    Reporting is one of Moodle Quizzes biggest strengths and an aspect of the quiz that I think people overlook. Today I want to take some timeout just to do some justice to Moodle quiz and share with the world just how fantastic it is.

    Very generally there are two types of reports that can be generated for Moodle quizzes, student report and statistics report. Lets look at each of these reports in a little detail.

    Student Report

    The student report (grades) allows the teacher to see how students are performing in the quiz. The student report allows the teacher to see at a glance averages for questions and students but also allows the teacher to drill down to individual students to individual question and view a log for a student’s behaviour in a given question.

    The screen shot below demonstrates a simple example of how summative information for a quiz is displayed.

    Grade report for Moodle Quiz

    Grade report for Moodle Quiz

    For a teacher to review an individual learners attempt he or she just needs to click on one of the marks. This will bring up the question and outline the students response to the question including a log of what the student did while answering the question.

    Question level logs

    Question level logs

    Teachers need to not only know how their students are performing but they also need to know how well their quizzes are performing. Moodle provides a “statistics” report providing basic psychometric analysis of quizzes to do this.

    Statistics Report

    The statistics report is broken into two parts; quiz information, which provides summative stats on the quiz, and quiz structure analysis, which provides detailed information about the quiz’s questions.

    Quiz information contains the following information about a given quiz:

    • Quiz name
    • Course name
    • Open and close dates for the quiz
    • Total number of first/graded attempts
    • Average grade for first/all attempts
    • Median grade
    • Standard deviation of grades
    • Score distribution skewness (for first attempts) – indicating whether there is a long tail on the distribution curve to the left (negative skew) or right (positive skew)
    • Coefficient of internal consistency (sometimes called Cronbach Alpha) – This is a measure of whether all the items in the quiz are testing basically the same thing. Thus it measures the consistency of the text, which is a lower bound for the validity. Higher numbers here are better [1].
    • Error ratio – the variation in the grades comes from two sources. First some students are better than others at what is being tested, and second there is some random variation. We hope that the quiz grades will largely be determined by the student’s ability, and that random variation will be minimised. The error ratio estimates how much of the variation is random, and so lower is better [1].
    • Standard error – this is derived from the error ratio, and is a measure of how much random variation there is in each test grade. So, if the Standard error is 10%, and a student scored 60%, then their real ability probably lies somewhere between 50% and 70% [1].
    The screen shot below outlines how this information is displayed to the teacher.
    Quiz statistics display
    Statistics are also generated for each question. The following looks at the types of statistics that you can expect for each question in your quiz (source: [1]):
    • Q# – shows the question number (position), question type icon, and preview and edit icons
    • Question name – the name is also a link to the detailed analysis of this question (See Quiz Question Statistics below).
    • Attempts – how many students attempted this question.
    • Facility Index – the percentage of students that answered the question correctly.
    • Standard Deviation – how much variation there was in the scores for this question.
    • Random guess score – the score the student would get by guessing randomly
    • Intended/Effective weight – Intended weight is simply what you set up when editing the quiz. If question 1 is worth 3 marks out of a total of 10 for the quiz, the the intended weight is 30%. The effective weight is an attempt to estimate, from the results, how much of the actual variation was due to this question. So, ideally the effective weights should be close to the intended weights.
    • Discrimination index – this is the correlation between the score for this question and the score for the whole quiz. That is, for a good question, you hope that the students who score highly on this question are the same students who score highly on the whole quiz. Higher numbers are better.
    • Discriminative efficiency – another measure that is similar to Discrimination index.
      • Where random questions are used, there is one row in the table for the random question, followed by further rows, one for each real question that was selected in place of this random question.
      • When quiz questions are randomized for each quiz, the quiz module determines a default position.
      • Quiz statistics calculations gives further details on all these quantities.
    Conclusion
    So there you have it, Moodle quiz allows you to see how well your students are performing and how well your quiz itself is performing. This is very powerful stuff giving you the information to create better questions and better quizzes that truly evaluate a students knowledge. 

    References:

    1. http://docs.moodle.org/22/en/Quiz_statistics_report
    Next Previous
    No tags.

    Related Post

    • alt=LMS info graphic outlining the aspects of a learning management system

      LMS for Retail Success

      Emma Cronin | Blog, News | 7 August, 2019

      Retail is a notoriously unpredictable industry that is dictated by its seasonal changes, trends and high staff turnover. When retailers equip their staff members with the necessary training and knowledge and skills cost-effectively, without interrupting their busy schedules, a culture of empowerment and encouragement is created. By introducing a cost-effective and customisable LMS, retail businesses are given the power to stay ahead of the curve.

    • SCORM and Moodle

      Mark Melia | Blog, News | 3 December, 2010

      In this post I am going to have a look at what the SCORM specification from ADL (Advanced Distributed Learning) is all about and how it relates to Moodle. The post will firstly look atRead more

    • Whats new in Moodle 2.0

      Mark Melia | Blog, News | 5 December, 2010

      Moodle 2.0, the long awaited next generation of Moodle was released on the 24th of November to much aclaim. In this blog post I am going to have a quick look at some of theRead more

    • Creating simple filter in Moodle 2

      Tomek Muras | Blog, News | 8 December, 2010

      Filters in Moodle are pluggable elements that can convert an output text to some other text. This is currently used for the functionality like: replacing text based emoticons with images (emoticon filter) generating images forRead more

    • Welcome to the new Enovation blog

      Mark Melia | Blog, News | 17 December, 2010

      Hello and welcome to the new Enovation Solutions Technical blog. This is the place to go to find all the latest and greatest developments, news and musings from the technical team at Enovation Solutions. Enovation’sRead more

    • Moodle 2.0 File Storage

      Stephen McGuinness | Blog, News | 3 January, 2011

      One of the major re-engineering efforts undertaken for Moodle 2.0 was a complete redesign of the Moodle file storage system. This article compares the Moodle 1.9 and Moodle 2.0 file storage methods.

    • Generate random test data in Moodle 2

      Tomek Muras | Blog, News | 17 February, 2011

      Would you like to test Moodle 2 performance? Or maybe you are interested in checking Moodle’s scalability? Sure, it works fast with the few courses you have created – but how will it look whenRead more

    • Creating SCORM Content for Moodle

      Mark Melia | Blog, News | 15 March, 2011

      Okay, so I have discussed what SCORM is and how to add it to Moodle. Click here for a reminder. In this blog post I am going to look at some of the excellent proprietaryRead more

    • Game In Moodle

      Moronke Fajobi | Blog, News | 8 April, 2011

      The first time I came across the game module in Moodle I couldn’t but wonder what this could be about. It aroused my curiosity and interest that I spent the entire day digging into itsRead more

    NextPrevious

    Latest Insights

    • 25 August, 2019
      Comments Off on 5 Signs Your LMS Isn’t Working

      5 Signs Your LMS Isn’t Working

    • 14 August, 2019
      Comments Off on Digital Content for Learner Engagement

      Digital Content for Learner Engagement

    • alt=LMS info graphic outlining the aspects of a learning management system
      7 August, 2019
      Comments Off on LMS for Retail Success

      LMS for Retail Success

    • alt=Concentrated female working on an eLearning course
      23 July, 2019
      Comments Off on Collaborative e-Learning

      Collaborative e-Learning

    Archives

    • August 2019
    • July 2019
    • June 2019
    • May 2019
    • March 2019
    • January 2019
    • December 2018
    • October 2018
    • September 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • January 2017
    • November 2016
    • October 2016
    • June 2016
    • March 2016
    • February 2016
    • January 2016
    • December 2015
    • November 2015
    • October 2015
    • September 2015
    • July 2015
    • June 2015
    • May 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
    • September 2014
    • June 2014
    • May 2014
    • January 2014
    • August 2013
    • April 2013
    • March 2013
    • February 2013
    • September 2012
    • July 2012
    • May 2012
    • April 2012
    • February 2012
    • December 2011
    • November 2011
    • June 2011
    • May 2011
    • April 2011
    • March 2011
    • February 2011
    • January 2011
    • December 2010

    Sign-up to get our insights direct to your inbox

      Enovation Square

      Enovation Solutions Ltd.,
      T: +44 (0) 2071839207

      Partners & Certifications

      Totara Partner Logo

      Latest Insights

      • 5 Signs Your LMS Isn’t Working

        At Enovation, we want to add value to your company with an effective learning management solution. This article will outline some telltale signs your current software isn’t working for you and what you should be looking for from your future LMS to ensure success.

        25 August, 2019
      • Digital Content for Learner Engagement

        Whatever stage of the eLearning journey you and your business are on, we can help you to bring your project to a successful conclusion. Few companies can offer the breadth of expertise across project management, technology, instructional design, content authoring and learning and development that our team can. Choosing us as your partner will ensure that your eLearning project is a success.

        14 August, 2019
      • alt=LMS info graphic outlining the aspects of a learning management system

        LMS for Retail Success

        Retail is a notoriously unpredictable industry that is dictated by its seasonal changes, trends and high staff turnover. When retailers equip their staff members with the necessary training and knowledge and skills cost-effectively, without interrupting their busy schedules, a culture of empowerment and encouragement is created. By introducing a cost-effective and customisable LMS, retail businesses are given the power to stay ahead of the curve.

        7 August, 2019

      Latest Tweets

      Tweets by @EnovationIRE
      • Legal Information
      © 2021 Enovation Your eLearning Partner
      • WHAT WE DO
        • OUR SERVICES
          • Consultancy
          • Content Creation
          • Build & Design
          • Training
          • Hosting
          • Support & Maintenance
        • OUR SOLUTIONS
          • Moodle
          • Moodle Workplace
          • The LMS Totara Learn
          • Aura Talent
      • WHO WE ARE
        • About Enovation
        • Careers
      • CASE STUDIES
        • Smyths Toys
        • Tata Chemicals Europe
        • Courts Service of Ireland
        • OpenJaw
        • New College Lanarkshire
      • OUR PARTNERS
        • IntelliBoard
        • BigBlueButton
      • INSIGHTS
      • CONTACT US
      Enovation
      +44 (0)2 0718 39207