The specific course design used in legal training has always suited the use of Multiple Choice Question (MCQ) assessments, but with the introduction of the Bar Vocational course many more MCQ assessments needed to be processed. Initially, this was done manually as they had always been, but it soon became apparent how time-consuming the process had become.
Manual marking could be both unreliable and costly. More and more staff hours were being spent marking and temporary staff had to be hired to help ease the burden. A better all round solution was needed.
Many staff at the College already had previous experience in using DRS products and services, and they had no hesitation recommending the DRS Optical Mark Reader (OMR) solution to help alleviate the burden of manual marking. As DRS were already well established within the education sector no market testing was needed.
The College’s London centre, based at Store Street, took delivery of a high-speed, automatic OMR and the MultiQuest software package to aid in assessment processing. In addition, a bespoke mark sheet was designed and printed by DRS to use in conjunction with MultiQuest. With this complete package the College was able to start automatically marking the MCQ assessments very quickly.
Manually, approximately 30 mark sheets could be completed in an hour. But with the DRS solution, the OMR would take just one hour to complete over 7,000 mark sheets. In addition, MultiQuest could automatically download the marks directly into the College’s own results database.
This sort of fast turnaround meant that students taking exams in the morning could have their results by the same afternoon. Lecturers could benefit as well. The results were linked directly to a student’s overall course performance meaning written feedback on the assessments could be given to the student immediately.
The comprehensive reporting facility that MultiQuest provides allows the College to evaluate the performance of individual questions. Any rogue questions can be identified quickly and the results analysis adjusted accordingly. In the event that an answer was incorrectly set up when originating the test MultiQuest eliminates the need for re-marking, the answer is simply changed in the setup field and all results are updated automatically.
The key benefits the College has seen since implementing the OMR system is the considerable amount of time saved and the higher level of accuracy achieved. Staff no longer have to put aside hours of their time for assessment marking. The OMR relieves staff of this basic, yet vitally important administrative role.
The success of the OMR with MCQ assessments has led staff to explore many other areas that will benefit from using DRS technology. Some of these areas include streamlining attendance registers and staff and student questionnaires.
One of the areas where the College has already implemented the DRS OMR is for Teaching Quality forms which were only completed by a small sample of students. This needed to be expanded to cover all students, greatly increasing the number of forms to be processed.
Using additional software, the DRS OMR is now helping to save time in collecting and processing this data. The College is currently looking at increasing the number of applications and OMRs it has to enable each centre to utilise the benefits of the DRS solution even further.
As the College is heavily regulated by the Law Society it is assessed on the quality of the courses they provide and on how the courses are examined. Having quick, reliable access to assessment, attendance and survey data greatly helps with this procedure.