Oral examination as an online assessment tool

By Marisa Graser

More and more courses are delivered entirely online. Accordingly, existing assessment approaches need to be adjusted to fit into the virtual teaching and learning environment (Robles and Braathen, 2002). To test for higher-order skills, most courses rely on the submission of coursework like essays. However, a number of challenges arise from this form of assessment and the online environment in general: Accessibility issues, legality of the assessment, identity security, and ensuring academic integrity (Akimov and Malin, 2020).

Online oral assessment

Akimov and Malin (2020) suggest online oral examinations to overcome some of these problems. For practical reasons, this style of assessment is most suitable for smaller, more advanced classes. Akimov and Malin (2020) followed a three-part assessment approach for their postgraduate finance course: An online quiz early in the course to track progress; an applied project with a time limit to test practical concepts taught in the course; and a final oral examination to test communication skills as well as higher-order skills like problem solving and critical thinking.

How to setup an online oral assessment

To prepare students for the oral exam, Akimov and Malin (2020) suggest distributing a list of questions at the beginning of the course that reflect the learning outcomes of every module. Students should prepare the relevant questions before every live lecture, where they should then be encouraged to discuss the questions and actively participate.

In Akimov and Malin’s case, the actual oral examination was set up in 30-minute slots over a two-day period. Students could select their time slots on a first-come, first-served basis. They structured their exam as follows:

2 x 5 minutes to answer two randomly selected questions from the previously provided list;
5 minutes of questions about the project that was completed as previous assignment, which also aids in ensuring academic integrity;
5-10 minutes for further questions testing the depth and breadth of knowledge;
5 minutes for providing feedback to the student and assigning a mark.

Akimov and Malin (2020) advise to use an online form to immediately compile the mark without communicating it to the student directly to avoid delays. Instead, marks can be released after all examinations are completed. Furthermore, they suggest including the following four criteria in the marking rubric: completeness of response (worth 40%), accuracy of response (worth 40%), depth and breadth of knowledge (worth 10%), and oral communication skills (worth 10%).

How to successfully implement an oral examination

To ensure successful implementation of the oral examination, Akimov and Malin (2020) highlight a few points. Firstly, an identification process should be integrated at the beginning of the exam, for example by showing a valid student ID or government-issued document, to avoid academic misconduct.

Secondly, the communication system should be tested in advance to avoid any technical issues.

Thirdly, intra-rater reliability should be ensured. All examinations could be recorded and a random selection thereof moderated by a second examiner. The selected recordings should thereby represent the breadth of marks achieved.

Lastly, to relieve some of the anxiety amongst students that is commonly associated with oral exams, mock online assessments could be set up. Akimov and Malin (2020) suggest that students can provide feedback on each other’s answers to increase the learning effect and reduce the workload on the course leader.

Oral examinations facilitate communication and higher-level skills

Although face-to-face examination is unfeasible in online learning, conducting an online oral assessment can make interactions and discussions possible. The delivery is flexible, and students receive immediate feedback. By using software for the marking process, cost and time can be saved as well and the turnover time for marking is shortened.

For students, communication and confidence are enhanced (Haque et al., 2016), which are sought after skills by employers (Murillo-Zamorano and Montanero, 2018). They are also more motivated to learn and understand the subject whilst cheating is discouraged (Akimov and Malin, 2020, Bhati, 2012). Overall, oral examinations are a great tool to integrate into online courses, especially when combined with other types of assessments.

FAQ

Q: How do students with disabilities or those who require accommodations navigate online oral examinations?

A: Students with disabilities or those who require accommodations are given special consideration during online oral examinations to ensure fairness and accessibility. Educational institutions typically have protocols in place to assess individual needs and make the necessary adjustments. This could include providing additional time, using alternative questioning techniques, or employing assistive technologies that enable these students to participate fully. The concept of student voice is crucial here, as students are encouraged to communicate their specific needs and preferences to the educators or examination coordinators beforehand, ensuring that their feedback directly influences the adjustments made for their examinations.

Q: What measures are in place to handle technical failures or connectivity issues during the oral examination?

A: To address technical failures or connectivity issues during an oral examination, several measures are typically implemented. These include having a technical support team on standby during examinations to assist with any issues that arise, offering a test run before the actual examination to ensure that all participants are familiar with the system and to identify any potential problems, and having a clear protocol for what steps to take if an issue occurs—such as rescheduling the examination or allowing extra time. The importance of student voice is acknowledged by inviting feedback on the technical experience, which can help to further refine and improve the process for future examinations.

Q: How is student feedback on the oral examination process collected and utilised to improve future assessments?

A: Student feedback on the oral examination process is collected through surveys, feedback forms, or informal discussions after the examination period. Institutions value student voice as it provides critical insights into their experiences, highlighting areas of success and identifying opportunities for improvement. This feedback is then analysed and used to make informed decisions about adjustments to the examination format, technical setup, and support services, with the aim of enhancing the overall effectiveness of future assessments and ensuring that they meet the learning needs and preferences of all students.

References

[Source Paper] Akimov A., Malin M. (2020) “When old becomes new: a case study of oral examination as an online assessment tool”. Assessment & Evaluation in Higher Education, 45 (8), 1205-1221.
DOI: 10.1080/02602938.2020.1730301

[1] Robles M., Braathen S. (2002). “Online Assessment Techniques.” Delta Pi Epsilon Journal 44 (1): 39–49.
Available Here

[2] Haque, M., R. Ibtisam, T. Mustafa, S. Qayyum, Q. Tahir, S. Melsing, and F. Rafique (2016). “Oral Examinations: What Medical Students and Examiners Think! Comparison of Opinions on Oral Examination.” International Journal of Pathology 14 (2): 66–73.
Available Here

[3] Murillo-Zamorano, L. R., Montanero M. (2018). “Oral Presentations in Higher Education: A Comparison of the Impact of Peer and Teacher Feedback.” Assessment & Evaluation in Higher Education 43 (1): 138–150.
DOI: 10.1080/02602938.2017.1303032

[4] Bhati, S. (2012). “The Effectiveness of Oral Presentation Assessment in a Finance Subject: An Empirical Examination.” Journal of University Teaching & Learning Practice 9 (2): 6.
DOI: 10.53761/1.9.2.6