IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v90y2021ics2214804320306960.html
   My bibliography  Save this article

Can we stay one step ahead of cheaters? A field experiment in proctoring online open book exams

Author

Listed:
  • Vazquez, Jose J.
  • Chiang, Eric P.
  • Sarmiento-Barbieri, Ignacio

Abstract

As more institutions of higher learning expand their offerings of online courses, the use of online assessments has become an important topic of discussion. Although the use of online assessments can be very beneficial, instances of cheating in the absence of a proctor poses a cost in protecting academic integrity. This has led to the development of many proctoring solutions to address this challenge. This paper presents two field experiments used to analyze the effects of proctoring methods on exam scores: one involving a face-to-face class and the other involving an online class. Also, two proctoring methods were used: live proctors and web-based proctors. In each class, best practices were used to minimize cheating and students were informed in advance which exams were proctored. Our results show that students whose exams were not proctored scored over 11% higher on average than those whose exams were proctored. However, the results varied significantly: the use of live proctors in the face-to-face class had a much larger effect on test scores than web-based proctors in the online class. We compare variables affecting each testing environment to uncover possible determinants, including the ease of collaboration, test anxiety, and information sharing over the testing period.

Suggested Citation

  • Vazquez, Jose J. & Chiang, Eric P. & Sarmiento-Barbieri, Ignacio, 2021. "Can we stay one step ahead of cheaters? A field experiment in proctoring online open book exams," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    • Handle: RePEc:eee:soceco:v:90:y:2021:i:c:s2214804320306960
    DOI: 10.1016/j.socec.2020.101653
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214804320306960
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socec.2020.101653?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Belot, Michèle & van de Ven, Jeroen, 2019. "Is dishonesty persistent?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 83(C).
    2. Oskar R. Harmon & James Lambrinos, 2008. "Are Online Exams an Invitation to Cheat?," The Journal of Economic Education, Taylor & Francis Journals, vol. 39(2), pages 116-125, April.
    3. Schwieren, Christiane & Weichselbaumer, Doris, 2010. "Does competition enhance performance or cheating? A laboratory experiment," Journal of Economic Psychology, Elsevier, vol. 31(3), pages 241-253, June.
    4. Joe Kerkvliet & Charles L. Sigmund, 1999. "Can We Control Cheating in the Classroom?," The Journal of Economic Education, Taylor & Francis Journals, vol. 30(4), pages 331-343, December.
    5. Siniver, Erez & Tobol, Yossef & Yaniv, Gideon, 2017. "Do Higher Achievers Cheat Less? An Experiment of Self-Revealing Individual Cheating," IZA Discussion Papers 10709, Institute of Labor Economics (IZA).
    6. Clifford Nowell & Doug Laufer, 1997. "Undergraduate Student Cheating in the Fields of Business and Economics," The Journal of Economic Education, Taylor & Francis Journals, vol. 28(1), pages 3-12, March.
    7. repec:wly:soecon:v:82:3:y:2016:p:1021-1038 is not listed on IDEAS
    8. Yaniv, Gideon & Siniver, Erez & Tobol, Yossef, 2017. "Do higher achievers cheat less? An experiment of self-revealing individual cheating," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 68(C), pages 91-96.
    9. Akın, Zafer, 2019. "Dishonesty, social information, and sorting," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 80(C), pages 199-210.
    10. Azar, Ofer H. & Applebaum, Mark, 2020. "Do children cheat to be honored? A natural experiment on dishonesty in a math competition," Journal of Economic Behavior & Organization, Elsevier, vol. 169(C), pages 143-157.
    11. David Figlio & Mark Rush & Lu Yin, 2013. "Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning," Journal of Labor Economics, University of Chicago Press, vol. 31(4), pages 763-784.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Klijn, Flip & Mdaghri Alaoui, Mehdi & Vorsatz, Marc, 2022. "Academic integrity in on-line exams: Evidence from a randomized field experiment," Journal of Economic Psychology, Elsevier, vol. 93(C).
    2. Salim Al-Hashmi, 2023. "Did they really Work? English Teachers’ Attitude towards the Effectiveness of Remote Online Exams in Times of Emergencies," English Language Teaching, Canadian Center of Science and Education, vol. 16(12), pages 1-27, December.
    3. Dench, Daniel & Joyce, Theodore, 2022. "Information and credible sanctions in curbing online cheating among undergraduates: A field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 195(C), pages 408-427.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alan, Sule & Ertac, Seda & Gumren, Mert, 2020. "Cheating and incentives in a performance context: Evidence from a field experiment on children," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 681-701.
    2. Siniver, Erez & Yaniv, Gideon, 2018. "Losing a real-life lottery and dishonest behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 75(C), pages 26-30.
    3. Azar, Ofer H. & Applebaum, Mark, 2020. "Do children cheat to be honored? A natural experiment on dishonesty in a math competition," Journal of Economic Behavior & Organization, Elsevier, vol. 169(C), pages 143-157.
    4. Ximena Garcia-Rada & Heather E. Mann & Lars Hornuf & Matthias Sohn & Juan Tafurt & Edwin S. Iversen Jr & Dan Ariely, 2018. "The Adaptive Liar: An Interactionist Approach of Multiple Dishonesty Domains," CESifo Working Paper Series 7215, CESifo.
    5. Togara Warinda, 2017. "Academic Dishonesty: Prior perceptions and behaviour on cheating of Bachelor of Accountancy Freshmen at a Zimbabwean university," Journal of Economics and Behavioral Studies, AMH International, vol. 8(6), pages 82-93.
    6. Seeun Jung & Kenneth Houngbedji, 2014. "Shirking, Monitoring, and Risk Aversion," PSE Working Papers halshs-00965532, HAL.
    7. Maria de Fátima Rocha & Aurora A.C. Teixeira, 2005. "College cheating in Portugal: results from a large scale survey," FEP Working Papers 197, Universidade do Porto, Faculdade de Economia do Porto.
    8. Yaniv, Gideon & Siniver, Erez & Tobol, Yossef, 2017. "Do higher achievers cheat less? An experiment of self-revealing individual cheating," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 68(C), pages 91-96.
    9. Maria de Fátima Rocha & Aurora A.C. Teixeira, 2005. "Crime without punishment: An update review of the determinants of cheating among university students," FEP Working Papers 191, Universidade do Porto, Faculdade de Economia do Porto.
    10. Siniver, Erez, 2021. "Do Happy People Cheat Less? A Field Experiment on Dishonesty," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 91(C).
    11. Brinja Meiseberg & Thomas Ehrmann & Aloys Prinz, 2017. "“Anything worth winning is worth cheating for”? Determinants of cheating behavior among business and theology students," Journal of Business Economics, Springer, vol. 87(8), pages 985-1016, November.
    12. Seeun JUNG, 2014. "Risk Attitudes and Shirking on the Quality of Work under Monitoring: Evidence from a Real-Effort Task Experiment," THEMA Working Papers 2014-26, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    13. Paul W. Grimes & Jon P. Rezek, 2005. "The Determinants of Cheating by High School Economics Students: A Comparative Study of Academic Dishonesty in the Transitional Economies," International Review of Economic Education, Economics Network, University of Bristol, vol. 4(2), pages 23-45.
    14. Maria Fátima Rocha & Aurora A.C. Teixeira, 2006. "A cross-country evaluation of cheating in academia: is it related to ‘real world’ business ethics?," FEP Working Papers 214, Universidade do Porto, Faculdade de Economia do Porto.
    15. Chui, Celia & Kouchaki, Maryam & Gino, Francesca, 2021. "“Many others are doing it, so why shouldn't I?”: How being in larger competitions leads to more cheating," Organizational Behavior and Human Decision Processes, Elsevier, vol. 164(C), pages 102-115.
    16. Hoque, Nazmul & Basher, Syed Abul & A.K. Enamul, Haque, 2022. "Do Students Perform Better in Online Delivery of Education? Evidence from Bangladesh," MPRA Paper 112981, University Library of Munich, Germany.
    17. Gill, David & Prowse, Victoria & Vlassopoulos, Michael, 2013. "Cheating in the workplace: An experimental study of the impact of bonuses and productivity," Journal of Economic Behavior & Organization, Elsevier, vol. 96(C), pages 120-134.
    18. Nicolas R. Ziebarth & Gert G. Wagner, 2013. "Top-down v. Bottom-up: The Long-Term Impact of Government Ideology and Personal Experience on Values," Discussion Papers of DIW Berlin 1280, DIW Berlin, German Institute for Economic Research.
    19. Celse, Jeremy & Karakostas, Alexandros & Zizzo, Daniel John, 2023. "Relative risk taking and social curiosity," Journal of Economic Behavior & Organization, Elsevier, vol. 210(C), pages 243-264.
    20. Joyce, Ted & Crockett, Sean & Jaeger, David A. & Altindag, Onur & O'Connell, Stephen D., 2015. "Does classroom time matter?," Economics of Education Review, Elsevier, vol. 46(C), pages 64-77.

    More about this item

    Keywords

    Academic integrity; Cheating; Online learning; Personality traits;
    All these keywords.

    JEL classification:

    • A20 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • A22 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Undergraduate

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:90:y:2021:i:c:s2214804320306960. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.