Detection of Online Contract Cheating Through Stylometry: A Pilot Study

Authors

  • David Ison Northcentral University

DOI:

https://doi.org/10.24059/olj.v24i2.2096

Keywords:

Academic integrity, plagiarism, contract cheating, online

Abstract

Contract cheating, instances in which a student enlists someone other than themselves to produce coursework, has been identified as a growing problem within academic integrity literature and in news headlines. The percentage of students who have utilized this type of cheating has been reported to range between 6% and 15.7%. Generational sentiments about cheating and the prevalent accessibility of contract cheating providers online seems to only have exacerbated the issue. The problem is that there is currently no simple means identified and verified to detect contract cheating, as available plagiarism detection software has been shown to be ineffective in these cases. One method that is commonly used for authorship authentication in nonacademic settings, stylometry, has been suggested as a potential means for detection. Stylometry uses various attributes of documents to determine if they were written by the same individual. This pilot study sought to assess the utility of three easy to use and readily available stylometry software systems to detect simulated cases of contract cheating on academic documents. Average accuracy ranged from 33% to 88.9%. While more research is necessary to further investigate the reliability of the best performing software packages, stylometry software appears to show significant promise for the potential detection of contract cheating.

References

Anekwe, T. D. (2010). Profits and plagiarism: the case of medical ghostwriting. Bioethics, 24(6), 267-272. doi: 10.1111/j.1467-8519.2008.00705.x

Athira, U., & Thampi, S. M. (2018). An author-specific-model-based authorship analysis using psycholinguistic aspects and style word patterns. Journal of Intelligent & Fuzzy Systems, 34(3), 1453-1466. doi: 10.3233/JIFS-169441

Bailey, J. (2019, May 14). PayPal’s essay mill ban has had no impact. Retrieved from https://www.plagiarismtoday.com/2019/05/14/paypals-essay-mill-ban-has-had-no-impact/

Bretag, T., Harper, R., Burton, M., Ellis, C., Newton, P., Rozenberg, P., ... & van Haeringen, K. (2018). Contract cheating: A survey of Australian university students. Studies in Higher Education, 1-20. doi: 10.1080/03075079.2018.1462788

Brocardo, M. L., Traore, I., & Woungang, I. (2015). Authorship verification of e-mail and tweet messages applied for continuous authentication. Journal of Computer and System Sciences, 81(8), 1429-1440. doi: 10.1016/j.jcss.2014.12.019

Clare, J., Walker, S., & Hobson, J. (2017). Can we detect contract cheating using existing assessment data? Applying crime prevention theory to an academic integrity issue. International Journal for Educational Integrity, 13(1), 4. doi: 10.1007/s40979-017-0015-4

Coughlan, S. (2019). PayPal to reject essay-writing firms. Retrieved from https://www.bbc.com/news/education-47800531

Dawes, B., Merivale, H., & Millican, J. (2003). Signature Stylometry System 1.0 [Computer software]. Retrieved from http://www.philocomp.net/humanities/signature.htm

Dawson, P., & Sutherland-Smith, W. (2018). Can markers detect contract cheating? Results from a pilot study. Assessment & Evaluation in Higher Education, 43(2), 286-293. doi: 10.1080/02602938.2017.1336746

Dawson, P., & Sutherland-Smith, W. (2019). Can training improve marker accuracy at detecting contract cheating? A multi-disciplinary pre-post study. Assessment & Evaluation in Higher Education, 44(5), 715-725. doi: 10.1080/02602938.2018.1531109

EVL Labs. (2018). Java Graphical Authorship Attribution Program [Computer software]. Retrieved from https://evllabs.com/?page_id=42

Farhi, P. (2014). Who wrote that political memoir? No, who actually wrote it? The Washington Post. Retrieved from https://www.washingtonpost.com/lifestyle/style/who-wrote-that- political-memoir-no-who-actually-wrote-it/2014/06/09/

García, A. M., & Martín, J. C. (2012). Testing Delta on the “Disputed Federalist Papers.” International Journal of English Studies, 12(2), 133-150. doi: 10.6018/ijes/2012/2/161791

Harper, R., Bretag, T., Ellis, C., Newton, P., Rozenberg, P., Saddiqui, S., & van Haeringen, K. (2018). Contract cheating: a survey of Australian university staff. Studies in Higher Education, 1-17. doi: 10.1080/03075079.2018.1462789

Juola, P. (2017). Detecting contract cheating via stylometry methods. Plagiarism Across Europe and Beyond 2017, 187-198.

Juola, P., Sofko, J., & Brennan, P. (2006). A prototype for authorship attribution studies. Literary and Linguistic Computing, 21(2), 169-178.

Lancaster, T. (2019). Profiling the international academic ghost writers who are providing low cost essays and assignments for the contract cheating industry. Journal of Information, Communication and Ethics in Society, 17(1), 72-86. doi: 10.1108/JICES-04-2018-0040

Lines, L. (2016). Ghostwriters guaranteeing grades? The quality of online ghostwriting services available to tertiary students in Australia. Teaching in Higher Education, 21(8), 889-914. doi: 10.1080/13562517.2016.1198759

Ma, H. J., Wan, G., & Lu, E. Y. (2008). Digital cheating and plagiarism in schools. Theory Into Practice, 47(3), 197-203. doi: 10.1080/00405840802153809

Medway, D., Roper, S., & Gillooly, L. (2018). Contract cheating in UK higher education: A covert investigation of essay mills. British Educational Research Journal, 44(3), 393- 418. doi: 10.1002/berj.3335

Millican, P. (2003). The Signature Stylometry System: A user-friendly system for textual analysis. The Leeds Electronic Text Centre, 24.

Mosteller, F., & Wallace, D. L. (1963). Inference in an authorship problem: A comparative study of discrimination methods applied to the authorship of the disputed Federalist Papers. Journal of the American Statistical Association, 58(302), 275-309.

Neal, T., Sundararajan, K., Fatima, A., Yan, Y., Xiang, Y., & Woodard, D. (2018). Surveying stylometry techniques and applications. ACM Computing Surveys (CSUR), 50(6), 86. doi: 10.1145/3132039

Newton, P. (2018). How common is commercial contract cheating in higher education? In Frontiers in Education, 3, article 67, 1-18. doi: 10.3389/fedue.2018.00067

Nieto, V. G., Sierra, C. V., Juan, M. P., Barco, P. M., & Cueto, A. S. (2008). Exploring state-of the-art software for forensic authorship identification. International Journal of English Studies, 8(1), 1-28.

Perkins, M., Gezgin, U. B., & Roe, J. (2018). Understanding the relationship between language ability and plagiarism in non-native English speaking business students. Journal of Academic Ethics, 16(4), 317-328.

Posadas-Durán, J. P., Gómez-Adorno, H., Sidorov, G., Batyrshin, I., Pinto, D., & Chanona Hernández, L. (2017). Application of the distributed document representation in the authorship attribution task for small corpora. Soft Computing, 21(3), 627-639. doi: 10.1007/s00500-016-2446-x

Prasad, S. N., Narsimha, V. B., Reddy, P. V., & Babu, A. V. (2015). Influence of lexical, syntactic and structural features and their combination on authorship attribution for Telugu text. Procedia Computer Science, 48, 58-64. doi: 10.1016/j.procs.2015.04.110

Puig, X., Font, M., & Ginebra, J. (2016). A unified approach to authorship attribution and verification. The American Statistician, 70(3), 232-242. doi: 10.1080/00031305.2016.1148630

Ragel, R., Herath, P., & Senanayake, U. (2013, December). Authorship detection of SMS messages using unigrams. In 2013 IEEE 8th International Conference on Industrial and Information Systems (pp. 387-392). IEEE.

Rigby, D., Burton, M., Balcombe, K., Bateman, I., & Mulatu, A. (2015). Contract cheating & the market in essays. Journal of Economic Behavior & Organization, 111, 23-37. doi: 10.1016/j.jebo.2014.12.019

Rogerson, A. (2014). Detecting the work of essay mills and file swapping sites: some clues they leave behind. 6th International Integrity & Plagiarism Conference: Conference Proceedings (pp. 1-9). Newcastle-on-Tyne, UK: Plagiarismadvice.org

Rogerson, A. M. (2017). Detecting contract cheating in essay and report submissions: process, patterns, clues and conversations. International Journal for Educational Integrity, 13(1), 10. doi: 10.1007/s40979-017-0021-6

Salkind, N. J. (2012). Exploring research (8th ed.). Upper Saddle River, NJ: Pearson.

Sarwar, R., Li, Q., Rakthanmanon, T., & Nutanong, S. (2018). A scalable framework for cross lingual authorship identification. Information Sciences, 465, 323-339. doi: 10.1016/j.ins.2018.07.009

Singh, S., & Remenyi, D. (2016). Plagiarism and ghostwriting: The rise in academic misconduct. South African Journal of Science, 112(5-6), 1-7. doi: 10.17159/sajs.2016/20150300

Singleton, P., & Ricksen, M. (2019, April). Your guide to recognizing various forms of plagiarism and gaining insights from technology. Paper presented at the Canadian Symposium on Academic Integrity, University of Calgary, Calgary, Canada. Abstract retrieved from https://prism.ucalgary.ca/handle/1880/110294

Slade, C., Rowland, S., & McGrath, D. (2019). Talking about contract cheating: facilitating a forum for collaborative development of assessment practices to combat student dishonesty. International Journal for Academic Development, 24(1), 21-34.

Stolerman, A., & Dutko, T. (2013). JStylo Authorship Attribution Framework v1.2 [Computer software]. Retrieved from https://psal.cs.drexel.edu/index.php/JStylo-Anonymouth

Taylor, S. M. (2014). Term papers for hire: How to deter academic dishonesty. The Education Digest, 80(2), 52.

Turnitin. (2019). Authorship investigate. Retrieved from https://www.turnitin.com/products/authorship-investigate

Top 20 Writing Services. (2019). The 20 best dissertation writing services in 2019. Retrieved from https://top20writingservices.com/best-dissertation-writing-services/

Wallace, M. J., & Newton, P. M. (2014). Turnaround time and market capacity in contract cheating. Educational Studies, 40(2), 233-236. doi: 10.1080/03055698.2014.889597

White, J. L. (2016). Shadow Scholars and the Rise of the Dissertation Service Industry: Can We Maintain Academic Integrity? Journal of Research Practice, 12(1), article V1.

Downloads

Published

2020-06-01

Issue

Vol. 24 No. 2 (2020)

Section

Empirical Studies

License

As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.

This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.

Author(s) hold copyright in their work, and retain publishing rights without restrictions