The Cyclical Ethical Effects of Using AI in Education

Framework

The research underpinning this presentation was done by researchers with and for the benefit of diverse frontline educators, other researchers, and developers to collectively produce new knowledge and validate existing knowledge associated with the use of AI in education.

Methods

A synthetic literature review. This study included the reading, reviewing, and synthesizing of over 100 journal articles, edited books and book chapters, books, and conference presentations. Coupled with a standard literature review were interviews with industry and education leaders. Those interviews used a semi-structured protocol. From our investigations, we developed a new and more useful theoretical perspective by rigorously integrating the results of interviews and previous studies.

Results

The results of the synthetic literature review include a new framework that will help frontline educators, other researchers, and developers understand the interdependent and cyclical effects of using AI in education.

Importance

Learners of all ages and educators must prepare to collaborate with AI to do work that neither is capable of in isolation. For AI to be a positive force in equity, the humans --- especially frontline educators, leaders, researchers, developers, funders, and parents --- must have responsibility and control over ethical decision making, which involves understanding the cyclical ethical effects of using AI in education.

References

Adjei, S., Ostrow, K., Erickson, E., & Heffernan, N. (2017). Clustering students in ASSISTments: Exploring system and school-level traits to advance personalization. Proceedings of the 10th international conference on Educational Data Mining, Hubei Province, China.
Angwin, J., Larson, J., Mattu, S., & Kirchner, L. (2016). Machine bias: There’s software used across the country to predict future criminals. And it’s biased against blacks. ProPublica. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
Autor, D. H. (2015). Why are there still so many jobs? The history and future of workplace automation. Journal of Economic Perspectives, 29(3), 3-30. https://doi.org/10.1257/jep.29.3.3
Baker, R. S. (2019). Challenges for the future of educational data mining: The Baker Learning Analytics Prizes. Journal of Educational Data Mining, 11(1), 1-17. https://doi.org/10.5281/zenodo.3554745
Baker, R. S., & Hawn, A. (in press). Algorithmic bias in education. EdArXiv. https://doi.org/10.35542/osf.io/pbmvz
Bakhshi, H., Downing, J., Osborne, M., & Schneider, P. (2017). The future of skills: Employment in 2030. Pearson and Nesta. https://futureskills.pearson.com/research/assets/pdfs/technical-report.pdf
Bondie, R., & Dede, C. (2021). Redefining and transforming field experiences in teacher preparation through personalized mixed-reality simulations. In R. E. Ferdig & K. E. Pytash (Eds.), What teacher educators should have learned from 2020 (pp. 229-242). Association for the Advancement of Computing in Education. https://www.learntechlib.org/p/219088/
Buolamwini, J., & Gebru, T. (2018). Gender shades: Intersectional accuracy disparities in commercial gender classification. Proceedings of the 1st Conference on Fairness, Accountability and Transparency, New York, NY. http://proceedings.mlr.press
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017). Semantics derived automatically from language corpora contain human-like biases. Science, 356(6334), 183-186. https://doi.org/10.1126/science.aal4230
CAST. (2018). Universal design for learning guidelines. Version 2.2. https://udlguidelines.cast.org/
Chandra, S., Chang, A., Day, L., Fazlullah, A., Liu, J., McBride, L., Mudalige, T., & Weiss, D. (2020). Closing the K-12 digital divide in the age of distance learning. https://www.commonsensemedia.org/sites/default/files/uploads/pdfs/common_sense_media_report_final_7_1_3pm_web.pdf
Chardin, M., & Novak, K. (2020). Equity by design: Delivering on the power and promise of UDL. Corwin Press.
Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. (2016). Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research, 86(1), 79-122. https://doi.org/10.3102/0034654315582065
Council of Chief State School Officers. (2018). States leading for equity: Promising practices advancing the equity commitments. https://ccsso.org/sites/default/files/2018-03/States%20Leading%20for%20Equity%20Online_031418.pdf
D'Mello, S., Dieterle, E., & Duckworth, A. (2017). Advanced, analytic, automated (AAA) measurement of engagement during learning. Educational Psychologist, 52(2), 104-123. https://doi.org/10.1080/00461520.2017.1281747
D’Angelo, C., Rutstein, D., Harris, C., Bernard, R., Borokhovski, E., & Haertel, G. (2014). Simulations for STEM learning: Systematic review and meta-analysis. SRI International. https://www.sri.com/wp-content/uploads/pdf/simulations-for-stem-learning-full-report.pdf
Damasio, A. R. (1999). The feeling of what happens: Body and emotion in the making of consciousness. Houghton Mifflin Harcourt.
Daniel, B. K. (2019). Big data and data science: A critical review of issues for educational research. British Journal of Educational Technology, 50(1), 101-113. https://doi.org/10.1111/bjet.12595
Darling-Hammond, L., Zielezinski, M. B., & Goldman, S. (2014). Using technology to support at-risk students' learning. https://edpolicy.stanford.edu/sites/default/files/scope-pub-using-technology-report.pdf
Dede, C. (2015). Data-intensive research in education: Current work and next steps. Computing Research Association. https://cra.org/wp-content/uploads/2015/10/CRAEducationReport2015.pdf
Dede, C. (2019). Improving efficiency and effectiveness through learning engineering. In C. Dede, J. Richards, & B. Saxberg (Eds.), Learning engineering for online education: Theoretical contexts and design-based examples (pp. 1-14). Routledge.
Dede, C. (2020a). Introduction: Reconceptualizing higher education and lifelong learning in the era of the synergistic digital economy. In C. Dede & J. Richards (Eds.), The 60-year curriculum: New models for lifelong learning in the digital economy (pp. 1-24). Routledge.
Dede, C. (2020b). Necessity is the parent of transformation: Universal, blended, personalized, lifelong learning. School Administrator, 77(7), 26-29. https://my.aasa.org/AASA/Resources/SAMag/2020/Aug20/Dede.aspx
Dede, C. (2021). Supporting unlearning to enable upskilling. In J. Wingard & C. A. Farrugia (Eds.), The great skills gap: Optimizing talent for the future of work (pp. 79-84). Stanford Business Books.
Dede, C., Etemadi, A., & Forshaw, T. (2021). Intelligence augmentation: Upskilling humans to complement AI.
Development, O. f. E. C.-o. a. (2018). The future of education and skills: Education 2030. http://www.oecd.org/education/2030/oecd-education-2030-position-paper.pdf
Díaz, P., Ioannou, A., Bhagat, K. K., & Spector, J. M. (Eds.). (2019). Learning in a digital world: Perspective on interactive technologies for formal and informal education. Springer. https://doi.org/10.1007/978-981-13-8265-9.
Educational Testing Service. (2014). ETS standards for quality and fairness. https://www.ets.org/s/about/pdf/standards.pdf
Ercikan, K., & Pellegrino, J. W. (Eds.). (2017). Validation of score meaning for the next generation of assessments: The use of response processes. Routledge.
Eubanks, V. (2017). Automating inequality: How high-tech tools profile, police, and punish the poor. St. Martin's Press.
European Commission. (n.d.). AI watch: Monitor the development, uptake and impact of Artificial Intelligence for Europe. Retrieved July 25, 2021 from https://knowledge4policy.ec.europa.eu/ai-watch_en
European Economic and Social Committee. (2017). The ethics of big data: Balancing economic benefits and ethical questions of big data in the EU policy context. European Union. https://doi.org/10.2864/18937
Ferrero, F., & Barujel, A. G. (2019). Algorithmic driven decision-making systems in education: Analyzing bias from the sociocultural perspective. 2019 XIV Latin American Conference on Learning Technologies (LACLO), https://doi.org/10.1109/LACLO49268.2019.00038
Finlay, L. (2016). Negotiating the swamp: The opportunity and challenge of reflexivity in research practice. Qualitative Research, 2(2), 209-230. https://doi.org/10.1177/146879410200200205
Fischer, C., Pardos, Z. A., Baker, R. S., Williams, J. J., Smyth, P., Yu, R., Slater, S., Baker, R., & Warschauer, M. (2020). Mining big data in education: Affordances and challenges. Review of Research in Education, 44(1), 130-160. https://doi.org/10.3102/0091732x20903304
Fishman, B., & Dede, C. (2016). Teaching and technology: New tools for new times. In D. H. Gitomer & C. A. Bell (Eds.), Handbook of research on teaching (Fifth ed., pp. 1269-1334). American Educational Research Association. https://doi.org/10.3102/978-0-935302-48-6_21
Giannakos, M. N., Sharma, K., Pappas, I. O., Kostakos, V., & Velloso, E. (2019). Multimodal data as a means to understand the learning experience. International Journal of Information Management, 48, 108-119. https://doi.org/https://doi.org/10.1016/j.ijinfomgt.2019.02.003
Gigerenzer, G. (2008). Gut feelings: The intelligence of the unconscious. Penguin Books.
Gulick, W. B. (2020). Machine and person: Reconstructing Harry Collins’s categories. Ai & Society. https://doi.org/10.1007/s00146-020-01046-3
Heffernan, N. T., & Heffernan, C. L. (2014). The ASSISTments ecosystem: Building a platform that brings scientists and teachers together for minimally invasive research on human learning and teaching. International Journal of Artificial Intelligence in Education, 24(4), 470-497. https://doi.org/10.1007/s40593-014-0024-x
IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. (2018). Ethically aligned design: A vision for prioritizing human well-being with autonomous and intelligent systems. IEEE. https://standards.ieee.org/content/dam/ieee-standards/standards/web/documents/other/ead1e.pdf
Jiang, W., Pardos, Z. A., & Wei, Q. (2019). Goal-based course recommendation Proceedings of the 9th International Conference on Learning Analytics & Knowledge, Tempe, AZ. https://doi.org/10.1145/3303772.3303814
Kirkpatrick, K. (2016). Battling algorithmic bias. Communications of the ACM, 59(10), 16-17. https://doi.org/10.1145/2983270
Kirsch, I., Sands, A., Robbins, S., Goodman, M., & Tannenbaum, R. (2021). Buttressing the middle: A case for reskilling and upskilling America’s middle-skill workers in the 21st century. https://www.ets.org/s/research/pdf/buttressing-policy-report.pdf
Kostyuk, V., Almeda, M. V., & Baker, R. S. (2018). Correlating affect and behavior in reasoning mind with state test achievement. Proceedings of the 8th International Conference on Learning Analytics and Knowledge, Sydney, Australia.
LearnPlatform. (2021). Edtech engagement & digital learning equity gaps. Retrieved July 14, 2021 from https://learnplatform.com/insights/infographic/2020-digital-equity-in-review
LeDoux, J. (1998). The emotional brain: The mysterious underpinnings of emotional life. Simon and Schuster.
Lee, Y.-H., & Haberman, S. J. (2016). Investigating test-taking behaviors using timing and process data. International Journal of Testing, 16(3), 240-267. https://doi.org/10.1080/15305058.2015.1085385
Levy, R. (2019). Dynamic Bayesian network modeling of game-based diagnostic assessments. Multivariate Behavioral Research, 54(6), 771-794. https://doi.org/10.1080/00273171.2019.1590794
Luckin, R. (2018). Machine learning and human intelligence: The future of education for the 21st century. UCL IOE Press.
Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Pearson. https://www.pearson.com/content/dam/one-dot-com/one-dot-com/global/Files/about-pearson/innovation/open-ideas/Intelligence-Unleashed-v15-Web.pdf
MacLean, C. L., & Dror, I. E. (2016). A primer on the psychology of cognitive bias. In C. T. Robertson & A. S. Kesselheim (Eds.), Blinding as a solution to bias: Strengthening biomedical science, forensic science, and law (pp. 13-24). Academic Press. https://doi.org/10.1016/B978-0-12-802460-7.00001-2
Mandinach, E. B., & Miskell, R. C. (2018). Blended learning and data use in three technology-infused charter schools. LEARNing Landscapes, 11(1), 183-198. https://doi.org/10.36510/learnland.v11i1.931
Mandinach, E. B., & Schildkamp, K. (2021). Misconceptions about data-based decision making in education: An exploration of the literature. Studies in Educational Evaluation, 69, 1-10. https://doi.org/10.1016/j.stueduc.2020.100842
Marco, C. A., & Larkin, G. L. (2000). Research ethics: Ethical issues of data reporting and the quest for authenticity. Acad Emerg Med, 7(6), 691-694. https://doi.org/10.1111/j.1553-2712.2000.tb02049.x
Mitchell, M., Baker, D., Moorosi, N., Denton, E., Hutchinson, B., Hanna, A., Gebru, T., & Morgenstern, J. (2020). Diversity and inclusion metrics in subset selection. 2020 AAAI/ACM Conference on AI, Ethics, and Society (AIES ’20), New York, NY.
National Academies of Sciences, Engineering, and Medicine. (2000). How people learn: Brain, mind, experience, and school (Expanded ed.). National Academy Press. https://doi.org/10.17226/9853
National Academies of Sciences, Engineering, and Medicine. (2018). How people learn II: Learners, contexts, and cultures. The National Academy Press. https://doi.org/10.17226/24783
Nielsen, M. W., Bloch, C. W., & Schiebinger, L. (2018). Making gender diversity work for scientific discovery and innovation. Nature Human Behaviour, 2(10), 726-734. https://doi.org/10.1038/s41562-018-0433-1
Niemi, D. M., Pea, R. D., Saxburg, B., & Clark, R. E. (Eds.). (2018). Learning analytics in education. Information Age Publishing Inc.
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019). Social data: Biases, methodological pitfalls, and ethical boundaries. Frontiers in Big Data, 2. https://doi.org/10.3389/fdata.2019.00013
Pardos, Z. A., Baker, R. S., San Pedro, M., Gowda, S. M., & Gowda, S. M. (2014). Affective states and state tests: Investigating how affect and engagement during the school year predict end-of-year learning outcomes. Journal of Learning Analytics, 1(1), 107-128. https://doi.org/10.18608/jla.2014.11.6
Perkins, D. (1992). Smart schools: Better thinking and learning for every child. Free Press.
Perkins, D. (1995). Outsmarting IQ: The emerging science of learnable intelligence. Free Press.
Ramsetty, A., & Adams, C. (2020). Impact of the digital divide in the age of COVID-19. Journal of the American Medical Informatics Association, 27(7), 1147-1148. https://doi.org/10.1093/jamia/ocaa078
Ritchhart, R. (2002). Intellectual character: What it is, why it matters, and how to get it. John Wiley & Sons.
Sao Pedro, M. A., Baker, R. S., Gobert, J. D., Montalvo, O., & Nakama, A. (2013). Leveraging machine-learned detectors of systematic inquiry behavior to estimate and predict transfer of inquiry skill. User Modeling and User-Adapted Interaction, 23(1), 1-39. https://doi.org/10.1007/s11257-011-9101-0
Schiff, D. (2021). Out of the laboratory and into the classroom: The future of artificial intelligence in education. Ai & Society, 36(1), 331-348. https://doi.org/10.1007/s00146-020-01033-8
Schildkamp, K., Lai, M. K., & Earl, L. M. (Eds.). (2013). Data-based decision making in education: Challenges and opportunities. Springer.
Schildkamp, K., Poortman, C. L., Ebbeler, J., & Pieters, J. M. (2019). How school leaders can build effective data teams: Five building blocks for a new wave of data-informed decision making. Journal of Educational Change, 20(3), 283-325. https://doi.org/10.1007/s10833-019-09345-3
Schwartz, R., Down, L., Jonas, A., & Tabassi, E. (2021). A proposal for identifying and managing bias within artificial intelligence. https://doi.org/10.6028/NIST.SP.1270-draft
Shah, D. S., Schwartz, H. A., & Hovy, D. (2020). Predictive biases in natural language processing models: A conceptual framework and overview. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics,
Shao, E., Guo, S., & Pardos, Z. A. (2021). Degree planning with PLAN-BERT: Multi-semester recommendation using future courses of interest. Proceedings of the AAAI Conference on Artificial Intelligence, 35(17), 14920-14929. https://ojs.aaai.org/index.php/AAAI/article/view/17751
Shepard, L. A. (2019). Classroom assessment to support teaching and learning. The ANNALS of the American Academy of Political and Social Science, 683(1), 183-200. https://doi.org/10.1177/0002716219843818
Shohamy, E. (2016). Democratic assessment as an alternative. Language Testing, 18(4), 373-391. https://doi.org/10.1177/026553220101800404
Shute, V., Rahimi, S., Smith, G., Ke, F., Almond, R., Dai, C. P., Kuba, R., Liu, Z., Yang, X., & Sun, C. (2020). Maximizing learning without sacrificing the fun: Stealth assessment, adaptivity and learning supports in educational games. Journal of Computer Assisted Learning. https://doi.org/10.1111/jcal.12473
Shute, V., & Wang, L. (2017). Assessing and supporting hard-to-measure constructs in video games. In A. A. Rupp & J. P. Leighton (Eds.), The handbook of cognition and assessment: Frameworks, methodologies, and applications (pp. 535-562). John Wiley & Sons. https://doi.org/10.1002/9781118956588.ch22
Shute, V. J., & Ventura, M. (2013). Stealth assessment: Measuring and supporting learning in video games. The MIT Press.
Smith, B. C. (2019). The promise of artificial intelligence: Reckoning and judgment. The MIT Press.
Spann, C. A., Shute, V. J., Rahimi, S., & D'Mello, S. K. (2019). The productive role of cognitive reappraisal in regulating affect during game-based learning. Computers in Human Behavior, 100, 358-369. https://doi.org/10.1016/j.chb.2019.03.002
Stadler, M., Fischer, F., & Greiff, S. (2019). Taking a closer look: An exploratory analysis of successful and unsuccessful strategy use in complex problems. Frontiers in Psychology, 10(777). https://doi.org/10.3389/fpsyg.2019.00777
U.S. Department of Education. (2010). Transforming American education: Learning powered by technology. https://www.ed.gov/sites/default/files/netp2010.pdf
UNESCO. (2019). Artificial intelligence in education. Retrieved July 26, 2021 from https://en.unesco.org/artificial-intelligence/education
van Rijn, P. W., & Ali, U. S. (2017). A comparison of item response models for accuracy and speed of item responses with applications to adaptive testing. British Journal of Mathematical and Statistical Psychology, 70(2), 317-345. https://doi.org/10.1111/bmsp.12101
VanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46(4), 197-221. https://doi.org/10.1080/00461520.2011.611369
Wang, Y., Kai, S., & Baker, R. S. (2020). Early detection of wheel-spinning in ASSISTments. In I. I. Bittencourt, M. Cukurova, K. Muldner, R. Luckin, & E. Millán (Eds.), Artificial Intelligence in Education. AIED 2020. Lecture Notes in Computer Science (Vol. 12163, pp. 574-585). Springer International Publishing. https://doi.org/10.1007/978-3-030-52237-7_46
Yapo, A., & Weiss, J. (2018). Ethical implications of bias in machine learning. Hawaii International Conference on System Sciences 2018, Waikoloa Village, HI.
Završnik, A. (2019). Algorithmic justice: Algorithms and big data in criminal justice settings. European Journal of Criminology. https://doi.org/10.1177/1477370819876762
Zwitter, A. (2014). Big data ethics. Big Data & Society, 1(2), 1-6. https://doi.org/10.1177/2053951714559253