What Evidence Is There That the ISTE Standards Work?

Framework

The educator section of the ISTE Standards

Methods

A “systematic scoping review” methodology (Peters, et al., 2015) has been used. Scoping reviews, also known as “mapping reviews” (Anderson, et al., 2008; Arksey & O’Malley, 2005; Ehrich, et al., 2002) synthesize research evidence and map existing literature of a field in terms of topics and features (Peters, et al., 2015). The systematic scoping review methodology used in this study is more focused than a basic scoping review in that an a priori (Stemler, 2001) scoping review protocol was developed prior to undertaking the review. This protocol provided transparency in how the researchers searched the literature to find the evidence, including what databases were searched, across what years, and how the researchers knew what type of research to include or exclude.
The a priori approach in this study is a systematic review process using PRISMA principles Page et al., 2021). It is important to note that while a systematic scoping review is similar to a systematic review, a systematic review examines the literature to synthesize the research and develop new theories on the gathered data, whereas a scoping review has the goal of determining a range of evidence available on a topic (Peters et al., 2015) aligned to this study.

Results

Both studies completed.
ISTE Standards were developed.
ISTE Standards were also connected to existing research to evidence learning gains.

Importance

This study is unique in mapping the first set of empirically developed educator standards with extant research evidence to support the increase in student learning based on implementing the standards. It is important for the reader to note that following the methodology, only a few studies were selected for each practice as an example of the evidence and not as an exhaustive list of evidence. This study is important for researchers, practitioners, funders, and policymakers as it provides empirical evidence that the technology practices within the ISTE Standards lead to student learning gains.

References

References from the mapping of the ISTE standards to extant research.

Akçayır, M., & Akçayır, G. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review 20, 1–11.

Akiba, M., & Liang, G. (2016). Effects of teacher professional characteristics on student achievement. The Journal of Educational Research, 109(1), 99–110. http://dx.doi.org/10.1080/10494820.2013.817437

Aksit, O., & Wiebe, E. N. (2020). Exploring force and motion concepts in middle grades using computational modeling: A classroom intervention study. Journal of Science Education and Technology, 29, 65–82. https://doi.org/10.1007/s10956-019-09800–z

Albion, P. R., Tondeur, J., Forkosh-Baruch, A., & Peeraer, J. (2015). Teachers’ professional development for ICT integration: Towards a reciprocal relationship between research and practice. Educational Information Technology 20, 655-673. DOI 10.1007/s10639-015-9401-9
Alcantara, E., Alcantara, E. C., Marie, J., & Bacsa, P. (2017). Critical Thinking and Problem-Solving Skills in Mathematics of Grade-7 Public Secondary Students. Asia Pacific Journal of Multidisciplinary Research, 5(4), 21–27. http://www.apjmr.com/wp-content/uploads/2017/12/APJMR-2017.5.4.2.03.pdf
Anderson, S., Allen, P., Peckham, S., & Goodwin, N. (2008). Asking the right questions: scoping studies in the commissioning of research on the organisation and delivery of health services. Health Research Policy and Systems 6(7). https://doi.org/10.1186/1478-4505-6-7

Arksey, H., & O’Malley, L. (2005). Scoping studies: towards a methodological framework. International Journal of Social Research Methodology 8(1)19–32. https://doi.org/10.1080/1364557032000119616

Asterhan, C. S. C., & Rosenberg, H. (2015). The promise, reality and dilemmas of secondary school teacher–student interactions in Facebook: The teacher perspective. Computers & Education, 85, 134–148. https://doi.org/10.1016/j.compedu.2015.02.003

Aynas, N., & Aslan, M. (2021). The effects of authentic learning practices on academic success in science courses. Educational Research Quarterly, 44(4), 3–30.

Baker, T., Smith, L., & Anissa, N. (2019). Educ-AI-tion rebooted? Exploring the future of artificial intelligence in schools and colleges. In Educ-AI-tion rebooted? Exploring the future of artificial intelligence in schools and colleges (Issue February). Nesta. https://media.nesta.org.uk/documents/Future_of_AI_and_education_v5_WEB.pdf

BERA-RSA. (2014). Research and the teaching profession. Building the capacity for a self-improving education system. Final report of the BERA-RSA inquiry into the role of research in teacher education. Retrieved from https://www.bera.ac.uk/wp-content/uploads/2013/12/BERA-RSA-Research-Teaching-Profession-FULL-REPORT-for-web.pdf

Blau, I., & Shamir-Inbal, T. (2018). Digital technologies for promoting “student voice” and co-creating learning experience in an academic course. Instructional Science, 46(2), 315–336. https://doi.org/10.1007/s11251-017-9436-y

Bold, T., Filmer, D., Martin, G., Molina, E., Rockmore, C., Stacy, B., Svensson, J., & Wane, W. 2017. What Do Teachers Know and Do? Does It Matter? Evidence from Primary Schools in Africa. Policy Research Working Paper 7956, World Bank.

Bowman, M. A., Vongkulluksn, V. W., Jiang, Z., & Xie, K. (2022). Teachers’ exposure to professional development and the quality of their instructional technology use: The mediating role of teachers’ value and ability beliefs. Journal of Research on Technology in Education, 54(2), 188–204. https://doi.org/10.1080/15391523.2020.1830895

Brasof, M., & Spector, A. (2016). Teach students about civics through schoolwide governance. Phi Delta Kappan, 97, 7, 63-68.

Carpenter, J. P., & Justice, J. E. (2018). Can technology support teaching for global readiness? The case of the global read aloud. LEARNing Landscapes, 11(1), 65–85.

Chapman, A. L., & Marich, H. (2021). Using Twitter for Civic Education in K-12 Classrooms. TechTrends, 65(1), 51–61. https://doi.org/10.1007/s11528-020-00542-z

Chatti, M. A., & Muslim, A. (2019). The PERLA framework: Blending personalization and learning ana-lytics. International Review of Research in Open and Distance Learning, 20(1), 244–261. https://doi.org/10.19173/irrodl.v20i1.3936

Cherner, T., & Mitchell, C. (2021). Deconstructing edtech frameworks based on their creators, features, and usefulness. Learning, Media and Technology 46(1), 91-116. https://doi.org/10.1080/17439884.2020.1773852

Coskun, H., Dogan, A., & Uluay, G. (2017). The effect of technology on students opinions about authentic learning activities in science courses. Universal Journal of Educational Research, 5(1), 72–83. https://doi.org/10.13189/ujer.2017.050109

Crompton, H. (2017a). ISTE Standards for educators 2017: A guide for teachers and other professionals. International Society for Technology in Education. Arlington, VA.

Crompton, H. (2017b). Moving toward a mobile learning landscape: Presenting a mlearning integration framework. Interactive Technology and Smart Education, 18(2) 97-109. https://doi.org/10.1108/ itse-02-2017-0018

Crompton, H., Burke, D., Jordan, K., & Wilson, S. (2021). Support provided for K-12 teachers teaching remotely with technology during emergencies: A systematic review. Journal of Research on Technology in Education, 0(0), 1–16. https://doi.org/10.1080/15391523.2021.1899877

Crompton, H., Olszewski, B., & Bielefeldt, T. (2016). The mobile learning training needs of educators in technology-enabled environments. Professional Development in Education, 42(3), 482-501. https://doi.org/10.1080/19415257.2014.1001033

Crompton, H., & Sykora, C. (2021). Developing instructional technology standards for educators: A design-based research study. Computers and Education Open. 2 https://doi.org/10.1016/j.caeo.2021.100044

Darling-Hammond, L. (2017). Teacher education around the world: What can we learn from international practice? European Journal of Teacher Education, 40(3), 291–309.

Dinçer, S. (2018). Are preservice teachers really literature enough to integrate technology in their classroom practice? Determining the technology literacy level of preservice teachers. Education and Information Technologies 23(6), 2699–2718.

Dogan, S., Pringle, R., & Mesa, J. (2016). The impacts of professional learning communities on science teachers’ knowledge, practice and student learning: A review. Professional Development in Education, 42, 569–588. doi:10.1080/19415257.2015.1065899

Ehrich, Kathryn, Freeman, George K., Richards, Sally C., Robinson, Ian C. & Shepperd, Sasha (2002) How to do a scoping exercise: continuity of care. Research, Policy and Planning, 20 (1), 25-29.
Fernández-Batanero, J. M., Montenegro-Rueda, M., Fernández-Cerero, J., & García-Martínez, I. (2022). Assistive technology for the inclusion of students with disabilities: a systematic review. Educational Technology Research and Development. https://doi.org/10.1007/s11423-022-10127-7

Franklin, D., Coenraad, M., Palmer, J., Eatinger, D., Zipp, A., Anaya, M., White, M., Pham, H., Gökdemir, O., & Weintrop, D. (2020). An analysis of use-modify-create pedagogical approach’s success in balancing structure and student agency. ICER 2020 - Proceedings of the 2020 ACM Conference on International Computing Education Research, 14–24. https://doi.org/10.1145/3372782.3406256

Freire, P. (1994). Pedagogy of hope: Reliving pedagogy of the oppressed. Continuum Publishing.

Gazi, Z. A. (2016). Internalization of digital citizenship for the future of all levels of education. Egitim ve Bilim, 41(186) 137–148. http://egitimvebilim.ted.org.tr/index.php/EB/article/viewFile/4533/2471

Godwin, A., Potvin, G., Hazari, Z., & Lock, R. (2016). Identity, critical agency, and engineering: An affective model for predicting engineering as a career choice. Journal of Engineering Education, 105(2), 312–340. https://doi.org/10.1002/jee.20118

Greenhow, C., Glavin, S., Brandon, D., & Askari, E. (2020). A decade of research on K-12 teaching and teacher learning with social media: Insights on the state-of-the-field. Teachers College Record, 122(6).

Grover, S., Basu, S., Bienkowski, M., Eagle, M., Diana, N., & Stamper, J. (2017). A framework for using hypothesis-driven approaches to support data-driven learning analytics in measuring computational thinking in block-based programming environments. ACM Transactions on Computing Education, 17(3), 1–25. https://doi.org/10.1145/3105910

Healy, G., & Walshe, N. (2020). Real-world geographers and geography students using GIS: relevance, everyday applications and the development of geographical knowledge. International Research in Geographical and Environmental Education, 29(2), 178–196. https://doi.org/10.1080/10382046.2019.1661125

Heidari, K. (2020). Critical thinking and EFL learners’ performance on textually-explicit, textually-implicit, and script-based reading items. Thinking Skills and Creativity, 37(August), 100703. https://doi.org/10.1016/j.tsc.2020.100703

Henricksen, D., Creely, E., & Henderson, M. (2019). Failing in creativity: The problem of policy and practice in Australia and the United States. Kappa Delta Pi Record, 55(1), 4–10. https://doi.org/10.1080/00228958.2019.1549429.

Huang, C. S., Yang, S. J., Chiang, T. H., & Su, A. Y. (2016). Effects of situated mobile learning approach on learning motivation and performance of EFL students. Educational Technology & Society, 19(1), 263–276.

Hwang, G. J., Chiu, L. Y., & Chen, C. H. (2015). A contextual game-based learning approach to improving students’ inquiry-based learning performance in social studies courses. Computers and Education, 81, 13–25. https://doi.org/10.1016/j.compedu.2014.09.006.

Ibáñez, M. B. Portillo, A. U. Cabada, R. Z. & Barrón, M. L. (2020). Impact of augmented reality technology on academic achievement and motivation of students from public and private Mexican schools. A case study in a middle-school geometry course. Computers & Education 145, 1–9. https://doi.org/10.1016/j.compedu.2019.103734

ISTE. (2017). ISTE standards for educators. International Society for Technology in Education. Retrieved from https://www.iste.org/standards/for-educators

InTasc; Council of Chief State School Officers. (2013). Interstate teacher assessment and support consortium InTASC model core teaching standards and learning progressions for teachers 1.0: A resource for ongoing teacher development. InTasc.

Jakhelln, R., Eklund, G., Aspfors, J., Bjørndal, K., & Stølen, G. (2021). Newly qualified teachers’ understandings of research-based teacher education practices−Two cases from Finland and Norway. Scandinavian Journal of Educational Research, 65(1), 123–139. https://doi.org/10.1080/00313831.2019.1659402

Kim, M., & Choi, D. (2018). Development of youth digital citizenship scale and implication for educational setting. Educational Technology & Society, 21(1), 155–171. http://www.jstor.org/stable/26273877

Kim, M. K., Xie, K., & Cheng, S. L. (2017). Building teacher competency for digital content evaluation. Teaching and Teacher Education, 66, 309–324. https://doi.org/10.1016/j.tate.2017.05.006

Koehler, M. J., & Mishra, P. (2008). Introducing TPACK. In American Association of Colleges for Teacher Education Committee on Innovation and Technology (Ed.), Handbook of Technological Pedagogical Content Knowledge (TPACK) for Educators (pp. 3-29). New York: Routledge.

Lee, I. (2016). Reclaiming the roots of CT. CSTA Voice; The Voice of K-12 Computer Science Education and its Educators, 12(1), 3–5.

Luo, H., Li, G., Feng, Q., Yang, Y., & Zuo, M. (2021). Virtual reality in K-12 and higher education: A systematic review of the literature from 2000 to 2019. Journal of Computer Assisted Learning 37(1). https://doi.org/10.1111/jcal.12538

Mishra, P., & Koehler, M. J. (2007). Technological pedagogical content knowledge (TPCK): Confronting the wicked problems of teaching with technology. In R. Carlsen, K. McFerrin, J. Price, R. Weber, & D. A. Willis (Eds.), Proceedings of Society for Information Technology and Teacher Education (pp. 2214–2226). AACE.

Moon, E. C. (2018). Teaching students out of harm’s way: Mitigating digital knowledge gaps and digital risk created by 1:1 device programs in K-12 education in the USA. Journal of Information, Communication and Ethics in Society, 16(3), 290–302. https://doi.org/10.1108/JICES-02-2018-0012
Mystakidis, S., & Christopoulos, A. (2022). Teacher Perceptions on Virtual Reality Escape Rooms for STEM Education. Information (Switzerland), 13(3), 1–14. https://doi.org/10.3390/info13030136

Ornstein, A. C., & Hunkins, F. P. (2016). Curriculum: Foundations, principles, and issues (7th ed.). Pearson.
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T., Mulrow, C. … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. British Medical Journal 372(71). https://doi.org/10.1136/bmj.n71
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D. & Baldini Soares, C. (2015). Guidance for conducting systematic scoping reviews. International Journal of Evidence Based Healthcare 13, 141-146.

Petrucco, C., & Agostini, D. (2020). Student perceptions of fake news. International Journal of Digital Literacy and Digital Competence, 11(2), 28–43. https://doi.org/10.4018/ijdldc.2020040103

Puentedura, R. (2009, February 4) As we may teach: Educational technology, from theory into practice [Blog] Ruben R. Puentedura’s Weblog Available online at http://www.hiasuscom/rrpweblog/archives/000025html.

Popova, A., Evans, D. K., Breeding, M. E., & Arancibia, V. (2022). Teacher Professional Development around the World: The Gap between Evidence and Practice. World Bank Research Observer, 37(1), 107–136. https://doi.org/10.1093/wbro/lkab006

Qian, Y., & Lehman, J. D. (2019). Using targeted feedback to address common student misconceptions in introductory programming: A data-driven approach. Sage Open, 9(4). https://doi.org/10.1177/2158244019885136

Ronfeldt, M., Farmer, S. O., McQueen, K., & Grissom, J. A. (2015). Teacher collaboration in instructional teams and student achievement. American Educational Research Journal, 52, 475–514. doi:10.3102/0002831215585562

Saltan, F. & Arslan, Ö. E. (2017). The use of augmented reality in formal education: A scoping review. EURASIA Journal of Mathematics Science and Technology Education 13(2), 503–520. https://doi.org/10.12973/eurasia.2017.00628a

Saputri, A. C., Sajidan, Rinanto, Y., Afandi, & Prasetyanti, N. M. (2019). Improving students’ critical thinking skills in cell-metabolism learning using Stimulating Higher Order Thinking Skills model. International Journal of Instruction, 12(1), 327–342. https://doi.org/10.29333/iji.2019.12122a

Sarkar, S., Mohapatra, S., & Sundarakrishnan, J. (2017). Assessing impact of technology based digital equalizer programme on improving student learning outcomes. Education and Information Technologies, 22(1), 195–213. https://doi.org/10.1007/s10639-015-9434-0

Scharber, C., Peterson, L., Baskin, K., Cabeen, J., Gustafson, D., & Alberts, J. (2021). A research-practice Partnership about K12 technology integration: Technology as a catalyst for teacher learning through failure and creative risk-taking. TechTrends, 65(4), 626–635. https://doi.org/10.1007/s11528-021-00621-9

Schwarz, B., & Caduri, G. (2016). Novelties in the use of social networks by leading teachers in their classes. Computers & Education, 102, 35–51. https://doi.org/10.1016/j.compedu.2016.07.002

Seehorn, D., & Carey, S. (2011). CSTA K–12 computer science standards: Revised 2011. Association for Computing Machinery. https://doi.org/10.1145/2593249
Song, Y., & Wen, Y. (2018). Integrating various apps on BYOD (bring your own device) into seamless inquiry-based learning to enhance primary students’ science learning. Journal of Science Education and Technology, 27(2), 165–176. https://doi.org/10.1007/s10956-017-9715-z
Spiteri, M., & Chang Rundgren, S-N. (2020). Literature review on the factors affecting primary teachers’ use of digital technology. Tech Know Learn 25, 115–128. https://doi.org/10.1007/s10758-018-9376-x

Stein, K. C., Macaluso, M., & Stanulis, R. N. (2016). The interplay between principal leadership and teacher leader efficacy. Journal Of School Leadership, 26(6), 1002-1032 https://doi.org/10.1177/105268461602600605

Stemler, S. (2001). An overview of content analysis. Practical Assessment, Research & Evaluation, 7, 137-146. https://scholarworks.umass.edu/pare/vol7/iss1/17

Stojanović, D., Bogdanović, Z., Petrović, L., Mitrović, S., & Labus, A. (2020). Empowering learning process in secondary education using pervasive technologies. Interactive Learning Environments. https://doi.org/10.1080/10494820.2020.1806886
Sung, H. Y., Hwang, G. J., & Chang, H. S. (2015). An integrated contextual and web-based issue quest approach to improving students’ learning achievements, attitudes and critical thinking. Educational Technology and Society, 18(4), 299–311.
Sung, H. Y., Hwang, G. J., & Yen, Y. F. (2015). Development of a contextual decision-making game for improving students’ learning performance in a health education course. Computers and Education, 82, 179–190. https://doi.org/10.1016/j.compedu.2014.11.012.

Tapingkae, P., Panjaburee, P., Hwang, G. J., & Srisawasdi, N. (2020). Effects of a formative assessment-based contextual gaming approach on students’ digital citizenship behaviours, learning motivations, and perceptions. Computers and Education, 159, 103998. https://doi.org/10.1016/j.compedu.2020.103998

Tondeur. J., Van Braak, G., Voogt, J., Fisser, P., & Otten-Leftwich, A. (2012). Preparing preservice teachers to integrate technology in education: A synthesis of qualitative evidence. Computers & Education 59(1), 212–23.

Uerz, D., Volman, M., & Kral, M. (2018). Teacher educators’ competencies in fostering student teachers’ proficiency in teaching and learning with technology: an overview of relevant research literature. Teaching and Teacher Education 70, 12–23.

UNESCO. (2018). UNESCO ICT Competency Framework for Teachers, Version 3, UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000265721.

Vangrieken, K., Meredith, C., Packer, T., & Kyndt, E. (2017). Teacher communities as a context for professional development: A systematic review. Teaching and Teacher Education, 61, 47–59. https://doi.org/10.1016/j.tate.2016.10.001

Xie, H., Chu, H. C., Hwang, G. J., & Wang, C. C. (2019). Trends and development in technology-enhanced adaptive/personalized learning: A systematic review of journal publications from 2007 to 2017. Computers and Education, 140, 103599. https://doi.org/10.1016/j.compedu.2019.103599

Xie, K., Vongkulluksn, V., Justice, L. M., & Logan, J. (2019). Technology acceptance in context: Preschool teachers’ integration of a technology-based early language and literacy curriculum. Journal of Early Childhood Teacher Education, 40(3), 275–295. https://doi.org/10.1080/10901027.2019.1572678

Yilmaz, M.R. Augmented reality trends in education between 2016 and 2017 years. State of the art virtual reality and augmented reality know how. IntechOpen. https://doi.org/10.5772/intechopen.74943