It's Not Just About the AI: How to Evaluate EdTech That Works

Outline

I. Introduction (10 minutes)

Welcome and session objectives
Why EdTech evaluation matters: Post-ESSER funding realities
The hype around AI and why it’s important to focus on essential factors like instructional value, cost, and data privacy
II. Key Evaluation Criteria for EdTech (20 minutes)

Instructional Value
How to determine if a tool enhances learning outcomes
Ensuring tools support diverse learners (e.g., students with disabilities, English learners)
Case studies/examples of high-impact vs. low-impact tools
Cost-Effectiveness
Evaluating price in relation to value
Strategies for stretching tight budgets post-ESSER
Long-term scalability and sustainability of tech investments
Data Privacy and Security
Understanding privacy and data protection policies
Key questions to ask vendors
Examples of successful privacy-conscious technology adoptions
III. Hands-On Activity: Developing an EdTech Evaluation Plan (30 minutes)

Break attendees into small groups
Provide sample EdTech resources to evaluate
Use a structured evaluation rubric (instructional value, cost, data privacy)
Groups develop a brief evaluation for each tool and share their findings
Facilitator guidance and feedback during the exercise
IV. Addressing DEI in EdTech Evaluation (15 minutes)

Ensuring equitable access to technology for all students
Evaluating tools for inclusivity and cultural responsiveness
How to select resources that meet the needs of diverse student populations
Examples of EdTech supporting DEI initiatives
V. Wrap-Up and Takeaways (15 minutes)

Key points recap: Instructional value, cost-effectiveness, data privacy, and DEI
Participants customize and finalize their EdTech evaluation plan template
Q&A session
Resources and tools for further EdTech evaluation
Closing remarks and next steps

*Time can be adjusted to meet the need of the session allotted to us

Supporting research

Learning First, Technology Second in Practice by Liz Kolb

Evaluating Cost, Privacy, and Data: Checrallah, M. , Sonnett, C. , & Desgres, J.

Designing a Technology Acquisition Process and Capturing the Value on Investment (CoSN)