Leadership Exchange
at ISTELive 22
Edtech Industry
Network Summit
Creative Constructor
Lab Virtual
Edtech Advocacy &
Policy Summit

Teacher Learning Assessment: Development of Digital Age Teaching Scale (DATS)

Listen and learn

Listen and learn : Research paper
Lecture presentation


Monday, June 24, 2:30–3:30 pm
Location: 121AB

Presentation 2 of 4
Other presentations:
Measure the Capacity of Using Technology to Support Student-Centered Learning: TIP
Exemplary Special Education Technology Integrators: Personal, Cultural and Institutional Stories and Experiences
Personalize Learning @ Scale Framework and Assessment: Phase 1 Validity Report

Dr. Indrit Vucaj  
Digital Age Teaching Scale (DATS) is a summative assessment tool developed methodologically by iterative processes of data collection and analysis. DATS examines technological teaching capacities of ISTE Standards for Educators. Higher education faculty, K-12 teachers and administrators assess teacher's instructional effectiveness and professional practice alignment with the ISTE Standards for Educators.

Audience: Coaches, Teachers, Teacher education/higher ed faculty
Attendee devices: Devices useful
Attendee device specification: Smartphone: Windows, Android, iOS
Laptop: Chromebook, Mac, PC
Tablet: Android, iOS, Windows
Participant accounts, software and other materials: No specific materials needed.
Focus: Digital age teaching & learning
Topic: Assessment/evaluations/standards
Grade level: PK-12
Subject area: STEM/STEAM, Inservice teacher education
ISTE Standards: For Administrators:
Digital Age Learning Culture
  • Ensure effective practice in the study of technology and its infusion across the curriculum.
For Coaches:
Professional Development and Program Evaluation
  • Evaluate results of professional learning programs to determine the effectiveness on deepening teacher content knowledge, improving teacher pedagogical skills and/or increasing student learning.
For Educators:
Analyst
  • Provide alternative ways for students to demonstrate competency and reflect on their learning using technology.

Proposal summary

Framework

This research follows a theoretical framework built upon ISTE student standards.

Methods

This quantitative research methodology followed in the development of this assessment tool is rigorous in nature and follows an iterative cycle of data collection and analysis processes.
Specifically, the author follows Guidelines in Scale Development as evidenced by Robert DeVellis. The following steps are followed:
1. Determine clearly what is being measured -- ISTE educator standards is determined and the theoretical perspective fueling the measurement scale and clarification of what is to be included.
2. Generation of an item pool to be reviewed -- author generated questions stemming and informed by ISTE educator standards and educators reviewed the item pool on voluntary basis and professional capacities.
3. Determining the format of measurement -- Likert Scale
4. Initial pool of items is reviewed -- educators are asked to participate in the pool of items for review as part of curriculum embedded and ensure participation.
5. Include validation items -- social desirability items are include for validity reasons
6. Administer items to a development sample
7. Evaluate the items -- items are evaluated and further a series of item-scale correlations, reverse scoring, item variance, and item means
8. Optimization of scale length -- to ensure the survey is optimized for through completion

A convenience sample of 10 educators was selected for a a review of items and an attempted sample of 400 educators was selected to review items for development sample. Finally the scale was administered to a larger sample to provide final results.

Results

This research is on Step 6, and the successful completion is estimated to be completed by late October or early November. The instrument is expected to produce a Likert Scale item instrument containing about 30 questions each relevant to measure ISTE educator standards.

Importance

The study is expected to contribute to educational field by providing a summative assessment tool to educators, administrators and technology coaches examine the alignment extent of ISTE educator standards with current professional teaching capacities of material and instructional strategy. The tool will be particularly useful to educators and educational administrators that will provide them with a measurement scale that show the professional learning capacity of ISTE educator standards and measure the digital age learning culture of technology in school. As it pertains to scientific importance, faculty in higher education may uses it as means to assess pre-service teacher skills in determining the extent of equipped skills preservice teacher possess when join the profession.

References

A complete write-up is not available at this point as this is a hands-on scale development in the process. However, there are two works that are guiding the development process of the instrument.

1. Scale Development: Theory and Applications by Robert F. DeVellis, SAGE Publications

2. ISTE Student Standards by editorial staff of ISTE

More [+]

Presenters

Photo
Dr. Indrit Vucaj, Oklahoma City Public Schools

People also viewed

Coaching Digital Learning for Maximum Impact
Taking Charge of Your Own Professional Development
Yoga Lunch