Teacher Learning Assessment: Development of Digital Age Teaching Scale (DATS)
Listen and learn : Research paper
Monday, June 24, 2:30–3:30 pm
Presentation 2 of 4
Measure the Capacity of Using Technology to Support Student-Centered Learning: TIP
Exemplary Special Education Technology Integrators: Personal, Cultural and Institutional Stories and Experiences
Personalize Learning @ Scale Framework and Assessment: Phase 1 Validity Report
Dr. Indrit Vucaj
Digital Age Teaching Scale (DATS) is a summative assessment tool developed methodologically by iterative processes of data collection and analysis. DATS examines technological teaching capacities of ISTE Standards for Educators. Higher education faculty, K-12 teachers and administrators assess teacher's instructional effectiveness and professional practice alignment with the ISTE Standards for Educators.
|Audience:||Coaches, Teachers, Teacher education/higher ed faculty|
|Attendee devices:||Devices useful|
|Attendee device specification:||Smartphone: Windows, Android, iOS
Laptop: Chromebook, Mac, PC
Tablet: Android, iOS, Windows
|Participant accounts, software and other materials:||No specific materials needed.|
|Focus:||Digital age teaching & learning|
|Subject area:||STEM/STEAM, Inservice teacher education|
|ISTE Standards:||For Administrators:
Digital Age Learning Culture
Professional Development and Program Evaluation
This research follows a theoretical framework built upon ISTE student standards.
This quantitative research methodology followed in the development of this assessment tool is rigorous in nature and follows an iterative cycle of data collection and analysis processes.
Specifically, the author follows Guidelines in Scale Development as evidenced by Robert DeVellis. The following steps are followed:
1. Determine clearly what is being measured -- ISTE educator standards is determined and the theoretical perspective fueling the measurement scale and clarification of what is to be included.
2. Generation of an item pool to be reviewed -- author generated questions stemming and informed by ISTE educator standards and educators reviewed the item pool on voluntary basis and professional capacities.
3. Determining the format of measurement -- Likert Scale
4. Initial pool of items is reviewed -- educators are asked to participate in the pool of items for review as part of curriculum embedded and ensure participation.
5. Include validation items -- social desirability items are include for validity reasons
6. Administer items to a development sample
7. Evaluate the items -- items are evaluated and further a series of item-scale correlations, reverse scoring, item variance, and item means
8. Optimization of scale length -- to ensure the survey is optimized for through completion
A convenience sample of 10 educators was selected for a a review of items and an attempted sample of 400 educators was selected to review items for development sample. Finally the scale was administered to a larger sample to provide final results.
This research is on Step 6, and the successful completion is estimated to be completed by late October or early November. The instrument is expected to produce a Likert Scale item instrument containing about 30 questions each relevant to measure ISTE educator standards.
The study is expected to contribute to educational field by providing a summative assessment tool to educators, administrators and technology coaches examine the alignment extent of ISTE educator standards with current professional teaching capacities of material and instructional strategy. The tool will be particularly useful to educators and educational administrators that will provide them with a measurement scale that show the professional learning capacity of ISTE educator standards and measure the digital age learning culture of technology in school. As it pertains to scientific importance, faculty in higher education may uses it as means to assess pre-service teacher skills in determining the extent of equipped skills preservice teacher possess when join the profession.
A complete write-up is not available at this point as this is a hands-on scale development in the process. However, there are two works that are guiding the development process of the instrument.
1. Scale Development: Theory and Applications by Robert F. DeVellis, SAGE Publications
2. ISTE Student Standards by editorial staff of ISTE