MORE EVENTS
Leadership
Exchange
Solutions
Summit
DigCit
Connect
Change display time — Currently: Mountain Daylight Time (MDT) (Event time)

An OER Tool for Writing-to-Learn in Undergraduate STEM Courses

,
Colorado Convention Center, 108/10/12

Roundtable presentation
Listen and learn: Research paper
Save to My Favorites

Presentations with similar research topics are each assigned to round tables where hour-long discussions take place. Roundtables are intended to be more collaborative discussions about research.
This is presentation 1 of 3, scroll down to see more details.

Other presentations in this group:

Presenters

Photo
Professor
Pennsylvania State University
Greetings! I am a professor of Learning Design and Technology at Penn State, teaching courses in quantitative research, instructional design, and e-learning. My research focuses on measuring and applying knowledge structure measures to support learners and instructors. See my CV and list of publications at https://sites.psu.edu/rclariana/

Session description

This session demos the tool and then provides the 1st year data outcomes of a free open education resource (OER) called GIKS to provide STEM students with a teacher-made writing prompt that then scores the essay and displays it as a network to compare to an expert referent network.

Framework

Jonassen, Beissner, and Yacci (1993) note “The meaning for any concept or construct is implicit in the pattern of relationships to other concepts or constructs” (p.5), these patterns are the lexical–semantic organization of memory that can be shared over time and space, and that systematically change across the lifespan due to experiences (Krethlow, Fargier, & Laganaro, 2020). Relationship patterns among concepts are referred to here as knowledge structure (KS) that can be represented as network graphs of concepts, in this case, as nouns (Elman, 2004; 2009; Furtner, Rauthmann, & Sachse, 2009) that offer “a geography of the human mind” (p. 8, Gorgeakopoulos & Polis, 2018).

Nesbit and Adescope (2006) note, “Structural knowledge establishes a spatial frame that references visual features and verbal knowledge to enable efficient, spatially-indexed memory searches.” (p. 418). Extending this idea to knowledge building in STEM, Trumpower and Sarwar (2010) coined the terms “structural assessment” as measures of students’ domain-normative conceptual relationships and “structural feedback” as any form of feedback that aims to improve the quality of students’ domain-normative conceptual relationships. Research with structural feedback points to an important mediating role of network graphs as feedback for developing students’ conceptual understanding, especially feedback on the correct, incorrect, and missing connections formed by students between concepts (Kim, Clariana, & Kim, 2019; Sarwar, 2012; Sarwar & Trumpower, 2015).

This project is grounded on structural feedback, that when students receive structural feedback, the form of their conceptual model becomes more like an expert’s model. The project software uses network maps of students’ written responses as formative feedback at the individual level and at the group level. The individual network graph that immediately originates from a student’s written response is a personal representation of that student’s own conceptual understanding that may be especially potent for that student.

More [+]

Methods

Participants were recruited to participate in the two studies from an undergraduate architectural engineering course, total enrollment n = 110, and 87 volunteered to participate and received a $50 gift card for participation. In study 1, after completing the normal lessons on masonry and wood construction, half received the GIKS writing prompt and wrote a 300-word lesson summary with immediate network feedback while the other half did not write at all (control group). In study 2, after completing the normal lessons on concrete and sustainable construction, half received the GIKS writing prompt and wrote a 300-word lesson summary with immediate network feedback while the other half wrote a 300-word essay in a word processor with no feedback.

Data consisted of the already existing end-of-unit multiple-choice tests of these topics as well as a list-wise measure on concept knowledge structure that was rendered into networks using Pathfinder software. In addition, students' essays were rendered into network graphs and analyzed also suing Pathfinder software.

Data were analyzed using multivariate analysis of variance (MANOVA) as well as descriptive measures of the essays (mainly term frequencies).

More [+]

Results

For study 1, MANOVA showed that the concept knowledge structure networks (elicited as listwise measures of concrete and then of wood lesson terms) of the group receiving GIKS summary writing were significantly more like the expert network referent compared to the networks of those wo did not write at all (control).

However, this pattern was reversed for the end-of-units test (elicited as multiple-choice items), the no writing control group outperformed the GIKS writing group.

For study 2, data has been collected but is not yet analyzed. The analysis results for study 2 (masonry and sustainability) will be available by November 2023 and so will be included in the ISTE presentation in June 2024.

More [+]

Importance

It was expected that the GIKS intervention would improve students' knowledge structure (i.e., more like the expert) and then this would result in improved performance on classroom measures of declarative knowledge. Results show that knowledge structure did significantly improve with GIKS, but at the expense of declarative knowledge.

This interaction of conceptual and declarative knowledge has been reported before, and challenges and extends understanding of how knowledge exists in memory and how it influences cognition and production tasks. Because expert-liken knowledge structure is believed to support higher-order tasks, especially problem solving, this begs the question, if an instructor must prioritize one or the other, then which is more important, declarative knowledge (memorizing facts) of conceptual knowledge structure?

Further, GIKS is an open-ended tool that can be used in many ways, how can GIKS be used to meet instructor and course requirements? For example, GIKS can immediately complement and extend existing STEM writing pedagogies such as peer-writing, the immediate network feedback provided by GIKS could be used to improve the quality and timeliness of peers’ feedback since the network is an artifact that can support peer discussion, and the network graph should decrease the inclusion of common misconceptions that are more likely with peer feedback

GIKS is designed to be quick and simple to set up by a course instructor (or a course designer), it is easy to share with other instructors, and can be used in any content area, thus GIKS can be used in any STEM courses at the undergraduate and even the high school levels. This approach can add an active learner-centered approach to traditional STEM lecture classrooms that engages both the student and the instructor. In fact, GIKS has wide application in any content area, for example, since it works in any language it can be used in bilingual settings.

More [+]

References

Elman, J. L. (2004). An alternative view of the mental lexicon. TRENDS in Cognitive Sciences, 8(7), 301-306.

Elman, J. L. (2009). On the meaning of words and dinosaur bones: lexical knowledge without a lexicon. Cognitive Science, 33, 547-582.

Furtner, M. R., Rauthmann, J. F., & Sachse, P. (2009). Nomen est omen: Investigating the dominance of nouns in word comprehension with eye movement analyses. Advances in Cognitive Psychology, 5, 91-104. https://www.ncbi.nlm.nih.gov/pubmed/20523853

Georgakopoulos, T., & Polis, S. (2018). The semantic map model: State of the art and future avenues for linguistic research. Language and Linguistics Compass, 12, 1-33. https://doi.org/10.1111/lnc3.12270

Jonassen, D. H., Beissner, K., & Yacci, M. (1993). Structural knowledge: Techniques for representing, conveying, and acquiring structural knowledge. Lawrence Erlbaum Associates, Inc.

Kim, K., Clariana, R. B., & Kim, Y. (2019). Automatic representation of knowledge structure: Enhancing learning through knowledge structure reflection in an online course. Educational Technology Research and Development, 67, 105-122. http://link. springer. com/article/10. 1007/s11423-018-9626-6

Krethlow, G., Fargier, R., & Laganaro, M. (2020). Age-specific effects of lexical–semantic networks on word production. Cognitive Science, 44, e12915.

Nesbit, J. C., & Adesope, O. O. (2006). Learning with concept and knowledge maps: A meta-analysis. Review of Educational Research, 76, 413-448.

Sarwar, G. S. (2012). Comparing the effect of reflections, written exercises, and multimedia instruction to address (Unpublished doctoral dissertation). University of Ottawa, Ottawa, Canada. Retrieved from https://ruor. uottawa. ca/bitstream/10393/22865/3/Sarwar_Gul_Shahzad_2012_thesis. pdf

Sarwar, G. S., & Trumpower, D. L. (2015). Effects of conceptual, procedural, and declarative reflection on students’ structural knowledge in physics. Educational Technology Research and Development, 63, 185-201.

Trumpower, D. L., & Sarwar, G. S. (2010). Effectiveness of structural feedback provided by pathfinder networks. Journal of Educational Computing Research, 43, 7-24.

More [+]

Session specifications

Topic:
Online tools, apps & resources
Grade level:
Community college/university
Audience:
Professional developers, Teacher education/higher ed faculty, Technology coordinators/facilitators
Attendee devices:
Devices useful
Attendee device specification:
Smartphone: Android, iOS, Windows
Laptop: Mac, PC, Chromebook
Tablet: Android, iOS, Windows
Participant accounts, software and other materials:
GIKS runs in a web browser on any device, so no other software is needed.
Subject area:
STEM/STEAM
ISTE Standards:
For Educators:
Analyst
  • Provide alternative ways for students to demonstrate competency and reflect on their learning using technology.
For Students:
Empowered Learner
  • Students use technology to seek feedback that informs and improves their practice and to demonstrate their learning in a variety of ways.
Knowledge Constructor
  • Students build knowledge by actively exploring real-world issues and problems, developing ideas and theories and pursuing answers and solutions.