Wireless Connected Devices (D2)

We present a multimodal science simulation, including visual and auditory (descriptions, sound effects, and sonifications) display. The design of each modality is described, as well as evaluation with learners with and without visual impairments. We conclude with challenges and opportunities at the intersection of multiple modalities.

In this study, we explore how enhancing interactive science simulations with sonifications can scaffold interaction and learning for students with intellectual and developmental disabilities (I/DD). We added auditory cues to three PhET Interactive Simulations as additional feedback to highlight important concepts and relationships. Working with seventeen students who have I/DD, we evaluated the success of these cues in emphasizing science concepts, explored

For persons with visual impairment, forming cognitive maps of unfamiliar interior spaces can be challenging. Various technical developments have converged to make it feasible, without specialized equipment, to repre- sent a variety of useful landmark objects via spatial audio, rather than solely dispensing route information. Although such systems could be key to facilitating cognitive map formation, high-density auditory environments must be crafted carefully

We present a multimodal physics simulation, including visual and auditory (description, sound effects, and sonification) modalities to support the diverse needs of learners. We describe design challenges and solutions, and findings from final simulation evaluations with learners with and without visual impairments. We also share insights from completing research with members of diverse learner groups (N = 52). This work presents approaches for designing and