For over a decade, researchers at the University of Kansas have dedicated themselves to developing a groundbreaking virtual reality system designed to assist students with disabilities, particularly those on the autism spectrum, in honing essential social skills crucial for navigating a typical school day. Their efforts have culminated in the creation of a cutting-edge system that incorporates artificial intelligence components to provide students with an immersive experience, known as XR, that enhances their social interactions in a more natural setting.
The U.S. Office of Special Education Programs recently awarded a substantial five-year, $2.5 million grant to researchers at KU’s School of Education & Human Sciences to fund the development of Increasing Knowledge and Natural Opportunities With Social Emotional Competence, or iKNOW. This innovative system aims to build upon the success of the existing Virtual reality Opportunity to Integrate Social Skills (VOISS) by incorporating advanced AI features to further enrich the learning experience for students and educators alike.
Revolutionizing Social Skills Education Through AI Integration
VOISS, the foundation of the iKNOW system, has been proven effective in aiding students with disabilities in improving their social skills through 140 unique learning scenarios set in virtual school environments. These scenarios, covering 183 social skills, are accessible across various platforms like iPads, Chromebooks, and Oculus VR headsets, enabling students to practice and refine their social interactions in a range of settings beyond the confines of a traditional classroom.
With the integration of AI technology, iKNOW will revolutionize the learning experience by allowing for user-initiated spoken responses that are transcribed in real-time. Avatars within the system will provide appropriate reactions and behaviors, modeling desired practices for students and fostering more natural interactions, akin to real-life conversations. This advancement not only enhances the authenticity of the learning process but also instills a deeper understanding of why certain responses are preferred in different social situations.
The system’s AI capabilities extend beyond speech recognition to include audio analysis, integration of real-time images and graphics, and personalized feedback on user progress. By leveraging technology to create a dynamic and responsive learning environment, iKNOW equips students with the tools they need to navigate social interactions confidently and effectively.
Empowering Students Through Personalized Learning Experiences
One of the key features of iKNOW is the utilization of real middle school students, educators, and administrators to provide avatar voices within the system. This approach enhances the authenticity of the learning environment, allowing students to practice social skills without the pressure or judgment often present in supervised sessions with peers. By immersing students in a supportive and interactive digital space, iKNOW empowers them to build confidence and proficiency in their social interactions before transitioning these skills to real-world scenarios.
Maggie Mosher, an assistant research professor involved in the project, emphasizes the importance of providing students with diverse learning opportunities in multiple environments. By combining research-based virtual reality technology with the flexibility of AI, iKNOW aims to engage students in personalized learning experiences that foster the development of essential social-emotional skills necessary for success in both academic and real-world settings.
As the research team prepares to showcase their groundbreaking work at the annual I/ITSEC conference, they invite educators, families, and students to explore the iKNOW system and discover the transformative potential of AI-enhanced social skills education. Through ongoing collaboration and innovation, iKNOW is poised to revolutionize the way students with disabilities acquire and apply critical social-emotional competencies, paving the way for improved learning outcomes and enhanced social integration.
By combining cutting-edge technology with a deep commitment to empowering students with disabilities, the iKNOW system represents a significant step forward in the field of social skills education. Through personalized learning experiences, real-time feedback, and immersive virtual environments, iKNOW is poised to revolutionize the way students with disabilities approach social interactions and enhance their overall learning outcomes.
