Agent-based programming interfaces for children supporting blind children in creative computing through conversation

Abstract

Children that learn to express themselves creatively and think computationally are empowered to create rather than solely consume technology. They practice creativity and learn strategies for solving problems, designing projects, and communicating ideas. However, children with visual impairments cannot access most programming experiences designed for beginners. This deprives these children of the chance to play with expressing themselves through programs that they design and create themselves. In this paper, we introduce Codi, a software agent that children can talk to in order to create, play, modify, and explore programs built using natural language. Through the design and implementation of Codi, I explore how agent-based programming interfaces can make programming accessible to children with visual impairments and multiple disabilities. Interviews, workshops, and test sessions with visually impaired children at Perkins School for the Blind led me to draw two conclusions: (1) Agent- based programming interfaces like Codi can facilitate meaningful creative learning experiences for children who cannot see. (2) In order to support children's engagement with computational thinking concepts and practices, agent-based programming interfaces need onboarding experiences, learning resources, and facilitation that helps learners surface and pursue their own interests and integrate computational thinking concepts.