TESTING prototype AI storytelling tool at ECRC

During a recent collaboration at the NSF Annual Site Visit for AI4ExceptionalED, Dr. Wang spearheaded an innovative explorative pilot study, enlisting the expertise of Dr. Yun Huang and her student Qingxiao Zheng from Illinois University, along with Dr. Abbie L Olszewski, at the Early Childhood Research Center (ECRC).

Our journey began with securing consent from the parents of our young participants from the PreK classroom. We then invited the individual child to the gross motor room, where we encouraged them to share stories about their favorite things. Capturing their narratives through audio recordings and taking a frontal photo, we set the stage for our AI’s magic.

Qingxiao then wielded our prototype AI storytelling tool to create vibrant cartoon avatars for each child based on their preferences. These avatars came to life in videos, mimicking the children’s stories with uncanny similarity.

The children’s reactions were nothing short of magical. Delighted by the sight of their animated selves narrating their own tales, they expressed eagerness to share this innovative creation with friends and family.

This pilot study marks an exciting phase in our project, funded by the NSF AI Institute for Exceptional Education. Our goal is to develop a tool that not only entertains but serves a greater purpose: assisting children with speech and language challenges by transforming their storytelling into flawlessly narrated cartoon narratives. This approach not only captivates but also models storytelling more effectively.

As we refine our tool, feedback from typically developing children is invaluable, providing insight into how young audiences engage with and react to seeing themselves represented in cartoon form. This venture is not just about harnessing technology but about touching lives, one story at a time.