Research Project

Reshaping Craft Learning: Insights from Designing an AI-Augmented MR System for Wheel-Throwing

680a4d77efdd275ade771f1b_Technical Detail@4x-p-2000

Keywords

Mixed Reality, Interactive AI, Embodied Learning, Craft Learning, Personalized Learning, Instructional Design

Publications

JI, H., Hu, P, El-Zanfaly, D.(2025). Reshaping Craft Learning: Insights from Designing an
AI-Augmented MR System for Wheel-Throwing. In Designing Interactive Systems (DIS ’25). (In Press)

Team

Hongfei Ji, Peiyu (Steve) Hu, and Dina El-Zanfaly

Description

The growth of media technologies and maker culture has reshaped craft learning from instructor-guided models to diverse self-directed approaches. However, mastering crafts such as ceramics remains challenging due to their embodied nature, including materials, tools, physical action, and difficulties in tacit knowledge transfer. While Mixed Reality (MR) and Artificial Intelligence (AI) have supported embodied task learning, their application in craft remains underexplored. We present an AI-augmented MR ceramic guiding system to investigate how such technology influences embodied craft learning and transforms instructional contexts. Our system delivers immersive multimedia instruction and real-time spatial-based feedback using computer vision and large language models (LLMs) to guide learners in wheel-throwing on a pottery wheel. Through a Research-through-Design process, we co-designed and evaluated the system with twenty novices and experienced ceramic practitioners. We examine how AI-MR systems influence craft learning, user perception, and pedagogy, contribute design insights into AI-MR for craft learning, and suggest opportunities for extending such systems into creative, collaborative, and other craft-making scenarios.