Research Project
Origami Sensi: Mixed Reality Ai-Assitant for Cretaive Tasks
Keywords
Ai-Assistant, Mixed-Reality
Publication
Work in progress
Team
Thesis by Qiyu Chen and Richa Mishra with Lia Purnamasari advised by Kris Kitani and Dina El-Zanfaly
Description
Learning creative tasks that involve using hands and the body, like knitting and music playing, can be challenging for beginners. We introduce Origami Sensei, a mixed-reality system that assists beginners in creating origami by providing step-by-step instructions in real-time. Origami Sensei enables users to create their own origami pieces from a library of pre-existing designs. It uses computer vision algorithms to identify the user’s current origami step. It then provides them with real-time visual projections and verbal feedback to assist them in completing the next steps. The current setup consists of a tablet, a reflective mirror and a small projector. This research approach opens possibilities for introducing mixed-reality systems for learning hands-on skills in other fields such as welding,
Other Projects
CUIs for Creative CollaborationProject type
Origami SensiProject type
Sand PlaygroundHuman-AI collaboration for creative practices on sand
Mixed reality In-situ WeldingProject type
Sandscape→SoundscapeProject type
Penumbra of PrivacyProject type
Memory PortalExperiment and Observation on Augmented Spatial Experiences
Remote EncounterMediating ambient presence for remote social groups
Here/ThereExperiments in telepresence and remote experiences co-creation
Intelligence in EnvironmentsAn investigation about presence, temporality, and memory
Memory MatrixProject type
I3 Imitation, Iteration, ImprovisationEmbodied Interactions
From Nature to FabricationThe simple logic of nature creates complex forms
Contact
Lab Director:
Dina El-Zanfaly
delzanfa@andrew.cmu.edu
School of Design, MM207
Carnegie Mellon University
Pittsburgh, PA 15213
USA