Multi_Model_Alphabet

An AR based app that focuses on augmenting Multiple 3D models of objects starting with the concerned letter for example: A for Airplane, subsequently a 3D model of Airplane displays on the screen.

Alphabet multimodal app is an augmented reality app for children aged 3 to 6.

Each alphabet is represented by four CAD models in this app.

This app was created to introduce into the classroom vocabulary related to everyday objects that are not typically covered in a single alphabet model chart.

This app aims to broaden children's vocabulary and assist them in understanding the sounds of each alphabet. Because each alphabet has words that begin with the same sound, it aids the child in decoding the pattern and discovering the relationship between written letters (graphemes) and the sounds they represent (phonemes).

Steps to start the application:

Menu Page — Menu page with an option to scan charts and cube markers.

Clicking on the ‘CARD & CUBE’ and ‘CHART’ button loads the next page where the camera is launched to scan for markers.

Features

There are three basic features implemented on the 3D models - phonic Sound, scaling, and rotation of the 3D models using touch gestures.

Scanning another marker.	Rotating the 3D model using touch gestures.

Use in classroom (Activity & Outcome)

Recognize initial letters with similar sounds.
Recognize the phonic sound of each alphabet.
Sort words based on their initial sounds.
Can combine sounds to produce new words.
Begins to connect a letter to a sound, for example, writes M to represent Monkey.
Recognises and identifies a few letters by name, for example, points to letter B in a book and says that’s the same as my name.
Recognize some words that are frequently encountered in the environment.
Can name objects in their surroundings.
Understand that words are made up of letters and every word has a first and last letter.
Texts have features like pictures, print size, color, font, or bolding that help to clarify messages.
Recognize environmental print automatically.
There is a relationship between written letters (graphemes) and the sounds they represent (phonemes).

Demo Video Link

Watch the demo video

Testing

We worked with students and teachers of CSC Bal Vidyalaya to test the prototype apps and collected feedback to improve the prototypes.