Play Your Story App - Case Study
Concept
Children have it hard when it comes to focus on listening stories since they are energetic and have focusing problems. So I wanted to create an app that helps children to focus for longer time and improve their problem solving skills at the same time.
Team: I have worked with seven AI Engineer fellows.
Team: I have worked with seven AI Engineer fellows.
Technology
Artificial Intelligence (AI / AR)
Object Detection - Tracking (Detecting and tracking the hand)
Joint Detection (Controlling the virtual puppet which is located on the hand)
Pose Estimation
Segmentation (Human segmentation and background changing)
Object Detection - Tracking (Detecting and tracking the hand)
Joint Detection (Controlling the virtual puppet which is located on the hand)
Pose Estimation
Segmentation (Human segmentation and background changing)
Persona
Insights form Researchs
- Children need to use their imagination to improve her/his social and emotional development.
- Children enjoy having a role when playing the game.
- Children get bored quickly when there is less interaction with the game
- Children tend to give up easily when they don't have a role in a game.
- Children enjoy having a role when playing the game.
- Children get bored quickly when there is less interaction with the game
- Children tend to give up easily when they don't have a role in a game.
Empathy Map
Problem Statement
We believe children need more fun while solving problems, listening stories and express their imagination, and by creating a 'Play Your Story App' that helps them improve their problem solving development, this may help them become more engaged, have more focus, and improve their cognitive skills as they get older.
Affinity Diagram
User Scenario
Mark is picked up by his mom from his school. But his mom needs to return to her office to finish her work for the day. So they drive back to the office and Mark needed to wait for his mom. His mom has a parrot in her room. Mark played with him, Mark played with some games on his mom's phone. After a while his mom wanted from him to read a book since he played with games a lot. Mark didn't have a book with him. His mom asked if he can listen stories on mobile apps. But it was boring for Mark to listen a story on phone, he had concentration problem. His mom searched on her phone to find a storytelling app that Mark can have fun at the same time. She searched for Storytelling Apps on Google Play and have found a 'Play your Story App'. That was exciting! Because Mark was able to interact with the story, sometimes he may have some missions during the story. They downloaded the App, Mark started watching the 'How to play' video. He has chosen the 'Spiderman' character and the 'City' theme. He started listening the story about the character and the place that he has chosen. During the story randomly a mission tells Mark to solve a problem or to do something to continue the story. When he has missions he was completing it by controlling the character with his hand. He was happy to have a role in a story app and dive in more to the story by interacting physically. His mom was happy because her son was more focused and interacted with a story.
Story Board
User Flow
Paper Prototype
User Test
- CTA buttons changed to be consistent.
- Display changed to landscape position.
- Added 'How To Play' as a video instead of instructions.
- Play button enlarged.
- 'Character' and 'Place' cards are simplified.
- Carousel have been added to selection parts.
- Display changed to landscape position.
- Added 'How To Play' as a video instead of instructions.
- Play button enlarged.
- 'Character' and 'Place' cards are simplified.
- Carousel have been added to selection parts.
Digital Prototype
Benefits
- Improves Listening Skills
- Encourages Creativity And Imagination Power
- A Great Tool For Sharpening Memory
- Broadens Horizon
- Helps to improve cognitive skills
- Helps to improve focusing
- Improves problem solving skills
- Encourages Creativity And Imagination Power
- A Great Tool For Sharpening Memory
- Broadens Horizon
- Helps to improve cognitive skills
- Helps to improve focusing
- Improves problem solving skills
Future Iterations & Challenges
- Adding 'Face Pose' for more interaction.
- Should improve 3D pose estimation
- Keep searching for technology capabilities.
- Adding more characters and themes.
- Adding more themes for more stories.
- Enlarging the type of problems/questions.
- Learn more about children behaviour.
- Should improve 3D pose estimation
- Keep searching for technology capabilities.
- Adding more characters and themes.
- Adding more themes for more stories.
- Enlarging the type of problems/questions.
- Learn more about children behaviour.
How it Works
Play your story app is designed to improve children's listening and problem solving skills while they enjoy.
User selects a character and a theme for the story. The story starts to play as a video. While user is watching the story, video stops and the front camera becomes active. User sees him/her self on the screen with the background mixture of real environment and the scene from the story background and some virtual objects at different depths to make user feel like they are in the story. And story asks a question to user. To continue to the story user should solve some problems. But how user will select the answer for the question? User raises his/her one hand next to his/her head and hand becomes the character from the story... User moves the character to the answer and selects by making fist. If the answer is correct story continues, if the answer is wrong user should answer the question again.
This keeps going to end of the story...
User selects a character and a theme for the story. The story starts to play as a video. While user is watching the story, video stops and the front camera becomes active. User sees him/her self on the screen with the background mixture of real environment and the scene from the story background and some virtual objects at different depths to make user feel like they are in the story. And story asks a question to user. To continue to the story user should solve some problems. But how user will select the answer for the question? User raises his/her one hand next to his/her head and hand becomes the character from the story... User moves the character to the answer and selects by making fist. If the answer is correct story continues, if the answer is wrong user should answer the question again.
This keeps going to end of the story...
©2022 BUSRA KIRALP