Smart Library.
Voice recognition, AccessibilitySpeech-to-Text: Automatic Speech Recognition app to help students easily find what they need.
Client, Year
Personal/ Google Android Pixel 3, 2023
Role
UX Research/UI Design, Mobile app development
Duration
7 Weeks (March- May)
Skills
UX Design, Visual Design, Coding
Tool
Figma, Javascript
Team
Joann Myung, Sophie Lee
Personal/ Google Android Pixel 3, 2023
Role
UX Research/UI Design, Mobile app development
Duration
7 Weeks (March- May)
Skills
UX Design, Visual Design, Coding
Tool
Figma, Javascript
Team
Joann Myung, Sophie Lee
Background Challenge
Designing the JavaScript code to convert audio into written text presented the most significant challenge in envisioning the future of the NYU library. This task required me to immerse myself in an unfamiliar environment, step outside my comfort zone, and explore innovative prototyping methods. These adaptations were necessary to ensure the successful execution of voice commands from the web and their seamless transfer to mobile Android device.
How can I enhance the quality of my daily life at school to align with the overall quality of my daily life by utilizing a library app? Bridging the gap between students' daily experiences and library resources.
Designing the JavaScript code to convert audio into written text presented the most significant challenge in envisioning the future of the NYU library. This task required me to immerse myself in an unfamiliar environment, step outside my comfort zone, and explore innovative prototyping methods. These adaptations were necessary to ensure the successful execution of voice commands from the web and their seamless transfer to mobile Android device.
PROBLEM
The current library booking system requires too many steps.
How might I simplify and invent user experience?
How might I simplify and invent user experience?
RESEARCH
(COMING SOON)
INTERVIEW FINDINGS
INSIGHT
Students are looking for a simpler and more user-
friendly library app that includes only the “essential features.”
WHY
We aimed to create a playful experience while ensuring quick access to information. Users can simply speak, and the app will promptly recognize and direct them to the appropriate location.
GOLDEN PATH
JOURNEY MAP
SOLUTION
Voice Trigger Library App
Provide a fast & precise conversion of audio into written text, while also displaying the information to students who face difficulties in using a touch screen.(e.g. due to paralysis, tremor, or temporary injury) use their Android device by voice.
Voice Access provides commands for:
Provide a fast & precise conversion of audio into written text, while also displaying the information to students who face difficulties in using a touch screen.(e.g. due to paralysis, tremor, or temporary injury) use their Android device by voice.
Voice Access provides commands for:
- Navigation (e.g. "I want to book a study room")
- Controlling the current screen (e.g. "tap next", "scroll down")
WEB ARCHITECTURE
reduced 8 steps ︎︎︎ 4 steps
reduced 8 steps ︎︎︎ 4 steps
︎︎︎
EARLY DESIGN & ITERATION
LO-FI WIREFRAME
FUNCTIONALITY TEST
FINAL PROTOTYPE
VOICE TRIGGER focused
AS A USER
- Voice control for your device.
- Navigate your device using sentences.
- Dictation capabilities
- Voice Access assists individuals facing challenges in touchscreen manipulation (e.g., due to paralysis, tremors, or temporary injuries) in using their Android device through voice commands.