Smart Library
Speech-to-Text: Automatic Speech Recognition app
Client, Year
Personal,
2023
2023
Role/Skills
UX/UI Design, Research, Coding
UX/UI Design, Research, Coding
Team
Joann Myung,
Sophie Lee
Joann Myung,
Sophie Lee
Tool
Javascript
Figma,
Javascript
Figma,
Overview
Bridging the gap between students' daily experiences and library resources.
Challenge
Designing the JavaScript code to convert audio into written text was a major challenge in reimagining the NYU library's future. This required immersing myself in an unfamiliar environment, stepping outside my comfort zone, and exploring innovative prototyping methods to ensure seamless voice command execution from the web to a mobile Android device.
How might we simplify and invent user experience?
Motivation
New York University offers excellent library resources and study spaces, but many graduate students are unaware of the bookable spaces or find the current app too complicated. To address this, I aimed to create a seamless user experience that makes booking study spaces easy and efficient.
New York University offers excellent library resources and study spaces, but many graduate students are unaware of the bookable spaces or find the current app too complicated. To address this, I aimed to create a seamless user experience that makes booking study spaces easy and efficient.
🤔 Understanding the problem
Let’s understand the purpose of the current features, Chat and Booking system, in the app.
Let’s understand the purpose of the current features, Chat and Booking system, in the app.
- Chat: List all options to ask the Librarian. All details regarding booking study spaces are displayed here with a clickable link.
- Rooms & Spaces (Booking System): Find study spaces and various services available in the app.
Existing User Flow
THE PROBLEM
The library booking system has useful features but requires too many steps, making it hard for students to book quickly through the app. As a result, they often walk in without a reserved room.
The library booking system has useful features but requires too many steps, making it hard for students to book quickly through the app. As a result, they often walk in without a reserved room.
RESEARCH
My research first centered around the competition space in order to understand how other apps are addressing similar issues. More than 30 user survey responses would help quantify what students are looking for, and what they’re hoping to resolve. And lastly, one-on-one interviews would help me understand users’ journeys and specific issues the app would need to address.
INTERVIEW FINDINGS
The interviews indicate a lack of clarity and awareness regarding the library's booking system, with one participant finding it confusing and another expressing surprise at its existence.
“
I'll take a chance and go to the library to check, as the library booking system is incredibly confusing."
“ I didn't know there was a booking system for library app."
“ I didn't know there was a booking system for library app."
JOURNEY MAP
GOLDEN PATH
![]()
INSIGHT
Students are looking for a simpler and more user- friendly library app that includes only the essential features.
SOLUTION
Voice Trigger Library App
Provide a fast & precise conversion of audio into written text, while also displaying the information to students who face difficulties in using a touch screen.(e.g. due to paralysis, tremor, or temporary injury) use their Android device by voice.
Voice Access provides commands for:
Voice Trigger Library App
Provide a fast & precise conversion of audio into written text, while also displaying the information to students who face difficulties in using a touch screen.(e.g. due to paralysis, tremor, or temporary injury) use their Android device by voice.
Voice Access provides commands for:
- Navigation (e.g. "I want to book a study room")
- Controlling the current screen (e.g. "tap next", "scroll down")
EARLY DESIGN
Option A : Barcode Scan![]()
Option B : Voice Trigger
![]()
![]()
Option A : Barcode Scan
Option B : Voice Trigger
︎︎︎
LO-FI WIREFRAME![]()
BEHIND THE SCENE (Speech-to-Text-API)
![]()
![]()
AS A USER
- Voice control for your device
- Navigate your device using sentences
- Dictation capabilities
- Voice Access assists individuals facing challenges in touchscreen manipulation (e.g., due to paralysis, tremors, or temporary injuries) in using their Android device through voice commands
FINAL WIREFRAMES + DEMOS
REFLECTION
Moving forward, I am eager to continue exploring this intersection of technology & design, and I am enthusiastic about any opportunities to further refine and expand upon this project. I welcome any feedback you may have and appreciate your time in considering my journey throughout this process.