Back to works

Simplifying administrative discourse for hearing-impaired users

Korero is an AI powered communication sidekick concept aiming at bridging the communication gap between the hearing and hearing-impaired communities through innovative technology.

Two phones showing Korero in action: the app has a dark design and easily clickable cards
Client
UX Studio
Industry
Healthcare and Accessibility Services
Service
UI/UX Design
Team Setup
1 Researcher + 3 Designers
Timeline
3 months

Goal

Develop a solution to facilitate communication between individuals with varying hearing abilities, bridging the gap between the hearing and the deaf or hard of hearing with the latest tech in mind.

Challenge

Partnering with SignCoders, a group of highly skilled IT professionals coming from the deaf community, we aimed to address inclusivity by delving into the world of the hearing impaired. This involved the exploration of unfamiliar fields, showcasing what's possible starting from ground zero.

Outcome

We created a new mobile app idea called Korero, which features AI-assisted live transcription and frictionless input methods focusing on accessibility. Additionally, a dedicated website has been created to help users better understand the product.

24+
Months of collab
25+
User flows
1
Full app redesign
1 /
Discovery

How we started

We did an extensive discovery phase combining different methods., as follows to come up with a problem statement

  1. Conducted desk research about the deaf community and their struggles, including institutional, educational, and attitudinal barriers, personal struggles and needs.
  2. Held an in-person workshop with the SignCoders team, with the assistance of sign language translators to gain more insights about the actual user problems.
  3. Synthesized the outcomes and previous materials to create the problem statements that could bring us closer to the ideation part. 

  4. After shortlisting ideas we mapped out different experience flows, worked on the concepts, and defined the features of the minimum viable product.

These steps helped us lay the foundation for our project and set us on the path toward designing a successful solution.

The problems and needs identified: one, there is a greater deficiency on the side of hearing people in how to interact or assist when meeting a deaf person, and two, the critical areas of the hearing impaired were mostly connected to situations where they want to manage their everyday needs and use administrative devices
2 /
Specifying the core UX

Denoising ideation, defining the feature set

Our solutions were focusing on supporting hearing-impaired users in administrative discourses by connecting them with hearing people, making the other party also at ease without the need of sign language interpreters.

  1. The low fidelity workflow of the core features allowed us to quickly explore supplementary functions and features.
  2. Our focus was on ideation, solution and concept generation and iterative refinement of the Information Architecture.
A workflow exploration with core features, with a map that shows government offices near the user, then prompts them to plan ahead for what will happen with conversation cards. They get a customer number, and a card to show to the hearing person assigned to their case which lets them know that the user is deaf, and is using Korero to communicate.
Workflow of core features with low fidelity designs
3 /
Defining the Look&Feels

Key considerations

  1. Our design direction prioritized evoking emotions over creating a futuristic assistant.
  2. We aimed to harness the power of visual communication by utilizing soft colors, friendly shapes, and forms.
  3. Building confidence between the user and the application has to be emphasized, considering the application's real-time reliance. We prioritized the Peak-End Rule throughout our design process to ensure user trust.
UI elements of Korero: neon colours on a dark background, including live transcribe options even for ambiance
4 /
Incorporating new tech and tools
  1. We successfully integrated Spline, a 3D design software, to create engaging and interactive visuals.
  2. Spline enabled us to generate minimalistic, kinetic shapes representing communication and sound-waves without overwhelming the user.
  3. We explored data visualization techniques using p5 JavaScript. This approach aimed to enhance spatial awareness, particularly for users interacting with a small screen.
5 /
Final designs

Key features

  1. Sidekick: AI providing quick replies and reply triggers during live discussions to reduce communication friction.
  2. Intro Stack: Cards to let the user present their circumstances for the participant of the discussion and set expectations for the use of the app.
  3. Multiple Inputs: Other than the traditional keyboard, users can rely on the AI trained voice recognition or 3D skeletal sign language input enabled by the phone’s front facing depth sensor.
Screens that show that Korero can use the user's digitally recreated voice to communicate
6 /
Webflow implementation
  1. Korero also received a standalone Landing Page that we could regularly update with new improvements and features.
  2. We opted to use no-code web builder Webflow as it is flexible enough to have effortless updates, but it’s embracing confident control over consistency and interactions.
Similar success stories
Now available for hire
Let's talk
Schedule a call
Drop a message