Sarah-Jane Seddon, Keely WIlson HandTalk

Finalist
Credits
  • Tauira / Students
    Sarah-Jane Seddon, Keely WIlson
  • Kaiako / Lecturers
    Jason O'Hara, Antony Nevin, Jo Bailey, Tim Turnage
Description:

Hearing loss is one of the most common physical impairments in the world. Being diagnosed with this condition can be scary and isolating. Statistics show that around “20,000 people in NZ use NZSL as a form of communication and of this, approximately 4,600 are deaf.” The needs of hard-of-hearing individuals are often overlooked. In our school years, we had limited opportunities to learn sign language, only briefly encountering it during New Zealand Sign Language (NZSL) week. We believe the lack of NZSL education in schools is a significant issue. As an official language, NZSL should be taught more extensively to foster inclusivity and positive change in New Zealand.

Our research identified students aged 9-13 as the ideal target audience, because children in this age bracket tend to absorb and retain information well. By looking through the existing NZSL learning resources, it was clear that there was a lack of visual engagement. Simply put, the resources are flat and lifeless. They do not effectively communicate emotion for such a visual language, partially when facial expression is a crucial part of signing. To overcome this we considered various tools like books and board games, but concluded that animation, being a visual and tangible medium, would be the best way to teach sign language.

Our analysis led to the development of Handtalk, an app that utilises gamification as a fun and engaging way of learning NZSL. The design features a vibrant brand identity through the use of cartoon illustrations and school stationery items. It includes lively cartoon characters with exaggerated facial features, to highlight the importance of expression in sign language learning.

With Handtalk, learning sign language is accessible through an online dictionary, covering numbers, the alphabet, greetings, everyday sayings, and more. Students can then learn the course by engaging with animation through multi-choice missions, and competing with their classmates to rise through the ranks; this can be seen through the missions map. This fosters a competitive dynamic and enjoyable learning experience. Furthermore, children can have their own personalised experience by customising their avatar.

By integrating our design with modern technology like phones, students can use camera functions to practise signing within designated lines, ensuring their hand gestures are correctly positioned. Additionally, the app tracks their progress by allowing students to view replays and advance through different levels, earning mission stamps upon completion.
Handtalk is suitable for classrooms, and ensures inclusion for children who may feel isolated or misunderstood. Learning NZSL through this resource equips students with the knowledge to engage with the deaf community, raising awareness and fostering inclusivity through friendly competition. Additionally, family and friends can also download the app, expanding its outreach beyond the classroom to a broader audience, ultimately creating a more inclusive environment that extends beyond the classroom setting. Handtalk can also be adapted for both desktop and iPad, enabling it to reach a wider audience. Learning NZSL just got a whole lot more fun.

Bibliography
- Sepuloni, Hon Carmel. “New Zealand Sign Language Week 2022 Recognises ‘essential’ Workers.” The Beehive, 9 May 2022, www.beehive.govt.nz/release/new-zealand-sign-language-week-2022-recognises-
%E2%80%98essential%E2%80%99-workers#:~:text=NZSL%20was%20
recognised%20as%20an,language%2C%20but%20it%20is%20endangered.