University of Auckland researchers develop world-first robotic Māori sign language interpreters

A groundbreaking collaboration at the University of Auckland has resulted in the development of robotic sign language interpreters specifically designed for Turi Māori—Māori who are deaf. The project, which has been in development for over five years, aims to provide culturally grounded communication tools that reflect a Māori worldview. Project lead Dr Tauwehe Tamati told RNZ’s Morning Report that the initiative was born from a desire to connect high-level engineering with the needs of the most vulnerable members of the community. Dr Tamati, who is bilingual in Te Reo Māori and English, was inspired by her late father, who became profoundly deaf in his later years. She noted that while her father was deeply connected to his identity at the pā, he eventually withdrew due to communication barriers. "I’ll do this for dad," she said of her motivation to join the project. The development process involved filming and photographing Māori sign-language models to ensure the robots could capture essential nuances, including specific mannerisms and lip movements. Dr Tauwehe Tamati and Dr Ho Seok Ahn worked alongside experts in robotics and mechatronics, ensuring the technology was developed in close partnership with Turi Māori, whānau, iwi, and hapū. Technologically, the robots utilize an advanced AI system known as a weighted multimodal network to interpret signs accurately. The University has confirmed that the robots are now fully built and functioning within their research lab, with models created in both adult and child sizes. The initiative received significant backing in 2024 through the Vision Mātauranga Fund and the Endeavour Fund, following its start as part of the Science for Technological Innovation National Science Challenge. Dr Tamati indicated the project has reached a level of success that has local hapū excited and participating in the ongoing work.