The Nippon Foundation, in collaboration with Google and others, has developed a learning game that recognizes sign language movements using AI = artificial intelligence technology.
This computer game, named "Sign Language Town," was developed by the Nippon Foundation in collaboration with Kwansei Gakuin University and Google in order to broaden their understanding of sign language.
In the game where the character travels, you will be asked to answer the question in sign language, and then proceed if you can correctly express the sign language toward the camera of your computer.
According to the Nippon Foundation, sign language includes not only hand movements, but also facial expressions and gestures using the upper body, and these movements can be recognized by a general computer camera, as well as images. By collecting data and letting AI learn it, it is possible to determine whether it can be expressed correctly.
The beta version of this game is available for free on the Nippon Foundation's homepage, and currently 36 Japanese sign languages can be recognized, but we will increase it in the future.
Mr. Ikumi Kawamata of The Nippon Foundation, who was in charge of development, said, "I think that learning sign language has been a situation where you just watch the video of sign language and try to imitate it, but in this game, you will express the sign language yourself You can enjoy the joy of being able to understand and be recognized. "