< BackHome/news/rosetta-stone-object-recognition

Name Games

Learning vocabulary in another language is easy when there’s a native speaker in the room who can tell us the word for anything we point to, but that’s not always practical. Now, language-learning developer Rosetta Stone is using augmented reality, machine learning, and object recognition to provide the same thing via its smartphone app. Users can simply point their phone cameras at any object, and the app will provide the word for it in English, French, German, Italian, or Spanish, depending on which language a user is learning. The feature is also being implemented into scavenger hunt games in which users must  engage in conversations that utilize the words for the just-identified objects. While some smartphone apps for travelers such as Samsung’s Bixby Vision and  iTranslate have already ventured into object recognition, this is the first time the technology been implemented in such an integrated and immersive manner for language learning.
View Full Article >

sign up for our newsletter