Learning vocabulary in another language is easy when there’s a native speaker in the room who can tell us the word for anything we point to, but that’s not always practical. Now, language-learning developer Rosetta Stone is using augmented reality, machine learning, and object recognition to provide the same thing via its smartphone app. Users can simply point their phone cameras at any object, and the app will provide the word for it in English, French, German, Italian, or Spanish, depending on which language a user is learning. The feature is also being implemented into scavenger hunt games in which users must engage in conversations that utilize the words for the just-identified objects. While some smartphone apps for travelers such as Samsung’s Bixby Vision and iTranslate have already ventured into object recognition, this is the first time the technology been implemented in such an integrated and immersive manner for language learning.
sign up for our newsletter