Lingo — Language learning through conversation

Conversational Application



Mobile interface course

My role in the project: research, concept, (rapid)prototyping, CUI & micro-interaction

5 weeks mobile interface course, BA Interaction Design at ZHDK in 2016

Lingo is an addition to the Duolingo learn process and makes language learning even more fun. Lingo is like a friend (a virtual friend tho') that is interested in you. With Lingo you can talk about the topics that interest you the most right now.

Lingo can jumps into different roles of conversational partners – fruit seller, business partner, art museum guide, travel guide or even a potential date.

Conceptvideo

Conversation, Conversation, Conversation

Conversational User Interfaces (CUI) had a huge impact in the UX fields in 2016. During a mobile interface course, we had the task to build a meaningful conversational service with a focus on atomic applications and micro-interactions.

We live in a globalized and connected world. Languages get more and more important to communicate in intercultural affairs. That's why languages should be more efficient, exciting and accessible to everyone.

Enhance the language learning process in Duolingo

Lingo is an addition to the learning process of Duolingo, a free language learning app with over 150 Million learners worldwide. It completes its learning process with the possibility to use and deepen your learnings in a real life-like conversation.

„We created Duolingo so that everyone could have a chance. Free language education – no hidden fees, no premium content, just free.“
Quote from Luis von Ahn, Founder of Duolingo

What Duolingo was missing till recently (Duolingo introduced its own language bots last September) was a way to use and deepen the new knowledge gathered through the playful exercises in a real conversation.

My intention was to build up on what Duolingo is already doing great and close the gap with a meaningful conversational buddy.

Meet Lingo

With Lingo you can learn new languages and talk about the topics that interest you the most right now. Lingo adapts on your language level and is more a foreign friend or companion than a teacher. Lingo supports the conversation whenever it gets stuck, helps with unfamiliar words and how to structure sentences even better. Furthermore Lingo expands your vocabulary and connects location-independent learners with the same interest. Lingo encourages cultural exchange and learning languages over conversation.

First contact with Lingo.
Lingo is an addition the the already existing Duolingo language learning process

I wanted to focus fully on the conversational part of designing a conversational application and therefore decided to build up on the existing UI & UX of Duolingo.

A conversation with Lingo

A conversation with Lingo can be very individual and should always adapt on the language level of the user, help whenever help is needed & furthermore curate exercises that excite the user. All in all the conversation with lingo can be divided into four parts.










Context

You’re new here, right?

The first contact with lingo the user gets picked up on its language level, introduced to all some important functions and expalined how this conversation with Lingo can help in learning languages better.

How are you today?

Smalltalk is an important part in learning new languages as someone who learns a new language also wants to use it in a real environment. This part of the conversation with Lingo contains conversation flows like «How are you?», «Where are you from?» but also places and situation specific information as «The weather in Zurich is beautiful today, we should go have a swim in the lake!».

Context
Context

I’m hungry, let’s go eat a pizza!

Lingo can also jump into the role of other people. The vocabulary can be tested and deepened with role plays, in which real situation and user-interested new words and sentences can be learned too.

But contextualised learning can also be talking about a new tv-serie, that the user is interested at the moment.

This part of the conversation should fully focus on the needs of the user and give the user a starting point for a conversation about such topics in real life.

Good Job!

Last but not least, the user should be rewarded during the conversation and get tips how and where to improve.

After the last part of the conversation with Lingo, the user should know about the existing weak spots and how to improve this knowledge gaps with personalized exercises.

Context

Micro Interactions in Lingo

I adapted the micro interactions and features of the Duolingo excersices to a conversation. I also added some new features, that could help the user in a ongoing conversation.






Do you mean

...Do you mean?

Especially at the beginning its normal that mistakes happen. Lingo points subtil on such, withouth interupting or auto correct the user while typing/speaking. Lingo gives hints, similar to word-programms, which furthermore need to be completed actively by the user itself.

How do you say this again?

The user can always ask Lingo for unkown words and sentences in it's mother tongue. Lingo chimes in a passive way into the dialogue and completes the user with the missing words.

Tinycards
How do you say this

More natural language

On a more advanced level, Lingo also shows the user how this sentence would be formulated by native speakers. Lingo understands the user and helps it phrase things even better with pointing the user to how this word or sentence could be formulated in a more natural way, similar to a real conversation. The user can furthermore memorize this more natural structure while saving it as a tinycard.

Hints for an on going dialouge

Sometimes the dialogue can get stuck, because the user does not know what to answer or how to continue.

Short and precise hints during the conversation should help the user in an on going dialogue and keep the conversation strucutred. Those hints can also encourage the user to try out new things.

Hints
How do you say this

Reflect on your new learnings

During the conversation the user has access to an overview of all misspellings and tips to reflect on the new learnings. All complements are set behind the chat bubbles.

The user gets aware of all mistakes that happended during the conversation and save all words and sentences as Tinycards for further learnings.

Integration of Tinycards

With the help of Tinycards (another already existing app from Duolingo) words and sentences from the conversation with Lingo can be saved as flash cards.

Integration of Tinycards
With the integration of Tinycards, the user can save important words and sentences directly in the conversation

Right now, Tinycards is a separate app from Duolingo and therefore is not really an active part within Duolingo and therein I see a weakness in the language learning process of Duolingo. With an active integration of Tinycards, users could easily save interesting sentences and words, which furthermore could be categorized and made accesible for other users.

Help where help is needed

There are situations in a dialogue, that can overstrain the knowledge of the user. However this should never have a negative impact on learning a new language but rather encourage the user.

Already familiar functions
Already familiar functions won't distract and help the user in a ongoing conversation

Lingo could help with possible answers, methods that the user is already familiar from the Duolingo exercises or tips how to change the ongoing dialogue to its desire.

Now we are talking, right?

Having a conversation in another language shouldn't be comlicated. An important part in conversational design is the language. How can I formualte something as a designer, so the user unterstands it at first attempt and can answer simulatously? Especially in learning a new language this is an important part to consider when designing a conversational application.

Short, precise and context relevant

In a Whatsapp-conversation with someone who just started learning German and a first preprestructured dialogue of Lingo, I wanted to test what sentence work and what formulations may be too complicated for someone that just started learning a new language.

Whatsapp rapid prototyping
A rapid prototype of a 'human' bot in Whatsapp, based on a script and possible narrative of the conversation

What I found out was that my test users had difficulties with some more complex vocabular or long sentences that they needed to translate first in their mother tongue. This needs a lot of time and can interrupt an ongoing dialogue.

A better way was to focus on short, precise and context relevant sentences. However the user does not need to understand every word but should identify the context of what's inside a sentence and furthermore have the possiblility to answer corectly as well as remember the whole conversation path.

Contextualized learning

But also the needs for context related learning appeared multiple times during my research as well as first user tests. Unlike mandatory school context do users of apps like Duolingo have different needs to learn a new language.

Contextualised Learning
Contextualised Learning of how to order a Pizza in Munich like a local

Another use case could be, that you soon start an exciting backpack trip to southern spain, so Lingo will learn you everything you need to survive (and even a little bit more).

And exactly those needs are relevant to find out to be implemented in a dialogue.

But contextualised learning could also be talking about topics that Lingo doesn't know yet. Like every conversational parter also Lingo has its knowledge borders and it shouldn't hide those.

I was thinking about two simple solutions that could help to build up a conversation nevertheless.

Lingo could jump into the role of the questioning persona and could build new questions through the answers of the user.

Lingo is a mediation persona and could connect the user to other users that may have the same interest. Lingo could analyze user data and compare it to fields of interest but also language skills – a tandem-conversation could emerge.

Conclusion

Learning languages through conversations with real and artifical personas is a very intersting use case for the current conversational UI and bots trend. Because the end-user is new to the language the conversation is happening in, designing such a conversation does need even more sensitivity. Besides meaningful micro-interactions, a key to a successful conversational applications is still language itself.

As already mentioned, Duolingo did release its own conversational bots, just after this course was finished. Have a look!

Lingo

Now it’s your turn, say Hi or just give me a digital highfive 👋 let’s act now!