An array of neon signs of nonsense words on a wall. Image generated by the Stable Diffusion AI algorithm.

Polyglot in the Machine: AI for Language Learners

AI is the order of the day lately. Have you seen how many fantasy photos have been filling up Instagram lately? Thanks to the now wide availability of open source AI algorithms, some powerful computing power is in the hands of users courtesy of apps like Dawn AI and Lensa. Type in a few words, and the computer does the painting.

It’s new tech, opening new possibilities alongside new ethical challenges that users are gradually becoming sensitive to. But the benefit to individual language learners here is apparent very little imagination stretch. First and foremost, these algorithms parse human language. So why not, for instance, type in some target language – say, ein Hund mit grünen Augen (a dog with green eyes) – and see if the picture matches what you meant to say? It should act as a kind of machine validation that the language you produce makes sense.

It already works to a point with some languages. Models like Dall-E (seen at work below in the web-based Craiyon.com) cope reasonably well with non-complex, non-English prompts.

A screenshot from Craiyon.com, a web-based AI image generator built on DALL-E Mini.

It can be hit and miss, but Craiyon understood my German for the most part!

So it works – up to a point. The current stumbling block is linguistic and cultural bias. For a start, models like Stable Diffusion were initially developed and trained with English input. And as one web experimenter shows, non-English results can leave a lot to be desired, with a definite advantage for Western European languages. This isn’t surprising, given that the technique samples from pre-existing web content; the predominance of certain languages means there is a lot more of that to learn from.

Ai Work In Progress

It’s clear these techniques are nascent and emerging, as most casual users will admit. Even if English is your target learning language, for example, images can frequently be so off the mark that you may question whether it understood a single word of your prompt.

Things are improving, though, especially with regular updates to the Stable Diffusion model. There are even a couple of language augmentation projects floating around in beta, including. one that adds ‘Japanglish’ capabilities to the current algorithm, overcoming one particular cultural blindspot.

And, if you have the skills, you can add to many ongoing open source projects to extend and finesse the capabilities of AI algorithms. I’m sad to report that that isn’t in my skillset, but it’ll be interesting to follow how this develops over the coming months!

Amazon Echo Dot - Alexa for Language Learning

Alexa: Your Personal, Digital Native Speaker

It’s a language learning ‘secret’ that isn’t so secret any more: changing the language setting on your smart devices is a brilliant way to create a personalised immersion environment without going abroad. And the recent explosion of artificially intelligent digital assistant devices is taking this one step further. Voice-activated gadgets, like Amazon’s Alexa, place a (robotic) native speaker right in the centre of your home.

Swayed by the temptingly low price on the entry-level Amazon Dot, I’ve been getting to know Alexa for the past few months. First off, it’s a cliché, but this is definitely the kind of gadget you ‘never knew you needed’. After eyeing the unit with some cynicism for the first few weeks, soon I was constantly asking it to play music, convert currencies and measurements, tell me the weather forecast or simply the time. It’s both easy and fun, and gives you that sense of the future is now!

You digital language assistant

But it’s not just about voice-activating mundane, daily tasks. Ever alert to new learning opportunities, changing Alexa’s language settings was top of the list of experiments to try. And it works a treat, especially for pronunciation; suddenly, I was having to focus intently on expressing my commands in a nice, clear German accent so that Alexa could understand. (Incidentally, I’ve also found switching the language of Apple’s assistant Siri has these great pronunciation drill benefits!)

Interacting is as simple as asking a question like “”Alexa, was sind die Nachrichten?” (Alexa, what’s the news?) or “Alexa, wie ist das Wetter heute?” (Alexa, what’s the weather like today?). For more capabilities – including lots of silly (but briefly entertaining) games – there are hundreds of extra installable skills on Amazon. A useful hit list of the most useful can be found here.

The only snag with Alexa is that it is currently only available in English or German. Great news for Germanists, who won’t feel underrepresented in the language learning world for a change; but a pretty large black hole for everyone else.

Skilling up Alexa as language tutor

However, all is not lost. Users can still download Alexa Skills from Amazon, which augment the device’s capabilities. Already there are a good number of language learning skills, although they vary greatly in quality. It’s clearly early days for the device in terms of educational skills, but the start is promising.

A simple search on Learn Spanish or similar will yield plenty of results for you to try out. Here are a couple of links for the more mainstream languages:

Feedback ranges from decent right down to downright terrible on some of the skills available. However, the facility to give feedback on Amazon is a route for users to shape and improve Alexa as a language learning tool. Try new skills out, and write an honest review for each one – your thoughts will help developers to tweak and adapt Alexa skills for an incrementally better experience.

Watch this space

In summary, Alexa is an excellent investment for Germanists, but hit and miss for students of other languages – at least for the time being. There is a sizeable clamour around Spanish support on Amazon’s developer space, with pressure for other languages too. It would only seem a matter of time before she becomes more than just bilingual.