Small LLMs

LLMs on Your Laptop

I mentioned last week that I’m spending a lot of time with LLMs recently. I’m poking and prodding them to test their ‘understanding’ (inverted commas necessary there!) of phonology, in particular with non-standard speech and dialects.

And you’d be forgiven for thinking I’m just tapping my prompts into ChatGPT, Claude, Gemini or the other big commercial concerns. Mention AI, and those are the names people come up with. They’re the all-bells-and-whistles web-facing services that get all the public fanfare and newspaper column inches.

The thing is, that’s not all there is to Large Language Models. There’s a whole world of open source (or the slightly less open ‘open weights’) models out there. Some of them offshoots of those big names, while others less well-known. But you can download all of them to run offline on any reasonably-specced laptop.

LMStudio – LLMs on your laptop

Meet LMStudio – the multi-platform desktop app that allows you to install and interrogate LLMs locally. It all sounds terribly technical, but at its most basic use – a custom chatbot – you don’t need any special tech skills. Browsing, installing and chatting with models is all done via the tab-based interface. You can do much more with it – the option to run it as a local server is super useful for development and testing – but you don’t have to touch any of that.

Many of the models downloadable within LMStudio are small models – just a few gigabytes, rather than the behemoths behind GPT-5 and other headline-grabbing releases. They feature the same architecture as those big-hitters, though. And in many cases, they are trained to approach, even match, their performance on specific tasks like problem-solving or programming. You’ll even find reasoning models, that produce a ‘stepwise-thinking’ output, similar to platforms like Gemini.

A few recent models for download include:

  • Qwen3 4B Thinking – a really compact model (just over 2gb) which supports reasoning by default
  • OpenAI’s gpt-oss-20b – the AI giant’s open weights offering, released this August
  • Gemma 3 – Google’s multimodal model optimised for use on everyday devices
  • Mistral Small 3.2 – the French AI company’s open model, with vision capabilities

So why would you bother, when you can just fire up ChatGPT / Google / Claude in a few browser clicks?

LLMs locally – but why?

Well, from an academic standpoint, you have complete control over these models if you’re exploring their use cases in a particular field, like linguistics or language learning. You can set parameters like temperature, for instance – the degree of ‘creativity wobble’ the LLM has (0 being a very rigid none, and 1 being, well, basically insane). And if you can set parameters, you can report these in your findings, which allows others to replicate your experiments and build on your knowledge.

Small models also run on smaller hardware – so you can develop solutions that people don’t need a huge data centre for. If you do hit upon a use case or process that supports researchers, then it’s super easy for colleagues to access the technology, whatever their recourse to funding support.

Secondly, there’s the environmental impact. If the resource greed of colossal data centres is something that worries you (and there’s every indication that it should be a conversation we’re all having ), then running LLMs locally allows you to take advantage of them without heating up a server farm somewhere deep inside the US. The only thing running hot will be your laptop fan (it does growl a bit with the larger models – I take that as a sign to give it a rest for a bit!).

And talk of those US server farms leads on to the next point: data privacy. OpenAI recently caused waves with their suggestion that user conversations are not the confidential chats many assume them to be. If you’re not happy with your prompts and queries passing out of your control and into the data banks of a foreign state, then local LLMs offer not a little peace of mind too.

Give it a go!

The best thing? LMStudio is completely free. So download it, give it a spin, and see whether these much smaller-footprint models can give you what you need without entering the ecosystem of the online giants.

Lastly, don’t have a laptop? Well, you can also run LLMs locally on phones and tablets too. Free app PocketPal (on iOS and Android) runs like a cut-down version of LMStudio. Great for tinkering on the go!

A finch flying above a beautiful landscape

Finch : Tiny Bird, Big Habits [Review]

When I first saw a Finch ad on Instagram, I confess, I rolled my eyes. Yet another quirky productivity app wrapped up as a kid’s game and pitched to grown‑ups, I thought. Isn’t Insta awash with them lately? But curiosity won the day, and I’m honestly quite glad it did.

As you’ve probably guessed, Finch turns your self‑care and habit building into a gentle, gamified ritual – with a little birdie companion. It might seem a touch infantile, but don’t be fooled: its foundation rests on solid habit‑science, and yes, adults do love things that are fluffy and cute (well, I do anyway).

Finch is generous too – its free version offers custom goals, journaling, mood tracking and more, without forcing you to pay to access the essentials. I haven’t paid a penny to use it yet, but the range of function on the free tier has been more than enough to keep me using it.

Why It Works

  • It starts small. When you first set it up, the suggested goals are self-care easy wins – drink more water, get outside at least once day – things to get you used to the app environment. Want to journal, stretch, or simply “get out of bed”? Go ahead and make it count.
  • Flexible goal‑setting for grown‑ups. Once you’ve got used to the interface, you can go to town setting your own goals – even on the free tier. I’ve added language learning daily tactics, university reading goals and all sorts – I almost feel guilty that I’m doing all this without a subscription!
  • Gentle gamification. As you check off goals, your bird gains energy, goes on charming adventures, and earns “Rainbow Stones” for adorning its nest. It’s rewarding without being punishing. And of course, also streak-building is part of the ecosystem, your Finch never dies if you miss a day (God forbid).
  • Supportive, not prescriptive. Other users highlight how the app strikes the right tone: compassionate rather than preachy. Some users with ADHD, anxiety or depression say its warmth makes self‑care feel doable.
  • Friend‑based encouragement. You can buddy up with a friend on a single goal (or more) without exposing your progress to a social feed. It’s discreet, pressure‑free support. For a laugh, I added a pal on the “drink more water” goal. We laugh about it, but it’s actually not a bad habit to develop, is it?

Final Verdict

Finch is a cosy, surprisingly effective habit app wrapped in feathers and whimsy. It’s kind to energy-drained minds, flexible enough for real lives, and – despite coming at me via the dreaded Insta ads – far more than a passing gimmick.

If you’ve ever felt wary of habit tools that feel too serious or demanding, Finch might just surprise you. And if nothing else, the little bird and its gentle cheer-on can make daily tasks feel a bit more doable – and dare I say it, sweet.

Finch is available as a free download on all the usual platforms –
find out more at their website here!

A robot reading a script. The text-to-speech voices at ElevenLabs certainly sound intelligent as well as natural!

ElevenLabs : 5-Star Tool for Language Work and Study

If you’re a regular reader, you’ll know how impressed I’ve been at ElevenLabs, the text-to-speech creator that stunned the industry when its super-realistic voices were unleashed on the world. Since then, it’s made itself irreplaceable in both my work and study, and it bears spreading the word again: ElevenLabs is a blow-your-socks-off kind of tool for creating spoken audio content.

Professional Projects

In my work developing language learning materials for schools, arranging quality narration used to involve coordinating with agencies and studios — a process that was both time-consuming and costly. We’ve had issues with errors, too, which cost a project time with re-recordings. And that’s not to mention the hassle keeping sections up-to-date. Removing ‘stereo’ from an old vocab section (who has those now?) would usually trigger a complete re-record.

With ElevenLabs, I can now produce new sections promptly, utilising its impressive array of voices across multiple languages. The authenticity and clarity of these voices are fantastic – I really can’t understate it – and it’s made maintaining the biggest language learning site for schools so much easier.

Supporting Individual Learning

As a language learner, ElevenLabs is more than worth its salt, too. It’s particularly good for assembling short listening passages – about a minute long – to practise ‘conversation islands’—a well-regarded polyglot technique for achieving conversational fluency.

Beyond language learning, the tool can be a great support to other academic projects. I’ve created concise narrations of complex topics, converting excerpts from scholarly papers into audio format. Listening to these clips in spare moments (or even in the background while washing up) has helped cement some key concepts, and prime my mind for conventional close study.

Flexible and Affordable Plans

ElevenLabs offers a range of pricing options to suit different needs:

Free Plan: Ideal for those starting out, this plan provides 10,000 characters per month, roughly equating to 10 minutes of audio.

Starter Plan: At £5 per month, you receive 30,000 characters (about 30 minutes of audio), along with features like voice cloning and commercial use rights.

Creator Plan: For £22 per month, this plan offers 100,000 characters (around 100 minutes of audio), plus professional voice cloning and higher-quality outputs.

For messing around, that free plan is not too stingy at all – you can really get a feel for the tool from it. Personally, I’ve not needed to move beyond the starter plan yet, which is pretty much a bargain at around a fiver a month.

Introducing ElevenReader

And there’s more! Complementing the TTS service, ElevenLabs has introduced ElevenReader, a free tool that narrates PDFs, ePubs, articles, and newsletters in realistic AI voices. Available on both iOS and Android platforms, the app doesn’t even consume credits from your ElevenLabs subscription plan.

Seriously, I can’t even believe this is still free – go and try it!

Final Thoughts

ElevenLabs has truly transformed the way I create and consume spoken content. It truly is my star tool from the current crop of AI-powered utilities.

The ElevenLabs free tier is enough for most casual users to have a dabble – go and try it today!

A robot playwright - now even more up-to-date with SearchGPT.

Topical Dialogues with SearchGPT

As if recent voice improvements weren’t enough of a treat, OpenAI has just introduced another killer feature to ChatGPT, one that can likewise beef up your custom language learning resources. SearchGPT enhances the LLM’s ability to access and incorporate bang up-to-date information from the web.

It’s a development that is particularly beneficial for language learners seeking to create study materials that reflect current events and colloquial language use. With few exceptions until now, LLMs like ChatGPT have had a ‘data cutoff’, thanks to mass text training having an end-point (albeit a relatively recent one). Some LLMs, like Microsoft’s Copilot, have introduced search capabilities, but their ability to retrieve truly current data could be hit and miss.

With SearchGPT, OpenAI appear to have cracked search accuracy a level to rival AI search tool Perplexity – right in the ChatGPT app. And it’s as simple as highlighting the little world icon that you might already have noticed under the prompt field.

The new SearchGPT icon in the ChatGPT prompt bar.

The new SearchGPT icon in the ChatGPT prompt bar.

Infusing Prompts with SearchGPT

Switching this on alongside tried-and-tested language learning prompt techniques yields some fun – and pedagogically useful – results. For instance, you can prompt ChatGPT to generate dialogues or reading passages based on the latest news from your target language country/ies. Take this example:

A language learning dialogue on current affairs in German, beefed up by OpenAI's SearchGPT

A language learning dialogue on current affairs in German, beefed up by OpenAI’s SearchGPT

SearchGPT enables content that mirrors real-life discussion with contemporary vocabulary and expressions (already something it was great at). But it also incorporates accurate, up-to-the-minute, and even cross-referenced information. That’s a big up for transparency.

Unsure where that info came from? Just click the in-text links!

Enhancing Speaking Practice with Authentic Contexts

Beyond reading, these AI-generated dialogues serve as excellent scripts for speaking practice. Learners can role-play conversations, solo or group-wise, to improve pronunciation, intonation, and conversational flow. This method bridges the gap between passive understanding and active usage, a crucial step in achieving fluency.

Incorporating SearchGPT into your language learning content creation toolbox reconnects your fluency journey with the real, evolving world. Have you used it yet? 

Apples and oranges, generated by Google's new image algorithm Imagén 3

Google’s Imagén 3 : More Reliable Text for Visual Resources

If you use AI imaging for visual teaching resources, but decry its poor text handling, then Google might have cracked it. Their new algorithm for image generation, Imagén 3, is much more reliable at including short texts without errors.

What’s more, the algorithm is included in the free tier of Google’s LLM, Gemini. Ideal for flashcards and classroom posters, you now get quite reliable results when prompting for Latin-alphabet texts on the platform. Image quality seems to have improved too, with a near-photographic finish possible:

A flashcard produced with Google Gemini and Imagén 3.

A flashcard produced with Google Gemini and Imagén 3.

The new setup seems marginally better at consistency of style, too. Here’s a second flashcard, prompting for the same style. Not quite the same font, but close (although in a different colour).

A flashcard created with Google Gemini and Imagén 3.

A flashcard created with Google Gemini and Imagén 3.

It’s also better at real-world details like flags. Prompting in another engine for ‘Greek flag’, for example, usually results in some terrible approximation. Not in Imagén 3 – here are our apples and oranges on a convincing Greek flag background:

Apples and oranges on a square Greek flag, generated by Google's Imagén 3

Apples and oranges on a square Greek flag, generated by Google’s Imagén 3

It’s not perfect, yet. For one thing, it performed terribly with non-Latin alphabets, producing nonsense each time I tested it. And while it’s great with shorter texts, it does tend to break down and produce the tell-tall typos with anything longer than a single, short sentence. Also, if you’re on the free tier, it won’t allow you to create images of human beings just yet.

That said, it’s a big improvement on the free competition like Bing’s Image Creator. Well worth checking out if you have a bunch of flashcards to prepare for a lesson or learning resource!

Greek text on a packet of crisps

Language Lessons from Packaging (And A Little Help from ChatGPT)

If you love scouring the multilingual packaging of household products from discounter stores (a niche hobby, I must admit, even for us linguists), then  there’s a fun way to automate it with LLMs like ChatGPT.

Take the back of this packet of crisps. To many, a useless piece of rubbish. To me (and some of you, I hope!), a treasure of language in use.

Greek text on a packet of crisps - food and household item packaging can be a great source of language in use.

Greek text on a packet of crisps

Normally, I’d idly read through these, looking up any unfamiliar words in a dictionary. But, using an LLM app with an image facility like ChatGPT, you can automate that process. What’s more, you can request all sorts of additional info like dictionary forms, related words, and so on.

From Packaging to Vocab List

Take a snap of your packaging, and try this prompt for starters:

Create a vocabulary list from the key content words on the packaging label. For each word, list:
– its dictionary form
– a new, original sentence illustrating the word in use
– common related words

The results should be an instantly useful vocab list with added content for learning:

Vocabulary list from food packaging by ChatGPT

Vocabulary list compiled by ChatGPT from a food packaging label

I added a note-taking stage to round it off. It always helps me to write down what I’m learning, adding a kinaesthetic element to the visual (and aural, if you’ve had ChatGPT speak its notes out loud). Excuse the scrawl… (As long as your notes are readable by you, they’re just fine!)

Handwritten vocabulary notes derives from crisp packet packaging

Notes on a crisp packet…

It’s a fun workflow that really underscores the fact that there are free language lessons all around us.

Especially in the humblest, and often least glamorous, of places.

ChatGPT takes conversation to the next level with Advanced Voice Mode

ChatGPT Advanced Voice Mode is Finally Here (For Most of Us!)

Finally – and it has taken SO much longer to get it this side of the Pond – Advanced Voice Mode has popped up in my ChatGPT. And it’s a bit of a mind-blower to say the least.

Multilingually speaking, it’s a huge step up for the platform. For a start, its non-English accents are hugely improved – no longer French or German with an American twang. Furthermore, user language detection seems more reliable, too. Open it up, initiate a conversation in your target language, and it’s ready to go without further fiddling.

But it’s the flexibility and emotiveness of those voices which is the real game-changer. There’s real humanity in those voices, now, reminiscent of Hume’s emotionally aware AI voices. As well as emotion, there’s variation in timbre and speed. What that means for learners is that it’s now possible to get it to mimic slow, deliberate speech when you ask that language learning staple “can you repeat that more slowly, please?”. It makes for a much more adaptive digital conversation partner.

Likewise – and rather incredibly – it’s possible to simulate a whole range of regional accents. I asked for Austrian German, and believe me, it is UNCANNILY good. Granted, it did occasionally verge on parody, but as a general impression, it’s shocking how close it gets. It’s a great way to prepare for speaking your target language with real people, who use real, regionally marked speech.

Advanced Voice Mode, together with its recently added ability to remember details from past conversations (previously achievable only via a hack), is turning ChatGPT into a much cannier language learning assistant. It was certainly worth the wait. And for linguaphiles, it’ll be fascinating to see how it continues to develop as an intelligent conversationalist from here.

Mapping out conversational probabilities - it's much easier with flowcharts.

Vocabulary Flowcharts : Preparing for Probabilities with ChatGPT

The challenge in preparing for a speaking task in the wild is that you’re dealing with multiple permutations. You ask your carefully prepared question, and you get any one of a number of likely responses back. That, in turn, informs your next question or reply, and another one-of-many comebacks follows.

It’s probability roulette.

What if you could map all of these conversational pathways out, though? Flowcharts have long been the logician’s tool of choice for visualising processes that involve forking choices. Combined with generative AI’s penchant for assembling real-world language, we have a recipe for much more dynamic language prep resources than a traditional vocab list.

And, thanks to a ready-made flowchart plugin for ChatGPT – courtesy of the charting folks at Whimsical.com – it’s really easy to knock one together.

Vocabulary Flowcharts in Minutes

In your ChatGPT account, you’ll need to locate the Whimsical GPT. Then, it’s just a case of detailing the conversational scenario you want to map out. Here’s an example for ‘opening a bank account in Germany’:

Create a flowchart detailing different conversational choices and paths in German for the scenario “Opening a bank account as a non-resident of Germany planning to work there for six months.” Include pathways for any problems that might occur in the process. Ensure all the text reflects formal, conversational German.

The result should be a fairly detailed ‘probability map’ of conversational turns:

A 'vocabulary flowchart' in German, created by the Whimsical.com GPT on ChatGPT.

A ‘vocabulary flowchart’ in German, created by the Whimsical.com GPT on ChatGPT.

Vocabulary flowcharts are another tool in your AI arsenal for speaking prep. Have you given them a whirl yet? Tell us about your own prep in the comments!

Lots of colourful neon shortcuts on a screen.

Apple Shortcuts for Smart Study Hacks

I’ve been optimising my iPad for study recently, trying to make it a portable, one-stop shop for reading and prep on-the-move. It’s no doubt another flex of my childhood awe for Inspector Gadget’s niece Penny, and her computer-in-a-book that could do everything.

Anyway, it’s led me to discover lots of features I half knew about, but had ignored for the duration of my Apple fanboydom. And one of the biggest revelations of rediscovery has been the Apple Shortcuts app.

In a nutshell, Shortcuts allows you to bundle all sorts of custom process chains into a single, iconisable action. For example, a shortcut could retrieve something, do something with the result, then present it in a certain way. People use them for all sorts of admin tasks – collecting stock prices and collating them in a spreadsheet with a single click, for instance.

The cool thing is that many third-party apps have extensions that you can link into shortcuts. ChatGPT, for example, which I find invaluable as a quick summary or explanatory tool, can be part of an action chain. And you can trigger chains not just with clicks, but from documents, via the share link.

Shortcuts for Smart Study : Brief Description

Using the app, I put together a quick shortcut I called “Brief Description”. It sends the current PDF (from a browser window, or from the Files app), to ChatGPT, prompting it for a one-paragraph summary.

A screenshot from Apple Shortcuts of a 'Brief Explanation' action using ChatGPT.

A screenshot from Apple Shortcuts of a ‘Brief Explanation’ action using ChatGPT.

As you can see, one of the best things about it is how you assemble a shortcut in more or less natural language, as you select items via an intuitive click-and-build interface. There are also plenty of resources for getting started and pushing the boundaries of it (like this very clued-up YouTube channel!).

The result of my shortcut offers a great way to get a paper summary, whatever the language:

Screenshot of an Apple Shortcuts link in the share menu.

Screenshot of an Apple Shortcuts link in the share menu.

When working through a bunch of resources, it’s great to ascertain in a click or two whether it might be a worthwhile full read, making this a brilliant time-saver. It’s even more powerful when combined with ChatGPT’s new(ish) memory features – my account ‘knows’ what I’ve been working on from recent chats, so is even better able to judge what’s useful.

For sure, I’ll be exploring more of this over the coming weeks, as it’s clear I’ve barely scratched the surface of how useful it could be yet. Have you used Apple Shortcuts to create smart study hacks? Let us know in the comments!

ElevenLabs Reader is the TTS robot you need!

ElevenLabs Reader : Enjoy it while it’s free!

I’ve raved before about the fantastic text-to-speech facility at ElevenLabs. Voices so realistic they pretty much pass for human, that work across languages, and can even clone your own.

Well, there’s a little-feted app that the ElevenLabs team are behind that is a similar show-stopper in its category. It’s simply called Reader, and is a free text-to-speech narration app for Android and iOS. 

Like the company’s web-based TTS service, it has the same range of emotive, expressive, ultra-realistic voices. It can also cope well narrating many languages, which are autodetected. Best of all for me is that it links with your device’s documents, so I can quickly import the papers I’m reading. Listening AND reading has made a massive difference to my comprehension and recall – multimodal is definitely the way forward for me!

You do get the odd strange artefact in the readout, but the product is still in Beta (likely the reason it’s currently completely free), and glitches are rare. What I’m also missing in it is the ability to tweak imported texts in-app, as you can do with Speechify. This would allow some cleaning of the file pre-narration (I lost count of the number of times I had to skip the page footer DOI link, which it hilariously mis-narrated many times). You can, of course, simply export and clean the files as text before importing, which gets round that.

In any case, they’re worth putting up with while the app is still free and in Beta. Even as it is, you have features here that you’d pay a small fortune for in other apps (ahem, Speechify). Definitely worth a punt if you’re looking for TTS support in your reading! Find download links for Android and iOS here.