Back to blog

Claude vs GPT-6 vs Gemini vs DeepL for Django Translation (2026)

2026-07-09 8 min read
Claude vs GPT-6 vs Gemini vs DeepL for Django Translation (2026)

Claude, GPT-6, Gemini and DeepL can all translate your Django .po files well. The differences that matter in September 2026 are price, which model tier you pick, and whether you can pass project context along. This comparison covers the current models from each provider, what the WMT translation benchmarks actually found, and what a typical Django project costs to translate with each.

Every model here works with TranslateBot, either through LiteLLM or through the built-in DeepL provider. If you're setting up Django translations for the first time, the complete Django localization guide covers the setup before you pick a provider.

A note on sources: we haven't run our own benchmark on these model versions. Quality claims below come from the WMT shared tasks and one large industry dataset, all linked. Prices come from each vendor's pricing page as of September 26, 2026.

Quick answer

If you want... Use
The cheapest good option gpt-6-luna
Best quality per dollar claude-sonnet-5 or gpt-6-sol
Top quality for a launch or marketing copy claude-opus-5-5
Zero budget gemini/gemini-3.5-flash-lite on Gemini's free tier
No LLM at all, or you already pay for DeepL DeepL

TranslateBot's default is gpt-6-luna, so a project that doesn't set a model already uses the cheapest good option.

What the benchmarks say

The most rigorous machine translation evaluation is the annual WMT shared task. Professional annotators rate the output of every submitted system, and the results come out as quality clusters rather than a single ranking.

WMT24: Claude 3.5 Sonnet won

In the WMT24 General MT task, Claude 3.5 Sonnet was the best system overall and won 9 of the 11 language pairs. That was the first time a general-purpose LLM beat every dedicated translation system in the competition.

WMT25: Gemini 2.5 Pro won

At WMT25, Gemini 2.5 Pro landed in the top cluster for 14 of 16 language pairs. Human reference translations made the top cluster in only 6 of the 15 pairs that had them. The organizers note this could reflect "the stylistic or lexical preferences of the annotators", but the direction is clear: frontier LLMs now match or beat professional human references on these tests.

WMT26: not published yet

WMT26 takes place October 28–29, 2026 in Budapest. The findings paper isn't out yet, and the organizers aren't publishing preliminary rankings. We'll update this article when it is.

What production data says

Alconost published 5,632 quality evaluations from real client projects across 85 language pairs in May 2026. Their quality index put Gemini at 77.7, Claude at 75.6, GPT at 73.1 and DeepL at 70.8. They only report vendors, not model versions, and they call it descriptive of their sample rather than an industry benchmark. Treat the gaps as small.

Where LLMs still fall short

Low-resource languages are the weak spot. In one study, English-to-Khmer translation by an LLM scored 39.10 on XCOMET versus 65.88 for Google Translate. If you're targeting Khmer, Lao or Burmese, test carefully and get a native speaker to review.

Automated scores can also mislead. A segment with a COMET score of 0.86 turned out to contain a critical misunderstanding when professionals reviewed it. Benchmarks are a starting point, not a substitute for a native reader.

The current models

Anthropic Claude

Model Input / output per 1M tokens Notes
claude-haiku-4-5 $1 / $5 Fastest, cheapest Claude
claude-sonnet-5 $2 / $10 Best balance for translation
claude-opus-5-5 $4 / $20 Anthropic's recommended default model
claude-fable-5-1 $10 / $50 Built for long reasoning tasks, overkill for UI strings

Source: Claude models overview.

Claude's strength has always been translations that read as if they were written in the target language, and it follows the tone and terminology rules in a TRANSLATING.md file closely. Sonnet 5 costs less per token than the Sonnet 4.5 it replaced, which makes it the one to start with.

OpenAI

Model Input / output per 1M tokens Notes
gpt-6-luna $0.10 / $0.50 Cheapest current model
gpt-6-sol $2 / $10 Mid tier, same price as Sonnet 5
gpt-6-astra $10 / $50 Flagship, rarely needed for translation
gpt-4o-mini $0.15 / $0.60 TranslateBot's previous default, still available

Source: OpenAI API pricing.

gpt-4o-mini and gpt-4o aren't scheduled for shutdown, but OpenAI is retiring some dated GPT-4o snapshots (gpt-4o-2024-05-13 goes on October 23, 2026, per the deprecations page). If you pinned a dated snapshot, check that list.

Google Gemini

Model Input / output per 1M tokens Notes
gemini/gemini-3.5-flash-lite $0.30 / $2.50 Google lists translation among its intended uses
gemini/gemini-3.8-flash $0.75 / $3.75 Google's recommended model; price doubles on January 1, 2027
gemini/gemini-3.1-pro-preview $2 / $12 Preview only, no stable 3.x Pro yet

Sources: Gemini models, Gemini pricing.

Gemini won WMT25 and tops the Alconost data, so it deserves a spot on your shortlist. It's also the only provider here with an ongoing free tier: both Flash models above can be used free of charge, with rate limits, and Google may use free-tier data to improve its products. Gemini 2.5 models are now only open to projects that already used them, so new projects should start on 3.5 Flash-Lite or 3.8 Flash.

DeepL

DeepL now runs a next-generation LLM model for all its languages (model_type=quality_optimized in the API), and it supports 100+ languages.

The plans changed in 2026. New sign-ups get the Developer plan: a one-time credit of 1 million characters, not the old 500,000 characters every month. After that, Growth costs €23.80 per month billed annually, includes 12 million characters per year, and charges €22 per extra million characters (EU prices including VAT; see DeepL API plans).

DeepL has also added style rules, custom instructions and up to 5 glossaries per request. These help, but they're still more limited than a TRANSLATING.md file, which can describe your product, your audience and your preferred terminology in plain language.

Head-to-head comparison

Claude GPT-6 Gemini DeepL
Benchmark record Won WMT24 No WMT win Won WMT25, tops Alconost Lowest in Alconost data
Cheapest current model (input / output per 1M) $1 / $5 $0.10 / $0.50 $0.30 / $2.50 €22 per 1M chars
TRANSLATING.md context Yes Yes Yes No
Glossaries / style rules Via TRANSLATING.md Via TRANSLATING.md Via TRANSLATING.md Native API features
Free usage None None Free tier with rate limits One-time 1M characters
TranslateBot setup LiteLLM LiteLLM LiteLLM [deepl] extra

What a Django project costs

Take a medium Django project: 500 strings, roughly 10,000 words, translated into 5 languages. We assume about 15,000 input tokens (strings plus TranslateBot's prompt) and 20,000 output tokens per language, because most languages take more tokens than English.

Model Estimated cost
gpt-6-luna ~$0.06
gpt-4o-mini ~$0.07
gemini/gemini-3.5-flash-lite ~$0.27
gemini/gemini-3.8-flash ~$0.43
claude-haiku-4-5 ~$0.58
claude-sonnet-5 / gpt-6-sol ~$1.15
claude-opus-5-5 ~$2.30
DeepL (~300,000 characters) Fits in the one-time credit, or ~€6.60 at Growth's overage rate

These numbers are estimates. Models that reason before they answer, such as Claude Opus 5.5, bill that reasoning as output tokens, so they can cost more than the table shows. After the first run, TranslateBot only translates new or changed strings, so later runs usually cost a few cents at most.

Which one to pick

Start with claude-sonnet-5 or gpt-6-sol if quality matters and you don't mind paying about a dollar per full project run. Claude has the stronger benchmark record (Claude 3.5 Sonnet won WMT24), although no WMT results exist yet for these exact versions. The two cost the same.

Use gpt-6-luna for side projects, internal tools, or a first pass you'll review anyway. At about six cents for the example project, the cost is effectively zero.

Try Gemini if you translate into many languages or have no budget. It won WMT25, scored best in the Alconost data, and 3.5 Flash-Lite is cheap on the paid tier and free on the free tier.

Use DeepL if your company already has a DeepL contract, or you want dedicated MT with native glossaries. Without the old monthly free tier, it's no longer the automatic choice for zero-budget projects.

Mix providers per language. You can use one model for European languages and another for Japanese or Korean. Run the translate command once per provider, each time for different target languages, and switch TRANSLATEBOT_MODEL and TRANSLATEBOT_API_KEY between runs.

How to switch providers in TranslateBot

Switching providers means changing two settings in your settings.py:

import os

# Claude Sonnet 5
TRANSLATEBOT_MODEL = "claude-sonnet-5"
TRANSLATEBOT_API_KEY = os.getenv("ANTHROPIC_API_KEY")

# GPT-6 Luna
TRANSLATEBOT_MODEL = "gpt-6-luna"
TRANSLATEBOT_API_KEY = os.getenv("OPENAI_API_KEY")

# Gemini 3.5 Flash-Lite
TRANSLATEBOT_MODEL = "gemini/gemini-3.5-flash-lite"
TRANSLATEBOT_API_KEY = os.getenv("GEMINI_API_KEY")

# DeepL
TRANSLATEBOT_PROVIDER = "deepl"
TRANSLATEBOT_API_KEY = os.getenv("DEEPL_API_KEY")

For DeepL, you also need the DeepL extra:

uv add --dev translatebot-django[deepl]

To try another model from the same provider for one run without changing your settings, use --llm-model. TRANSLATEBOT_API_KEY is still used, so the model has to match your key's provider:

python manage.py translate --target-lang ja --llm-model gpt-6-sol

Practical tips

Compare on a branch. --dry-run doesn't call the model, so to compare real output, re-translate on a throwaway branch and read the diff:

git switch -c try-gpt-6-sol
python manage.py translate --target-lang nl --overwrite --llm-model gpt-6-sol
git diff -- '*.po'

Write a TRANSLATING.md before paying for a bigger model. Terminology and tone instructions ("translate 'cart' as 'Warenkorb'", "use informal 'du' in German") often fix what looked like a model quality problem.

Have a native speaker check a sample. Benchmarks measure averages. Your checkout page is one specific set of strings.

Watch the Gemini price change. Gemini 3.8 Flash doubles in price on January 1, 2027. It will still be cheap for translation, but update your estimates.

Conclusion

Claude won WMT24, Gemini won WMT25, and in 2026 the gap between the top providers is small. For most Django projects the practical choice is between claude-sonnet-5 or gpt-6-sol for quality and gpt-6-luna for cost, with Gemini as a strong alternative and the best free option. DeepL is still good, but new accounts no longer get a monthly free tier. TranslateBot makes switching between them a settings change.

Once you've chosen a provider, automate your Django translation workflow so new strings never pile up again.

Stop editing .po files manually

TranslateBot automates Django translations with AI. One command, all your languages, pennies per translation.