I really want to use tools like Claude Code or self written agents (LangGraph) with top notch models without relying on US clouds or buying 5-10k€ hardware.

I had a look at Scaleway, IONOS and OVHcloud, but they all only offer the same outdated medium size models like gpt-oss-120b, llama-3.3:70b, Qwen3:32b. Scaleway at least just recently added Qwen3.5:397b.

The best I could find so far seems Nebius. The problem here: they do offer MiniMax-M2.5, GLM-5, Qwen3.5 but again just on US servers. Only the older versions like MiniMax-M2.1 or GLM-4.7 are EU hosted.

Is there just no infrastructure available in the EU to host such models at scale? I really hope that is not the reason.

What do you use? Please help!

Edit: You just now found that Nebius requires Google, GitHub, or Microsoft account to sign up. Sad.

There's Mistral AI in France. And Microsoft offers the OpenAI/ChatGPT models running in EU datacenters as part of Azure.

And if you're willing to set it up yourself, you can always rent a cloud server with some beefy GPUs and run arbitrary workloads on it. Your favourite AI models, games or whatever you like. OVH or RunPod.io for example have Linux servers with GPU access.

Sadly Mistral's models are somewhat behind at the moment from the benchmarks I've been looking at. But yeah that would probably be the most european solution.

Microsoft hosting in EU datacenters doesn't help with Microsoft being a US corporation. Therefor they need to hand data even from EU servers to US government by law (CLOUD Act). As far as I know they don't even claim differently.

As for now I still avoid setting it up myself, because it is just much more expensive if you don't run very high loads. The per token price for occasional or low volume load is just better using API services.

Hmmh. I think you already found the well-known services. I found one more: regolo.ai from Seeweb?!

But I'm not aware of anything that properly fits what you're asking for.

I'll mostly tinker around with RunPod instances. But that's not what you're looking for. If you find something good and cheap (and prepaid) I might have some use-cases for it as well. Like connect my Home Assistant voice assistant to it.

I use Mammouth.ai. It similar to Regolo as that it is a privacy friendly interface between you and a service via their API (for instance Mistral, Gemini, OpenAI, etc.). Not as good as running your own, but the next best thing IMHO. What I like about Mammouth is that you have access to many different services for a standard monthly fee.

Anything on Open router with EU hosted. Could look there.

According to their documentation "EU data residency" is an enterprise feature. Not sure if that's available to regular end customers?! The top models all come with inference by companies based in California (USA) or China.

Update: gemma4:31b changed the game, at least for the moment and my use-cases. Just running it locally.