THE NO BULLSHIT GUIDE TO EU & OPEN AILESS DEPENDENCE. MORE POSSIBILITY.

AI ON
YOUR TERMS.

Choose who runs it. See what powers it. Build something you can make your own. European AI companies and the global open-source community give you a hell of a lot of options.

Explore all 22 picks Help me choose a setup ↗
22 researched picks6 layers of the stack0 paid placements
BIG CLAIMS? READ THE LABEL.

Know what
you’re choosing.

Location, licensing, and deployment are separate choices. Our labels help you see what you actually get.

EU company
An identified company based in an EU member state. This describes the provider, not a guarantee that every service processes data only in the EU.
Open-source code
The listed software has an open-source license. A hosted service, an enterprise edition, or the model it calls can have different terms.
Open weights
You can download the named model’s weights. That alone does not give you the training data or a fully reproducible training process. Check its exact license.
Self-hostable
You can run the listed component on infrastructure you control. Keep the whole path in mind: models, embeddings, tools, storage, and telemetry.
PICK A WAY IN

Start small. Own more.

Four practical starting points.
Build around what you need.

01 / PERSONAL · LOCAL

A chat that lives with you.

Start with Ollama and a small supported model. Add AnythingLLM for a document workspace.

Choose local generation and embeddings. Download first; then check what still needs a network connection.

Start with local inference ↗
02 / DEVELOPER · CODING

Your terminal. Extra hands.

Try Mistral Vibe with a supported model endpoint. Keep edits in Git and review commands before they run.

The harness is open. Model access can still cost money and send repository context to a provider.

Meet the coding harness ↗
03 / TEAM · YOUR DOCUMENTS

Answers from your own knowledge.

Prepare files with Docling, retrieve with Qdrant, and orchestrate with Haystack. Add a model and embeddings you control.

This is an architecture to assemble and test. Document permissions, answer quality, and operations are part of the build.

Explore the knowledge layer ↗
THE WHOLE STACK, OPENED UP

Meet your options.

Useful tools. Specific licenses.
Official sources. Real trade-offs.

22 AI solutions to explore

Sources checked September 23, 2026
01
EU providers

A different home for your AI.

Chat and model APIs from European companies. Start with a service, without running your own GPU fleet.

France · Mistral AI

Mistral AI

A European starting point for everyday AI.

EU company

Use Le Chat for writing, research, and everyday assistance, or build applications with Mistral’s model API. A direct route to a French AI provider.

License / terms
Hosted service · model licenses vary
Where it runs
Managed chat & API

Good for: People switching their daily assistant; teams choosing a model provider.

The heads-up & first step

The honest heads-up

Le Chat and the hosted API are commercial services. Downloadable Mistral models have separate licenses; an EU company address does not establish where every feature processes data.

Your first step

Try a non-sensitive task in Le Chat, then compare the result with your current assistant. For an app, start with the API playground.

France · Scaleway

Scaleway Generative APIs

Use the model. Skip the GPU operations.

EU company

Access a catalog of models through a managed inference API. Scaleway’s documentation describes its hosting locations and an API compatible with familiar chat-completion clients.

License / terms
Commercial hosted service
Where it runs
Managed model API

Good for: Developers who want a European inference provider without maintaining servers.

The heads-up & first step

The honest heads-up

Model availability, hosting locations, quotas, and usage charges can change. Check the selected endpoint and model terms before moving a workload.

Your first step

Follow the quickstart with one small request, then measure quality and cost on your own examples.

France · OVHcloud

OVHcloud AI Endpoints

A European cloud route into open models.

EU company

Call supported AI models through an API on OVHcloud infrastructure. Useful when you want managed inference alongside a broader European cloud setup.

License / terms
Commercial hosted service
Where it runs
Managed model API

Good for: Teams integrating model inference into existing applications.

The heads-up & first step

The honest heads-up

A managed endpoint is not a self-hosted model. Confirm the endpoint’s region, retention terms, supported features, and current pricing.

Your first step

Choose a model from the current catalog and run a small application proof of concept.

Germany · IONOS

IONOS AI Model Hub

Add AI without adding a server room.

EU company

A managed gateway to language and other AI models from a German cloud provider. Connect your application to hosted inference instead of operating the model runtime yourself.

License / terms
Commercial hosted service
Where it runs
Managed model API

Good for: Businesses looking for an EU provider and a managed integration path.

The heads-up & first step

The honest heads-up

The service and its individual models have different terms. Confirm processing locations, model availability, and data handling for the product you select.

Your first step

Explore the available models and test a representative request through the documented API.

02
Language models

Download the intelligence.

Named model releases with downloadable weights. Pick for your languages, hardware, and workload—not just a leaderboard.

France · Mistral AI

Mistral Small 3.1

Text, images, and a model you can take with you.

EU companyOpen weightsSelf-hostable

The 24B Instruct release combines multilingual text, image understanding, and function calling with downloadable weights. A concrete European option for your own deployment.

License / terms
Apache-2.0 · this model release
Where it runs
Your hardware / compatible host

Good for: Teams evaluating a self-hosted assistant with text and vision.

The heads-up & first step

The honest heads-up

24 billion parameters still need substantial memory. Quantization, context length, and runtime affect capacity and speed; this is a named release, not a claim to be the newest model.

Your first step

Read the model card’s deployment instructions and choose a runtime that supports the exact architecture and features you need.

Official sourcesModel card & license ↗
EU-funded · European research collaboration

EuroLLM-9B-Instruct

Europe has more than one language. So should AI.

Open weightsSelf-hostable

A multilingual model built to cover all official EU languages and additional languages. The collaboration includes institutions in Portugal, France, the Netherlands, and the UK.

License / terms
Apache-2.0 · this model release
Where it runs
Your hardware / compatible host

Good for: Multilingual prototypes, European-language evaluation, and research.

The heads-up & first step

The honest heads-up

Language coverage does not promise equal quality in every language. This is a research collaboration, not an EU cloud service; test your dialect and domain.

Your first step

Compare answers in the languages you actually use, following the model card’s chat template.

United States · Ai2

Olmo 3 7B Instruct

Go deeper than a weights download.

Open weightsSelf-hostable

Ai2’s Olmo project opens up model development with training resources as well as weights. The 7B Instruct release offers a practical entry into that research ecosystem.

License / terms
Apache-2.0 · this model release
Where it runs
Your hardware / compatible host

Good for: Researchers and builders who care about understanding how models are made.

The heads-up & first step

The honest heads-up

This is a US project, and the listed model is English-focused. Open development does not make model outputs reliable by default.

Your first step

Explore the project’s training resources, then run the model-card example on suitable hardware.

China · Qwen / Alibaba

Qwen3-8B

A global model. A deployment you choose.

Open weightsSelf-hostable

An 8B language model with multilingual support and thinking and non-thinking modes. Download it and evaluate it in a local or privately hosted application.

License / terms
Apache-2.0 · this model release
Where it runs
Your hardware / compatible host

Good for: Builders exploring a smaller downloadable model for chat and reasoning.

The heads-up & first step

The honest heads-up

Qwen is not European. The Apache license here applies to this specific release; other family members may differ. Thinking mode also changes latency and output handling.

Your first step

Use the official chat template and compare both modes on a small set of real tasks.

Official sourcesModel card & license ↗
03
Agents & harnesses

Build something that does things.

Frameworks orchestrate models and tools. A coding harness adds the working environment: files, commands, edits, and a review loop.

Germany · deepset

Haystack

Build agents with a plan you can inspect.

EU companyOpen-source codeSelf-hostable

Compose retrieval, model calls, tools, and routing into explicit pipelines and agents. A strong building block for document assistants and applications that need more than a prompt.

License / terms
Apache-2.0
Where it runs
Python application / your infrastructure

Good for: Developers building retrieval-augmented generation (RAG) and tool-using agents.

The heads-up & first step

The honest heads-up

The framework does not host your models or operate your infrastructure. Connected APIs may send data elsewhere; deepset’s commercial platform is a separate offering.

Your first step

Build one retrieval pipeline with your chosen model backend before adding agent loops.

Hugging Face · global open-source community

smolagents

Small framework. Room to experiment.

Open-source codeSelf-hostable

A compact agent library with code-based and tool-calling approaches, support for different model backends, and MCP tool integration.

License / terms
Apache-2.0
Where it runs
Python application / your infrastructure

Good for: Python developers prototyping agents without a large orchestration layer.

The heads-up & first step

The honest heads-up

Code-generating agents need a controlled execution environment. Local orchestration only keeps inference local when you also choose a local model backend.

Your first step

Run a minimal example with a restricted tool set and the execution isolation recommended by the project.

LangChain · global open-source community

LangGraph

Give long-running agents some structure.

Open-source codeSelf-hostable

Model agent workflows as graphs with state, persistence, and human intervention. Useful when a task must pause, resume, or take a deliberate path through multiple steps.

License / terms
MIT · framework
Where it runs
Your application / optional managed services

Good for: Developers who need explicit workflow control and review points.

The heads-up & first step

The honest heads-up

Persistence and deployment still need configuration. The open framework’s license does not include every hosted LangChain or LangSmith service.

Your first step

Build a small graph with one tool and a human review step; add durable storage when the flow works.

France · Mistral AI

Mistral Vibe

Put an open coding harness in your terminal.

EU companyOpen-source codeSelf-hostable

Mistral’s command-line coding agent brings repository context, file tools, and command execution into a conversational development workflow.

License / terms
Apache-2.0 · harness
Where it runs
Local terminal + configured model endpoint

Good for: Developers who want to inspect and configure their coding agent.

The heads-up & first step

The honest heads-up

Running the harness locally does not make model calls local. Check provider configuration, model costs, tool permissions, and telemetry settings.

Your first step

Try it in a small version-controlled project, review its proposed edits, and choose the model endpoint explicitly.

04
MCP servers & tools

Give your AI useful connections.

Model Context Protocol connects an AI client to tools and data. Here are real servers to run, plus a toolkit for building your own.

Model Context Protocol · open-source community

Filesystem & Git MCP

Connect an assistant to the work in front of you.

Open-source codeSelf-hostable

The MCP project’s Filesystem and Git servers expose file and repository operations to compatible clients. They are concrete examples of the protocol in action.

License / terms
MIT · reference servers
Where it runs
Local MCP servers

Good for: Learning MCP and testing a client against a dedicated folder or repository.

The heads-up & first step

The honest heads-up

These are reference implementations, not a production security guarantee. File and Git tools can change data; limit paths and permissions and review the current server documentation.

Your first step

Connect one server to an MCP-capable client using a disposable test directory.

Germany · Qdrant Solutions GmbH

Qdrant MCP Server

Give your agent a searchable memory.

EU companyOpen-source codeSelf-hostable

Qdrant’s official MCP server lets compatible assistants store and retrieve information through vector search. Connect it to a Qdrant instance you operate or a hosted one.

License / terms
Apache-2.0
Where it runs
MCP server + local or hosted Qdrant

Good for: Agents that need to recall notes and retrieve relevant context.

The heads-up & first step

The honest heads-up

The server needs storage and an embedding setup. A local MCP process is only one part of the data path; check where embeddings and the database run.

Your first step

Index a small set of non-sensitive notes and test retrieval before connecting it to a larger collection.

Germany · deepset

Hayhooks

Turn your own AI workflow into an MCP tool.

EU companyOpen-source codeSelf-hostable

Expose Haystack pipelines through REST endpoints and MCP. A practical bridge from an internal retrieval workflow to the assistants your team already uses.

License / terms
Apache-2.0
Where it runs
Your server + Haystack pipelines

Good for: Teams building reusable document search or question-answering tools.

The heads-up & first step

The honest heads-up

You still operate the service and its dependencies. Add authentication and suitable access controls before exposing internal data to clients.

Your first step

Wrap one working Haystack pipeline, then call it from a compatible MCP client.

Prefect · global open-source community

FastMCP

Build the connector you wish existed.

Open-source codeSelf-hostable

A Python toolkit for turning functions and resources into MCP interfaces. Build a server around your own application instead of waiting for a vendor integration.

License / terms
Apache-2.0
Where it runs
Python MCP servers & clients

Good for: Developers connecting internal tools and APIs to AI clients.

The heads-up & first step

The honest heads-up

This is a server-building toolkit, not a ready-made connector catalog. Your authentication, tool design, and downstream API permissions still matter.

Your first step

Expose one read-only function and test it locally before adding write operations.

05
Local & self-hosted

Your machine. Your inference.

The engines that actually run a model, from a laptop experiment to a GPU-backed service for a whole team.

Global open-source project

Ollama

Your first local model starts here.

Open-source codeSelf-hostable

Download supported models, run them locally, and connect applications through an API. An approachable way to try local inference on a computer you already own.

License / terms
MIT · runtime; model licenses vary
Where it runs
Desktop / your server

Good for: First local experiments and a model backend for personal tools.

The heads-up & first step

The honest heads-up

Choose a local model explicitly: cloud options also exist. Memory needs depend on the model and context; the runtime’s MIT license does not relicense its model catalog.

Your first step

Install from the official project and run a small supported model before connecting a chat interface.

ggml community · global open-source project

llama.cpp

Get closer to the metal.

Open-source codeSelf-hostable

Run supported language models through a C/C++ inference engine with quantization and multiple hardware backends. Includes a server for integrating local inference into applications.

License / terms
MIT · runtime
Where it runs
CPU / supported GPU / local server

Good for: Builders who want control over model files, hardware, and inference settings.

The heads-up & first step

The honest heads-up

Expect more configuration than a desktop app. GGUF is a file format, not a license or a promise that every model feature is supported.

Your first step

Use an official build for your hardware and a compatible GGUF model from a trusted publisher.

Global open-source project

vLLM

Turn model weights into a service.

Open-source codeSelf-hostable

An inference and serving engine built for efficient model execution and multiple requests. A useful foundation when a team needs a shared model endpoint.

License / terms
Apache-2.0
Where it runs
Your inference infrastructure

Good for: Engineers operating model inference on suitable server hardware.

The heads-up & first step

The honest heads-up

Hardware and model compatibility need checking. You own capacity planning, access control, monitoring, upgrades, and the infrastructure bill.

Your first step

Serve one supported model privately and benchmark realistic request sizes and concurrency.

06
Chat, data & RAG

Put your own knowledge to work.

A usable interface, document processing, and retrieval: the pieces that turn a model into an assistant for your actual work.

Mintplex Labs · global open-source project

AnythingLLM

Give your models a place to work.

Open-source codeSelf-hostable

A chat and document workspace that connects to local or hosted models. Bring documents into retrieval workflows without building the whole interface yourself.

License / terms
MIT · application
Where it runs
Desktop / self-hosted / hosted options

Good for: People who want a usable document assistant and a choice of model backend.

The heads-up & first step

The honest heads-up

Select both local generation and local embeddings if you want local processing. External providers and tools can still send data off the machine.

Your first step

Connect a local model, add one non-sensitive document, and check answers against the original.

Germany · Qdrant Solutions GmbH

Qdrant

Find the useful needle in your data haystack.

EU companyOpen-source codeSelf-hostable

A vector database for semantic search, with filtering and APIs for application integration. Use it to retrieve relevant context before a model writes its answer.

License / terms
Apache-2.0 · database
Where it runs
Self-hosted / managed cloud

Good for: Developers building RAG, semantic search, and agent memory.

The heads-up & first step

The honest heads-up

A vector database is not a language model. You still need embeddings, an ingestion pipeline, and permissions that match your source documents.

Your first step

Run a local instance and index a small collection with an embedding model you have chosen.

IBM Research Zurich origins · LF AI & Data

Docling

Your PDFs deserve better than copy-paste.

Open-source codeSelf-hostable

Parse documents into structured content for search and AI workflows, including PDF layouts, tables, and OCR. Local execution lets document preparation stay on your infrastructure.

License / terms
MIT · code; model licenses vary
Where it runs
Local document processing

Good for: Teams turning messy documents into material a retrieval system can use.

The heads-up & first step

The honest heads-up

OCR and layout extraction need checking on real documents. Included or optional models have their own licenses. Swiss origins do not mean EU company status.

Your first step

Convert a representative PDF and inspect its tables and reading order before indexing it.

THE QUESTIONS BEHIND THE HYPE

Let’s keep it honest.

Can I really keep everything local?

Yes, with a compatible local model, local embeddings, local storage, and tools that stay on your machine. Downloading an app is only the first step: inspect its provider settings and external connections. A local interface connected to a hosted API still sends requests to that provider.

Is a European provider automatically private?

Its company location tells you only part of the story. Look at where your selected service processes and stores data, its retention and training terms, and any external tools it calls. This directory identifies options; it does not certify a deployment.

How much hardware do I need?

It depends on model size, quantization, context length, and concurrent users. Start with a small model supported by your runtime and measure it on your machine. A quantized model may use less memory, with trade-offs in quality. Shared services and larger models often call for GPU infrastructure.

Does open source mean free AI?

It gives you permissions under a license. Hardware, electricity, hosted inference, support, and your time still cost something. Check the software license and the model license separately, especially for commercial use.

Do MCP servers make any model into an agent?

No. You need a compatible client or harness to discover and call the tools, plus a model and workflow capable of using them. A server supplies an interface; it does not decide what an agent should do. Begin with a narrow tool set and review consequential actions.

Why these projects, and where are the sources?

This is an editorial starting point selected for practical usefulness, EU provider options, inspectable software, and control over deployment. It is not exhaustive or a benchmark ranking. Each entry links to official documentation, repositories, or model cards, checked on September 23, 2026. Named model versions make licensing specific; they are not a claim to be the latest release. No paid placements or affiliate links.

THE NEXT MOVE IS YOURS

Less lock-in.
More building.

Try one model. Connect one tool. Move one workflow.
You don’t need to rebuild everything to take back some control.

Choose your starting point ↗Explore everyday software too ↗