Best free embedding & LLM API for RAG

RAG needs two things: an embedding model to index your documents and a chat model to answer. Cohere’s free trial key gives you best-in-class Embed v4 and Rerank, while Cloudflare and Scaleway offer free BGE embeddings. Pair them with a free chat model like Gemini Flash or Llama 3.3 for the generation step.

Top pick
Cohere

Free trial keys for Command models, embeddings and rerank.

Recommended free providers

Tips

  • Cohere Embed v4 + Rerank v3.5 is the strongest free retrieval stack.
  • Keep embeddings and generation on separate providers to stay within each free tier.
  • Re-rank your top-k results before sending them to the LLM for better answers.

FAQ

Best free embedding & LLM API for RAG?+

Cohere is our top pick — Free trial keys for Command models, embeddings and rerank. The full ranked list with setup and limits is below.

Do I need a credit card?+

Most picks here need no credit card. Each provider card shows a “No card” badge when a card is not required to start.

Are these APIs OpenAI-compatible?+

Yes — every recommended provider exposes an OpenAI Chat Completions compatible endpoint, so you change only the base URL and key in your existing code.