Skip to main content

Try Different LLMs

Agentic RAG offers a variety of LLMs to choose from. You can select the one that best fits your needs and use it to generate answers to your questions.

Note that all third-party LLMs available through Agentic RAG are subject to the terms and conditions that the LLM provider may identify as applicable, which you agree to by using their model. Hyperlinks below are provided for reference only, and you should review the provider’s website(s) for then-current versions and more information regarding their applicable terms and conditions or any other terms or policies that the LLM provider may identify as applicable to your use of the LLM.

What are the available LLMs?

We strive to provide the latest advancements in the field of language models and offer the most popular and efficient LLMs, including:

OpenAI

  • GPT-4o
  • GPT-4o Mini
  • o1
  • o3
  • o3 Mini
  • o4 Mini
  • GPT-4.1
  • GPT-5
  • GPT-5 Mini
  • GPT-5 Nano
  • GPT-5 Chat (Latest)
  • GPT-5.5
  • GPT-5.4 Mini
  • GPT-5.6 Sol
  • GPT-5.6 Terra
  • GPT-5.6 Luna

https://openai.com/policies/row-terms-of-use/

https://openai.com/policies/

OpenAI – Azure

  • GPT-4o
  • GPT-4o Mini
  • o1
  • o3 Mini
  • o3
  • o4 Mini
  • GPT-5
  • GPT-5 Mini
  • GPT-5 Nano
  • GPT-5 Chat
  • GPT-5.5
  • GPT-5.4 Mini
  • GPT-5.6 Sol
  • GPT-5.6 Terra
  • GPT-5.6 Luna
  • DeepSeek R1
  • Azure GPT OSS 120B

https://azure.microsoft.com/en-us/support/legal/

https://openai.com/policies/row-terms-of-use/

https://openai.com/policies/

Anthropic

  • Claude 4.5 Sonnet
  • Claude 4.6 Opus
  • Claude 4.6 Sonnet
  • Claude 4.5 Haiku
  • Claude 4.7 Opus
  • Claude 5 Sonnet
  • Claude 5 Fable
  • Claude 4.8 Opus
  • Claude 4.1 Opus

https://www.anthropic.com/legal/consumer-terms

https://www-cdn.anthropic.com/471bd07290603ee509a5ea0d5ccf131ea5897232/anthropic-vertex-commercial-terms-march-2024.pdf

https://cloud.google.com/terms

Anthropic - GCP

  • Claude 4.5 Sonnet
  • Claude 4.5 Haiku
  • Claude 4.6 Sonnet
  • Claude 4.6 Opus
  • Claude 4.7 Opus
  • Claude 5 Sonnet
  • Claude 4.8 Opus

https://www.anthropic.com/legal/consumer-terms

https://www-cdn.anthropic.com/471bd07290603ee509a5ea0d5ccf131ea5897232/anthropic-vertex-commercial-terms-march-2024.pdf

https://cloud.google.com/terms

Anthropic – AWS

  • Claude 4.1 Opus
  • Claude 4.5 Sonnet
  • Claude 4.5 Haiku
  • Claude 4.6 Sonnet
  • Claude 4.6 Opus
  • Claude 4.7 Opus
  • Claude 5 Sonnet
  • Claude 5 Fable
  • Claude 4.8 Opus

https://www.anthropic.com/legal/consumer-terms

https://aws.amazon.com/service-terms/

https://aws.amazon.com/legal/bedrock/third-party-models/

Gemini - GCP

  • Gemini 2.5 Pro
  • Gemini 2.5 Flash
  • Gemini 2.5 Flash Lite
  • Gemini 3.1 Pro Preview (Global)
  • Gemini 3.5 Flash
  • Gemini 3.1 Flash-Lite

https://cloud.google.com/terms

Vertex OpenAI comptible models

  • OpenAI API Compatible Model
  • Azure GPT OSS 120B
  • GLM 5 (Global)
  • Gemma 4 26B A4B

https://cloud.google.com/terms

Hugging Face

  • Hugging Face

https://huggingface.co/terms-of-service

Llama

  • Llama 4 Maverick 17B 128E Instruct
  • Llama 4 Scout 17B 16E Instruct
  • GLM 5 (Global)

https://www.llama.com/llama4/license/

https://cloud.google.com/terms

Deepseek - Azure

  • DeepSeek R1

https://azure.microsoft.com/en-us/support/legal/

https://cdn.deepseek.com/policies/en-US/deepseek-terms-of-use.html

Amazon – AWS

  • Amazon Nova Premier
  • Amazon Nova Pro

https://aws.amazon.com/service-terms/