Try Different LLMs

Agentic RAG offers a variety of LLMs to choose from. You can select the one that best fits your needs and use it to generate answers to your questions.

Note that all third-party LLMs available through Agentic RAG are subject to the terms and conditions that the LLM provider may identify as applicable, which you agree to by using their model. Hyperlinks below are provided for reference only, and you should review the provider’s website(s) for then-current versions and more information regarding their applicable terms and conditions or any other terms or policies that the LLM provider may identify as applicable to your use of the LLM.

What are the available LLMs?

We strive to provide the latest advancements in the field of language models and offer the most popular and efficient LLMs, including:

OpenAI

• OpenAI GPT-4
• OpenAI GPT-4o
• OpenAI GPT-4o Mini
• OpenAI o1
• OpenAI o3
• OpenAI o3 Mini
• OpenAI o4 Mini
• OpenAI GPT-4.1
• OpenAI GPT-5
• OpenAI GPT-5 Mini
• OpenAI GPT-5 Nano
• OpenAI GPT-5 Chat
• OpenAI API Compatible Model

https://openai.com/policies/row-terms-of-use/

https://openai.com/policies/

OpenAI – Azure

• OpenAI + Azure GPT-4o
• OpenAI + Azure GPT-4o Mini
• OpenAI + Azure o1
• OpenAI + Azure o3
• OpenAI + Azure o3 Mini
• OpenAI + Azure o4 Mini
• OpenAI + Azure GPT-5
• OpenAI + Azure GPT-5 Mini
• OpenAI + Azure GPT-5 Nano
• OpenAI + Azure GPT-5 Chat
• Azure GPT OSS 120B

https://azure.microsoft.com/en-us/support/legal/

https://openai.com/policies/row-terms-of-use/

https://openai.com/policies/

Anthropic

• Anthropic Claude 4 Sonnet
• Anthropic Claude 4 Opus
• Anthropic Claude 4.5 Sonnet
• Anthropic Claude 4.5 Haiku
• Anthropic Claude 4.6 Sonnet
• Anthropic Claude 4.6 Opus

https://www.anthropic.com/legal/consumer-terms

https://www-cdn.anthropic.com/471bd07290603ee509a5ea0d5ccf131ea5897232/anthropic-vertex-commercial-terms-march-2024.pdf

https://cloud.google.com/terms

Anthropic - GCP

• Anthropic + GCP Claude 3.7 Sonnet
• Anthropic + GCP Claude 4.5 Sonnet
• Anthropic + GCP Claude 4.5 Haiku
• Anthropic + GCP Claude 4.6 Sonnet
• Anthropic + GCP Claude 4.6 Opus

https://www.anthropic.com/legal/consumer-terms

https://www-cdn.anthropic.com/471bd07290603ee509a5ea0d5ccf131ea5897232/anthropic-vertex-commercial-terms-march-2024.pdf

https://cloud.google.com/terms

Anthropic – AWS

• Anthropic + AWS Bedrock Claude 3.7 Sonnet
• Anthropic + AWS Bedrock Claude 4 Sonnet
• Anthropic + AWS Bedrock Claude 4 Opus
• Anthropic + AWS Bedrock Claude 4.1 Opus
• Anthropic + AWS Bedrock Claude 4.5 Sonnet
• Anthropic + AWS Bedrock Claude 4.5 Haiku
• Anthropic + AWS Bedrock Claude 4.6 Sonnet
• Anthropic + AWS Bedrock Claude 4.6 Opus

https://www.anthropic.com/legal/consumer-terms

https://aws.amazon.com/service-terms/

https://aws.amazon.com/legal/bedrock/third-party-models/

Gemini - GCP

• Google Gemini 2.0 Flash Lite
• Google Gemini 2.0 Flash
• Google Gemini 2.5 Flash Lite
• Google Gemini 2.5 Flash
• Google Gemini 2.5 Pro
• Google Gemini 3.1 Pro Preview (Global)

https://cloud.google.com/terms

Hugging Face

• Hugging Face

https://huggingface.co/terms-of-service

Llama

• Llama 4 Maverick 17B 128E Instruct
• Llama 4 Scout 17B 16E Instruct

https://www.llama.com/llama4/license/

https://cloud.google.com/terms

Deepseek - Azure

• Deepseek + Azure R1

https://azure.microsoft.com/en-us/support/legal/

https://cdn.deepseek.com/policies/en-US/deepseek-terms-of-use.html

Amazon – AWS

• Amazon Nova Pro
• Amazon Nova Premier

https://aws.amazon.com/service-terms/