Try Different LLMs
Agentic RAG offers a variety of LLMs to choose from. You can select the one that best fits your needs and use it to generate answers to your questions.
Note that all third-party LLMs available through Agentic RAG are subject to the terms and conditions that the LLM provider may identify as applicable, which you agree to by using their model. Hyperlinks below are provided for reference only, and you should review the provider’s website(s) for then-current versions and more information regarding their applicable terms and conditions or any other terms or policies that the LLM provider may identify as applicable to your use of the LLM.
What are the available LLMs?
We strive to provide the latest advancements in the field of language models and offer the most popular and efficient LLMs, including:
OpenAI
- OpenAI ChatGTP-4
- OpenAI ChatGTP-4o
- OpenAI ChatGTP-4o-mini
- OpenAI o1
- OpenAI o3
- OpenAI o3-mini
- OpenAI o4-mini
- OpenAI ChatGPT-4.1
- OpenAI ChatGPT-5
- OpenAI ChatGPT-5 Mini
- OpenAI ChatGPT-5 Nano
- OpenAI ChatGPT-5 Chat
- OpenAI API Compatible Model
https://openai.com/policies/row-terms-of-use/
OpenAI – Azure
- OpenAI + Azure ChatGPT-4o
- OpenAI + Azure ChatGPT-4o-mini
- OpenAI + Azure ChatGPT-o1
- OpenAI + Azure ChatGPT-o3-mini
- OpenAI + Azure ChatGPT-5
- OpenAI + Azure ChatGPT-5 Mini
- OpenAI + Azure ChatGPT-5 Chat
- OpenAI + Azure ChatGPT-5 Nano
- Azure gpt-oss 120B
https://azure.microsoft.com/en-us/support/legal/
https://openai.com/policies/row-terms-of-use/
Anthropic
- Anthropic Claude 3 Opus
- Anthropic Claude 3.5 Sonnet
- Anthropic Claude 4 Opus
- Anthropic Claude 4 Sonnet
- Anthropic Claude 4.5 Sonnet
- Anthropic Claude 3.5 Haiku
https://www.anthropic.com/legal/consumer-terms
https://cloud.google.com/terms
Anthropic - GCP
- Anthropic + GCP Claude 3.5 Sonnet v2
- Anthropic + GCP Claude 3.7 Sonnet
- Anthropic + GCP Claude 4.5 Sonnet
https://www.anthropic.com/legal/consumer-terms
https://cloud.google.com/terms
Anthropic – AWS
- Anthropic + AWS Bedrock Claude 3.7 Sonnet
- Anthropic + AWS Bedrock Claude 4 Sonnet
- Anthropic + AWS Bedrock Claude 4.5 Sonnet
- Anthropic + AWS Bedrock Claude 4 Opus
- Anthropic + AWS Bedrock Claude 4.1 Opus
https://www.anthropic.com/legal/consumer-terms
https://aws.amazon.com/service-terms/
https://aws.amazon.com/legal/bedrock/third-party-models/
Gemini - GCP
- Google Gemini Flash 2.0 Lite
- Google Gemini Flash 2.0
- Google Gemini Flash 2.5 Lite
- Google Gemini Flash 2.5
- Google Gemini Pro 2.5 https://cloud.google.com/terms
Hugging Face
- Hugging Face https://huggingface.co/terms-of-service
Llama
- Llama 4 Maverick (BETA)
- Llama 4 Scout (BETA)
- Vertex Llama 3.2 90B (BETA)
https://www.llama.com/llama3_2/license/
https://www.llama.com/llama4/license/
https://cloud.google.com/terms
Mistral - Azure
- Mistral + Azure Mistral Large 2
https://azure.microsoft.com/en-us/support/legal/ https://mistral.ai/terms#terms-of-service
Deepseek -Azure
- Deepseek + Azure R1
https://azure.microsoft.com/en-us/support/legal/
https://cdn.deepseek.com/policies/en-US/deepseek-terms-of-use.html