Try Different LLMs
Agentic RAG offers a variety of LLMs to choose from. You can select the one that best fits your needs and use it to generate answers to your questions.
Note that all third-party LLMs available through Agentic RAG are subject to the terms and conditions that the LLM provider may identify as applicable, which you agree to by using their model. Hyperlinks below are provided for reference only, and you should review the provider’s website(s) for then-current versions and more information regarding their applicable terms and conditions or any other terms or policies that the LLM provider may identify as applicable to your use of the LLM.
What are the available LLMs?
We strive to provide the latest advancements in the field of language models and offer the most popular and efficient LLMs.
The models below are grouped by provider, and each entry includes the model ID to use when configuring API requests:
OpenAI
- GPT-4o -
chatgpt4o - GPT-4o Mini -
chatgpt4o-mini - o1 -
chatgpt-o1 - o3 -
chatgpt-o3 - o3 Mini -
chatgpt-o3-mini - o4 Mini -
chatgpt-o4-mini - GPT-4.1 -
chatgpt-4.1 - GPT-5 -
chatgpt-5 - GPT-5 Mini -
chatgpt-5-mini - GPT-5 Nano -
chatgpt-5-nano - GPT-5.5 -
chatgpt-5.5 - GPT-5.4 Mini -
chatgpt-5.4-mini - GPT-5.6 Sol -
chatgpt-5.6-sol - GPT-5.6 Terra -
chatgpt-5.6-terra - GPT-5.6 Luna -
chatgpt-5.6-luna
https://openai.com/policies/row-terms-of-use/
Azure
- GPT-4o -
chatgpt-azure-4o - GPT-4o Mini -
chatgpt-azure-4o-mini - o1 -
chatgpt-azure-o1 - o3 Mini -
chatgpt-azure-o3-mini - o3 -
chatgpt-azure-o3 - o4 Mini -
chatgpt-azure-o4-mini - GPT-5 -
chatgpt-azure-5 - GPT-5 Mini -
chatgpt-azure-5-mini - GPT-5 Nano -
chatgpt-azure-5-nano - GPT-5.5 -
chatgpt-azure-5.5 - GPT-5.4 Mini -
chatgpt-azure-5.4-mini - GPT-5.6 Sol -
chatgpt-azure-5.6-sol - GPT-5.6 Terra -
chatgpt-azure-5.6-terra - GPT-5.6 Luna -
chatgpt-azure-5.6-luna - Azure GPT OSS 120B -
azure-gpt-oss-120b
https://azure.microsoft.com/en-us/support/legal/
https://openai.com/policies/row-terms-of-use/
https://cdn.deepseek.com/policies/en-US/deepseek-terms-of-use.html
Anthropic
- Claude 4.5 Sonnet -
claude-4-5-sonnet - Claude 4.6 Opus -
claude-4-6-opus - Claude 4.6 Sonnet -
claude-4-6-sonnet - Claude 4.5 Haiku -
claude-4-5-haiku - Claude 4.7 Opus -
claude-4-7-opus - Claude 5 Sonnet -
claude-5-sonnet - Claude 5 Fable -
claude-5-fable - Claude 4.8 Opus -
claude-4-8-opus
https://www.anthropic.com/legal/consumer-terms
https://cloud.google.com/terms
Anthropic - GCP
- Claude 4.5 Sonnet -
gcp-claude-4-5-sonnet - Claude 4.5 Haiku -
gcp-claude-4-5-haiku - Claude 4.6 Sonnet -
gcp-claude-4-6-sonnet - Claude 4.6 Opus -
gcp-claude-4-6-opus - Claude 4.7 Opus -
gcp-claude-4-7-opus - Claude 5 Sonnet -
gcp-claude-5-sonnet - Claude 4.8 Opus -
gcp-claude-4-8-opus
https://www.anthropic.com/legal/consumer-terms
https://cloud.google.com/terms
Anthropic – AWS
- Claude 4.1 Opus -
aws-claude-4-1-opus - Claude 4.5 Sonnet -
aws-claude-4-5-sonnet - Claude 4.5 Haiku -
aws-claude-4-5-haiku - Claude 4.6 Sonnet -
aws-claude-4-6-sonnet - Claude 4.6 Opus -
aws-claude-4-6-opus - Claude 4.7 Opus -
aws-claude-4-7-opus - Claude 5 Sonnet -
aws-claude-5-sonnet - Claude 5 Fable -
aws-claude-5-fable - Claude 4.8 Opus -
aws-claude-4-8-opus
https://www.anthropic.com/legal/consumer-terms
https://aws.amazon.com/service-terms/
https://aws.amazon.com/legal/bedrock/third-party-models/
Gemini - GCP
- Gemini 2.5 Pro -
gemini-2.5-pro - Gemini 2.5 Flash -
gemini-2.5-flash - Gemini 2.5 Flash Lite -
gemini-2.5-flash-lite - Gemini 3.1 Pro Preview (Global) -
gemini-3.1-pro - Gemini 3.5 Flash -
gemini-3.5-flash - Gemini 3.6 Flash -
gemini-3.6-flash - Gemini 3.1 Flash-Lite -
gemini-3.1-flash-lite
https://cloud.google.com/terms
Vertex AI - GCP
- Llama 4 Maverick 17B 128E Instruct -
llama-4-maverick-17b-128e-instruct-maas - Llama 4 Scout 17B 16E Instruct -
llama-4-scout-17b-16e-instruct-maas - GLM 5 (Global) -
gcp-glm-5
https://www.llama.com/llama4/license/
https://cloud.google.com/terms
Amazon – AWS
- Amazon Nova Premier -
nova-premier - Amazon Nova Pro -
nova-pro