Chat models
info
If you'd like to write your own chat model, see this how-to. If you'd like to contribute an integration, see Contributing integrations.
Featured Providersโ
info
While all these LangChain classes support the indicated advanced feature, you may have to open the provider-specific documentation to learn which hosted models or backends support the feature.
| Provider | Tool calling | Structured output | JSON mode | Local | Multimodal | Package | 
|---|---|---|---|---|---|---|
| ChatAnthropic | โ | โ | โ | โ | โ | langchain-anthropic | 
| ChatMistralAI | โ | โ | โ | โ | โ | langchain-mistralai | 
| ChatFireworks | โ | โ | โ | โ | โ | langchain-fireworks | 
| AzureChatOpenAI | โ | โ | โ | โ | โ | langchain-openai | 
| ChatOpenAI | โ | โ | โ | โ | โ | langchain-openai | 
| ChatTogether | โ | โ | โ | โ | โ | langchain-together | 
| ChatVertexAI | โ | โ | โ | โ | โ | langchain-google-vertexai | 
| ChatGoogleGenerativeAI | โ | โ | โ | โ | โ | langchain-google-genai | 
| ChatGroq | โ | โ | โ | โ | โ | langchain-groq | 
| ChatCohere | โ | โ | โ | โ | โ | langchain-cohere | 
| ChatBedrock | โ | โ | โ | โ | โ | langchain-aws | 
| ChatHuggingFace | โ | โ | โ | โ | โ | langchain-huggingface | 
| ChatNVIDIA | โ | โ | โ | โ | โ | langchain-nvidia-ai-endpoints | 
| ChatOllama | โ | โ | โ | โ | โ | langchain-ollama | 
| ChatLlamaCpp | โ | โ | โ | โ | โ | langchain-community | 
| ChatAI21 | โ | โ | โ | โ | โ | langchain-ai21 | 
| ChatUpstage | โ | โ | โ | โ | โ | langchain-upstage | 
All chat modelsโ
| Label | Description | 
|---|---|
| AI21 Labs | Overview | 
| Alibaba Cloud PAI EAS | Alibaba Cloud PAI (Platform for AI) is a lightweight and cost-efficie... | 
| Anthropic | This notebook provides a quick overview for getting started with Anth... | 
| [Deprecated] Experimental Anthropic Tools Wrapper | The Anthropic API officially supports tool-calling so this workaround... | 
| Anyscale | This notebook demonstrates the use of langchain.chat_models.ChatAnysc... | 
| Azure OpenAI | This guide will help you get started with AzureOpenAI chat models. Fo... | 
| Azure ML Endpoint | Azure Machine Learning is a platform used to build, train, and deploy... | 
| Baichuan Chat | Baichuan chat models API by Baichuan Intelligent Technology. For more... | 
| Baidu Qianfan | Baidu AI Cloud Qianfan Platform is a one-stop large model development... | 
| AWS Bedrock | This doc will help you get started with AWS Bedrock chat models. Amaz... | 
| Cohere | This notebook covers how to get started with Cohere chat models. | 
| Coze Chat | ChatCoze chat models API by coze.com. For more information, see https... | 
| Dappier AI | Dappier: Powering AI with Dynamic, Real-Time Data Models | 
| Databricks | Databricks Lakehouse Platform unifies data, analytics, and AI on one ... | 
| DeepInfra | DeepInfra is a serverless inference as a service that provides access... | 
| Eden AI | Eden AI is revolutionizing the AI landscape by uniting the best AI pr... | 
| Ernie Bot Chat | ERNIE-Bot is a large language model developed by Baidu, covering a hu... | 
| EverlyAI | EverlyAI allows you to run your ML models at scale in the cloud. It a... | 
| Fireworks | This doc help you get started with Fireworks AI chat models. For deta... | 
| Friendli | Friendli enhances AI application performance and optimizes cost savin... | 
| GigaChat | This notebook shows how to use LangChain with GigaChat. | 
| Google AI | This docs will help you get started with Google AI chat models. For d... | 
| Google Cloud Vertex AI | This page provides a quick overview for getting started with VertexAI... | 
| GPTRouter | GPTRouter is an open source LLM API Gateway that offers a universal A... | 
| Groq | This will help you getting started with Groq chat models. For detaile... | 
| ChatHuggingFace | This will help you getting started with langchainhuggingface chat mod... | 
| IBM watsonx.ai | ChatWatsonx is a wrapper for IBM watsonx.ai foundation models. | 
| JinaChat | This notebook covers how to get started with JinaChat chat models. | 
| Kinetica | This notebook demonstrates how to use Kinetica to transform natural l... | 
| Konko | Konko API is a fully managed Web API designed to help application dev... | 
| LiteLLM | LiteLLM is a library that simplifies calling Anthropic, Azure, Huggin... | 
| LiteLLM Router | LiteLLM is a library that simplifies calling Anthropic, Azure, Huggin... | 
| Llama 2 Chat | This notebook shows how to augment Llama-2 LLMs with the Llama2Chat w... | 
| Llama API | This notebook shows how to use LangChain with LlamaAPI - a hosted ver... | 
| LlamaEdge | LlamaEdge allows you to chat with LLMs of GGUF format both locally an... | 
| ChatLlamaCpp | This notebook provides a quick overview for getting started with chat... | 
| maritalk | Introduction | 
| MiniMax | Minimax is a Chinese startup that provides LLM service for companies ... | 
| MistralAI | This will help you getting started with Mistral chat models. For deta... | 
| MLX | This notebook shows how to get started using MLX LLM's as chat models. | 
| Moonshot | Moonshot is a Chinese startup that provides LLM service for companies... | 
| NVIDIA AI Endpoints | This will help you getting started with NVIDIA chat models. For detai... | 
| OCIGenAI | This notebook provides a quick overview for getting started with OCIG... | 
| ChatOctoAI | OctoAI offers easy access to efficient compute and enables users to i... | 
| Ollama | Ollama allows you to run open-source large language models, such as L... | 
| Ollama Functions | This was an experimental wrapper that attempts to bolt-on tool callin... | 
| OpenAI | This notebook provides a quick overview for getting started with Open... | 
| Perplexity | This notebook covers how to get started with Perplexity chat models. | 
| PremAI | PremAI is an all-in-one platform that simplifies the creation of robu... | 
| PromptLayer ChatOpenAI | This example showcases how to connect to PromptLayer to start recordi... | 
| Snowflake Cortex | Snowflake Cortex gives you instant access to industry-leading large l... | 
| solar | Related | 
| SparkLLM Chat | SparkLLM chat models API by iFlyTek. For more information, see iFlyTe... | 
| Tencent Hunyuan | Tencent's hybrid model API (Hunyuan API) | 
| Together | This page will help you get started with Together AI chat models. For... | 
| Tongyi Qwen | Tongyi Qwen is a large language model developed by Alibaba's Damo Aca... | 
| Upstage | This notebook covers how to get started with Upstage chat models. | 
| vLLM Chat | vLLM can be deployed as a server that mimics the OpenAI API protocol.... | 
| Volc Enging Maas | This notebook provides you with a guide on how to get started with vo... | 
| YandexGPT | This notebook goes over how to use Langchain with YandexGPT chat mode... | 
| ChatYI | This will help you getting started with Yi chat models. For detailed ... | 
| Yuan2.0 | This notebook shows how to use YUAN2 API in LangChain with the langch... | 
| ZHIPU AI | This notebook shows how to use ZHIPU AI API in LangChain with the lan... |