Supported Large Language Models

Chat and Commands

Cody supports a variety of cutting edge large language models for use in Chat and Commands, allowing you to select the best model for your use case. Free users are defaulted to the Claude 3 Sonnet model from Anthropic, while Pro users have access to select any supported model.

Autocomplete

Cody uses a set of models for autocomplete which are suited for the low latency use case.

Input and output token limits

For all models, Cody allows up to 4,000 tokens of output, which is approximately 500-600 lines of code.

For Claude 3 Sonnet or Opus models users, Cody supports up to 30,000 tokens (~4,000 lines of code) of user-defined context through @-mention syntax and 15,000 tokens of continued chat history (user queries + system responses). All other models are currently capped at 7,000 tokens of shared context between user-defined context and chat history.

Here's a detailed breakdown of the token limits by model:

For more information on how Cody builds context, see our documentation here.