AI Models

The AI Models page displays all the models that you’ve downloaded from the Model Catalog or are currently downloading in a table format. Different quantization files for the same model appear on separate rows in the table.

From the Models table, you can start a new chat with a model, launch an API server, manage downloads, and delete a model. Selecting a model lets you view its details.

Prefer working on the command line? Use the Anaconda AI CLI to manage your models.

Viewing model details

Select a model to display detailed information such as supported languages, parameter count, context window size, and more. The details page also includes links to related documentation, license information, and acceptable use policies.

From the details page, you can also select Try Model to start a new chat with the model or select Start Server to create a new API server with the model and quantization level pre-loaded.

To download a different quantization for the model, use the Quantization dropdown field to select the quantization level, then select Download.

Managing downloads

From the Models table, you can pause, play, or cancel a downloading model.

Deleting models

To delete a model that you have downloaded, select Actions, then select Delete.

Models cannot be deleted while they’re loaded into the API server. On the Model Servers page, select Stop Server to unload a model.