> ## Documentation Index
> Fetch the complete documentation index at: https://anaconda.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Deploy a model from the model catalog

The fastest way to serve a model on Anaconda Platform is to deploy it directly from the model catalog. Deployments from the catalog serve the model as-is, with no application logic around it, which makes them well suited for evaluating and comparing models before you commit to one.

The platform packages the model into a long-running service, schedules it on an inference compute pool, and gives you an authenticated API endpoint and a built-in chat interface to try it out, with no code or configuration files required.

To build a service around a model instead, see [Writing your first deployment](https://anaconda.com/docs/platform/guides/inference/writing-your-first-deployment.md). For background on how deployments work, see [What is a deployment?](https://anaconda.com/docs/platform/concepts/what-is-deployment.md)

For more inference patterns, including CLI-based deployment for vLLM (safetensors) models and the `@vllm` and `@llamacpp` decorators, see the inference examples repository:

## Deploying a model

1. In the left-hand navigation, select  **Resources**, then select **Models**.

2. Confirm the context picker shows the perimeter you want to deploy into. The model catalog shows the models available in your current perimeter, as determined by that perimeter's model policies.

   ![The perimeter context picker open on the model details page, showing the default perimeter selected](https://mintcdn.com/anaconda-29683c67/cwLLt5dtVRvj7OPF/images/platform/plat_deploy_model_perimeter.png?fit=max\&auto=format\&n=cwLLt5dtVRvj7OPF\&q=85\&s=9ce0b58af88950fcaf0583ed4e28c4cd)

3. Select a model from the list to open its details page.

4. Click  **Deploy Model**.

   ![The model details page with the Deploy Model button](https://mintcdn.com/anaconda-29683c67/cwLLt5dtVRvj7OPF/images/platform/plat_deploy_model_button.png?fit=max\&auto=format\&n=cwLLt5dtVRvj7OPF\&q=85\&s=888c2a13bba39bf9779a3768628bb2a2)

5. In the Deploy model dialog, confirm the **Project** context for the deployment.

6. Under **Resources**, set the CPU, memory, and disk for the deployment. Use the model's **file size** and **estimated RAM** values shown under the selected file as a guide. Memory must exceed the estimated RAM, and disk must exceed the file size with room for the serving runtime.

7. Select a compute pool for the deployment, or leave the selection empty to let the platform schedule it on the best-fitting pool. If no compute pool can manage your requested resources, choose a smaller model file or reduce the values for the resources you are requesting.

   ![The Deploy model dialog showing Project, Model, and File fields with resource inputs for CPU, memory, disk, GPU, and shared memory, and a list of compute pools](https://mintcdn.com/anaconda-29683c67/VD0yQ0tXYWIdTsBU/images/platform/plat_deploy_model_details.png?fit=max\&auto=format\&n=VD0yQ0tXYWIdTsBU\&q=85\&s=d34c9db3bdcb88a2e3be9c7de40855b1)

8. Click **Create**.

The platform opens the  **Deployments** view. The deployment registers within a few seconds, then takes several minutes to provision and start.

> [!NOTE]
>
> If the Deployments view shows "Deployment not found" immediately after creating a deployment, refresh the page. The deployment list updates as the platform registers the new deployment.

## Accessing the deployment

When the deployment is ready, it appears in the Deployments list with a green status indicator. Select it to open the details view, which shows:

* The **API endpoint URL**, labeled "available at". This is the endpoint your applications call.
* **Additional UI routes**. For certain model file types (`.gguf` models served with `llamacpp`), this includes a built-in chat interface for trying the model interactively. Safetensors models served with vLLM expose the API endpoint only. Both the endpoint and the chat UI require visitors to be signed in to the platform.
* The serving image, compute pool, and resources the deployment is running with.
* Charts for requests per minute and autoscaling activity.

![The deployment details view for a deployed model showing the endpoint URL, additional UI routes, serving image, compute pool, and requests per minute chart](https://mintcdn.com/anaconda-29683c67/VD0yQ0tXYWIdTsBU/images/platform/plat_deployments_model_details.png?fit=max\&auto=format\&n=VD0yQ0tXYWIdTsBU\&q=85\&s=bb7fc7404f0e8f7738029bc1668adb84)

The deployment name gets a random suffix (for example, `gemma-2-2b-it-dm2kkh`) so you can deploy the same model more than once without name conflicts.

## Trying the model

The deployment's API endpoint is the primary interface: send requests to the endpoint URL with your application or tools like `curl`. For gguf models served with llamacpp, the deployment also includes a built-in chat interface.

To open it, click the **Additional UI routes** link in the deployment details. You will be asked to sign in if you are not already signed in. From the chat UI, you can send messages to the model and inspect its responses without writing any code. Each response shows its token count, latency, and throughput in tokens per second, which gives you a quick read on how the deployment performs under your sizing choices.

> [!NOTE]
>
> The chat interface is available only for `.gguf` models served with `llamacpp`. Safetensors models served with `vLLM` expose the API endpoint only.

![The chat interface for a deployed model showing a message input field with the model name](https://mintcdn.com/anaconda-29683c67/VD0yQ0tXYWIdTsBU/images/platform/plat_deployed_model_chat.png?fit=max\&auto=format\&n=VD0yQ0tXYWIdTsBU\&q=85\&s=2d7e743dd87c910c6ead85ee3ba57b6f)

## Suspending and resuming the deployment

Suspending a deployment scales its workers down to zero, which stops it from consuming compute while retaining its configurations and endpoint. You can resume it later without redeploying, which makes suspension good for deployments that are used intermittently.

To suspend a deployment:

1. Select the deployment in the **Deployments** list to open its details view.
2. Click **Actions**, then select *Suspend*.

   ![The deployment details view with the Actions dropdown open, showing Suspend and Delete options](https://mintcdn.com/anaconda-29683c67/hOY2_eACHXD72vxX/images/platform/plat_deployment_actions_suspend.png?fit=max\&auto=format\&n=hOY2_eACHXD72vxX\&q=85\&s=d57c7d8ab54f96368a50e1d3201b836a)

   > [!NOTE]
   >
   > While the platform processes the request, the **Actions** button shows "Suspending...". Once suspended, the deployment's status shows Suspended in place of its usual health status.

Resuming a deployment scales its workers back up to the configured number, which takes some time to become ready to serve traffic again.

To resume a deployment:

1. Select the deployment in the **Deployments** list to open its details view.
2. Click **Actions**, then select *Resume*.

> [!TIP]
>
> You can also [suspend](https://anaconda.com/docs/platform/cli/app/suspend.md) and [resume](https://anaconda.com/docs/platform/cli/app/resume.md) deployments from the CLI.

## Deleting the deployment

Deployments can be deleted when you no longer need them. Deleting a deployment removes it from the platform, including its endpoint and configurations. You can delete deployments from the UI or the CLI.

Deletion is asynchronous. The deployment might show a terminating state briefly before it disappears from the list.

To tear down a deployment you no longer need:

1. Select the deployment in the **Deployments** list to open its details view.
2. Click **Actions**, then select *Delete*.
3. Click **Delete** in the dialog to confirm.

> [!WARNING]
>
> Deleting a deployment is irreversible. If you might need the deployment again later, consider suspending it instead.

> [!TIP]
>
> You can also [delete](https://anaconda.com/docs/platform/cli/app/delete.md) deployments from the CLI.

## Next steps

* To deploy a custom service (such as a FastAPI app or a fine-tuned model) instead of a catalog model, see [Writing your first deployment](https://anaconda.com/docs/platform/guides/inference/writing-your-first-deployment.md).
* For an in-depth look at deployment configuration options, see [Deployments deep dive](https://anaconda.com/docs/platform/guides/inference/deployments-deep-dive.md).
* To manage deployments from the command line, see the [Deployments CLI reference](https://anaconda.com/docs/platform/cli/app/deploy.md).