Downloading a Model for AI Applications with Podman Desktop

Podman Desktop makes it easy to work with AI applications through its AI Lab extension. In this guide, we’ll walk you through the process of downloading AI models to get started.

Prerequisites

Before you begin, make sure you have:

• Podman Desktop installed
• A running Podman machine with at least 6 GB of memory
• The Podman AI Lab extension installed

Downloading a Model

1. Click AI Lab in the left navigation pane.
2. In the Catalog section, click the Download icon corresponding to the model you want to use.
3. View the downloaded model on the same page after the download completes. That’s it! You can now use the downloaded model to create AI services, experiment in playgrounds, or run AI recipes.

Next Steps

• Create a Service: Set up an inference server to serve your model via an OpenAI-compatible API
• Create a Playground: Experiment with model parameters to find the best configuration
• Run a Recipe: Start a complete AI application like a ChatBot