Run Large Language Models locally with Podman AI Lab

Podman AI Lab is the easiest way to work with Large Language Models (LLMs) on your local developer workstation. Find a catalog of recipes, leverage a curated list of open source models, experiment and compare the models. Get ahead of the curve and take your development to new heights wth Podman AI Lab!

Get started Learn more on GitHub

Experiment with free Open Source recipes

LLM Chatbot

Experiment prompting locally

Text Summarizer

Get insight on large text corpus

Speech to text

Get transcript from any audio file

Object Detection

Get started with computer vision

All built to run locally on your laptop

Recipes Catalog

Collection of pre-built solutions for various AI use cases and problem domains. Each recipe includes detailed explanations and sample applications that can be run using different large language models (LLMs). Get inspired by use cases and learn how to integrate AI in an optimal way. Recipes are kubernetes ready.

Models Catalog

Curated list of open source large language models available out of the box. Check license and required resources. Import your own models.

Model Serving

Run models locally with an inference server. Get OpenAI compatible endpoints, use code snippets and start integrating AI in your application.

Playground Environments

Experiment with large language models with a dedicated UI. Configure the models settings, system prompts to test and validate your prompt workflows. Compare behavior of different models.