Inference Logoinference.sh

CLI Setup

Install the command-line tool for creating apps.


Prerequisites

uv (Required)

The CLI uses uv for Python environment management:

bash
1curl -LsSf https://astral.sh/uv/install.sh | sh2 3# Windows4powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"

Hardware

App TypeDevelopment Environment
CPU appsAny machine
GPU appsRequires NVIDIA CUDA GPU

Install CLI

bash
1curl -fsSL https://cli.inference.sh | sh

Verify

bash
1infsh version

Login

bash
1infsh login

Opens a browser to authenticate.


Check your account

bash
1infsh me

Shows your username and team.


What you can do

CommandPurpose
infsh app initCreate a new app
infsh app runTest locally
infsh app deployDeploy to inference.sh
infsh app lsList your apps

Next

Coding Agents — Build with AI assistants

Creating an App — Manual setup

we use cookies

we use cookies to ensure you get the best experience on our website. for more information on how we use cookies, please see our cookie policy.

by clicking "accept", you agree to our use of cookies.
learn more.