Install the command-line tool for creating apps.
Prerequisites
uv (Required)
The CLI uses uv for Python environment management:
bash
1curl -LsSf https://astral.sh/uv/install.sh | sh23# Windows4powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"Hardware
| App Type | Development Environment |
|---|---|
| CPU apps | Any machine |
| GPU apps | Requires NVIDIA CUDA GPU |
Install CLI
bash
1curl -fsSL https://cli.inference.sh | shVerify
bash
1infsh versionLogin
bash
1infsh loginOpens a browser to authenticate.
Check your account
bash
1infsh meShows your username and team.
What you can do
Development
| Command | Purpose |
|---|---|
infsh app init | Create a new app |
infsh app test | Test locally |
infsh app deploy | Deploy to inference.sh |
Running Apps
| Command | Purpose |
|---|---|
infsh app run | Run an app in the cloud |
infsh app sample | Generate sample input |
Managing Apps
| Command | Purpose |
|---|---|
infsh app my | List your deployed apps |
infsh app list | Browse available apps |
infsh app get | Get app details |
infsh app pull | Download an app |
Secrets
| Command | Purpose |
|---|---|
infsh secrets list | List all secrets |
infsh secrets set <key> <value> | Create or update a secret |
infsh secrets get <key> | Get a secret (masked) |
infsh secrets delete <key> | Delete a secret |
Environment Variables
| Variable | Description |
|---|---|
INFSH_API_KEY | API key (overrides config file) |
Shell Completions
bash
1infsh completion bash # or zsh, fish, powershellNext
→ Coding Agents — Build with AI assistants
→ Creating an App — Manual setup