Inference Logoinference.sh

Coding Agents

Build inference.sh apps with AI coding assistants like Claude Code, Cursor, or Windsurf.


Setup

1. Install CLI

bash
1curl -fsSL https://cli.inference.sh | sh2infsh login

2. Create App

bash
1infsh app init my-app2cd my-app

This creates your app with all the files needed, including skills that teach your coding agent how to build inference.sh apps.


Skills Included

When you run infsh app init, the CLI creates a skills/ directory containing guidance for AI coding assistants:

SkillWhat it teaches
building-inferencesh-appsOverview, CLI commands
writing-app-logicHow to write inference.py
configuring-resourcesHow to set up inf.yml
managing-secretsHandling API keys
using-oauth-integrationsGoogle Sheets, Drive
tracking-usageOutput metadata for billing
handling-cancellationGraceful task cancellation
optimizing-performanceBest practices
debugging-issuesTroubleshooting

How It Works

  1. You describe what you want — Tell your coding agent what app to build
  2. Agent reads skills — The agent uses the skills to understand inference.sh patterns
  3. Agent writes code — Creates inference.py, updates inf.yml, adds dependencies
  4. Test locally — Run infsh app run to verify
  5. Deploy — Run infsh app deploy to publish

Example Prompts

code
1Create an image resizing app that takes an image and dimensions, 2and returns the resized image.
code
1Build an LLM app that calls OpenAI's API. 2It should track token usage for billing.
code
1Make a YouTube audio downloader that extracts audio from videos 2and returns MP3 files.

Supported Agents

The skills work with any AI coding assistant that supports project-level context:

  • Claude Code — Reads skills from .claude/skills/ or project files
  • Cursor — Uses project context
  • Windsurf — Uses project context
  • GitHub Copilot — Uses project context

Next

CLI Setup — Manual CLI installation

Creating an App — Manual app creation

we use cookies

we use cookies to ensure you get the best experience on our website. for more information on how we use cookies, please see our cookie policy.

by clicking "accept", you agree to our use of cookies.
learn more.