Tools that do one thing well.
Apps are the building blocks of inference.sh. Each app takes structured input, does something useful, and returns structured output.
The Grid
The Grid is our library of 100+ pre-built apps, always growing:
| Category | Examples |
|---|---|
| Image | Stable Diffusion, DALL-E, Upscaling, Background Removal |
| Audio | Whisper (transcription), Text-to-Speech, Music Generation |
| Video | Generation, Frame Interpolation, Editing |
| Text | Summarization, Translation, Sentiment Analysis |
| Code | Analysis, Generation, Documentation |
| Data | Processing, Conversion, Analysis |
Running an App
From the Workspace
- Find an app in the Grid
- Click to open
- Fill in the inputs
- Click Run
- View the results
Example: Image Generation
1┌─────────────────────────────────────────────────────────────┐2│ stable-diffusion [Run ▶] │3├─────────────────────────────────────────────────────────────┤4│ │5│ Prompt: │6│ ┌─────────────────────────────────────────────────────┐ │7│ │ A serene Japanese garden with cherry blossoms │ │8│ └─────────────────────────────────────────────────────┘ │9│ │10│ Style: [Photorealistic ▼] │11│ │12│ Size: [1024 x 1024 ▼] │13│ │14├─────────────────────────────────────────────────────────────┤15│ ● Running... │16│ │17│ [████████████░░░░░░░░] 60% │18│ Loading model... │19│ Generating image... │20│ │21└─────────────────────────────────────────────────────────────┘Results appear when complete, with download options and task details.
Using Apps as Agent Tools
When you add an app to an agent:
- Go to your agent's settings
- Click Add Tool
- Search and select the app
The agent can now use it during conversations:
1You: Transcribe this audio file2 3Agent: I'll transcribe that for you using Whisper.4 [Calling whisper with your audio file...]5 6 Here's the transcription:7 8 "Welcome to today's episode. We're going to discuss..."App Configuration
Apps can show setup parameters — configuration options that determine how the app initializes (e.g. loading a specific model checkpoint).
1┌────────────────────────────────┐2│ Setup: │3│ • Model: [Llama-2-7b ▼] │4│ • Precision: [fp16 ▼] │5└────────────────────────────────┘Changing these parameters restarts the app instance.
Where Apps Run
Choose your infrastructure:
| Option | Description |
|---|---|
| Cloud | Runs on inference.sh managed workers. Pay-per-use. |
| Private | Runs on your own hardware via an Engine. |
Toggle in the app runner:
1Run on: [● Cloud] [○ Private]Creating Your Own Apps
The Grid is open for extension. If you need something that doesn't exist, build it.
Quick Start
Apps are Python scripts with typed inputs and outputs:
1from inferencesh import BaseApp, BaseAppInput, BaseAppOutput2from pydantic import Field3 4class AppInput(BaseAppInput):5 text: str = Field(description="Text to process")6 7class AppOutput(BaseAppOutput):8 result: str = Field(description="Processed result")9 10class App(BaseApp):11 async def setup(self, metadata):12 pass13 14 async def run(self, input_data: AppInput, metadata) -> AppOutput:15 # Process each request16 return AppOutput(result=input_data.text.upper())17 18 async def unload(self):19 # Cleanup (runs on shutdown)20 passDeploy with the CLI:
1infsh deploy→ See Extending Apps for the full guide
Editing App Settings
After deploying, you can edit in the workspace:
- Setup Parameters — Configure initialization defaults
- Images — Card, thumbnail, banner for discoverability
- Description — Help others understand what it does
- Visibility — Public or private
No need to redeploy for these changes.
App Requirements
Some apps need external credentials to work:
- Secrets — API keys like
OPENAI_API_KEY - Integrations — OAuth connections like Google Sheets or X.com
If an app requires something you haven't set up, you'll be prompted before running.
→ Learn about Secrets & Integrations
What's Next?
- Flows — Chain apps into multi-step workflows
- Extending Apps — Build and deploy your own
- Secrets & Integrations — Connect external services
- API & SDK — Run apps programmatically