Create AI assistants that plan, use tools, and get things done.
Agents are the primary way to interact with inference.sh. Instead of manually running apps one by one, you describe what you want and the agent handles the execution.
Creating an Agent
From the Workspace
- Go to Agents in the workspace
- Click New Agent
- Configure the basics:
| Setting | What it does |
|---|---|
| Name | Identifier for your agent |
| LLM | The AI model that powers reasoning (GPT-4, Claude, etc.) |
| System Prompt | Describes the agent's role and behavior |
| Tools | Apps and flows the agent can use |
| Sub-Agents | Other agents this one can delegate to |
The System Prompt
This is where you define your agent's personality and purpose:
code
1You are a creative assistant that helps design social media content.2 3When asked to create content:41. Ask clarifying questions if the request is vague52. Generate images using the available tools63. Suggest captions and hashtags74. Offer to resize for different platforms8 9Always explain what you're doing and offer alternatives.Adding Tools
Tools are apps and flows your agent can use. When you add a tool:
- The name and description are automatically extracted
- The input schema becomes the tool's parameters
- You don't need to write tool definitions manually
Example Tools
| Tool | What it does |
|---|---|
stable-diffusion | Generate images from text |
whisper | Transcribe audio to text |
summarize | Condense long text |
web-search | Search the internet |
resize-flow | Resize images for multiple platforms |
Adding a Tool
- In your agent settings, click Add Tool
- Search for an app or flow
- Select it — done!
The agent now knows how to use it.
Built-in Capabilities
Every agent comes with default tools that aren't editable:
| Tool | Purpose |
|---|---|
| memory | Store and recall information across conversations |
| plan | Break down complex tasks into steps |
| finish | Mark the task as complete |
These help agents think through problems and remember context.
Sub-Agents
For complex tasks, agents can delegate to specialized sub-agents:
code
1Main Agent: "Create a blog post about AI trends"2 │3 ├──▶ Research Agent: Gathers information4 │5 ├──▶ Writing Agent: Creates the draft6 │7 └──▶ Editor Agent: Reviews and polishesAdd sub-agents the same way you add tools — search and select.
Talking to Your Agent
In the Workspace
Open your agent and start chatting:
code
1You: Generate a sunset landscape image2 3Agent: I'll create that for you.4 [Calling stable-diffusion...]5 6 Here's your sunset landscape! I generated a vibrant 7 scene with orange and purple colors over mountains.8 9 Would you like me to:10 - Modify the style?11 - Generate variations?12 - Resize for specific platforms?Widgets
Sometimes agents need more information. They can generate simple UI widgets:
code
1Agent: I need a few details for the logo:2 3 ┌─────────────────────────────────┐4 │ Company Name: [____________] │5 │ Style: [Modern ▼] │6 │ Colors: [_____] [_____] │7 │ │8 │ [Generate Logo] │9 └─────────────────────────────────┘Fill it out and the agent continues.
Chat Integrations
Connect your agent to:
- Slack — Talk in channels or DMs
- Discord — Bot integration
- Telegram — Chat interface
- WhatsApp — Message-based interaction
Example: Content Creation Agent
Configuration
Name: content-creator
System Prompt:
code
1You are a content creation assistant. Help users create 2images, write copy, and prepare social media posts.3 4When creating content:51. Ask about the target audience62. Generate visuals using image tools73. Write engaging copy84. Offer platform-specific formattingTools:
stable-diffusion— Image generationcopywriter— Marketing copyresize-flow— Multi-platform sizing
Conversation
code
1You: I need Instagram content for a coffee shop2 3Agent: Great! Let me help you create some Instagram content.4 5 A few questions:6 - What's the coffee shop's name and vibe?7 - Any specific products to highlight?8 - Preferred visual style (minimal, cozy, bold)?9 10You: "Morning Brew" - cozy vibe, featuring their new 11 oat milk latte, warm and inviting style12 13Agent: Perfect! I'll create content for Morning Brew.14 15 [Generating cozy coffee shop image...]16 [Writing caption...]17 18 Here's what I've created:19 20 �� Image: A warm, inviting shot of a oat milk latte21 with morning light streaming through a window22 23 ✍️ Caption: "Start your morning the right way ☀️ 24 Our new Oat Milk Latte is creamy, dreamy, and 25 100% plant-based. Your cozy corner awaits.26 #MorningBrew #OatMilkLatte #CoffeeLovers"27 28 Want me to create more variations or resize for Stories?Headless Agent SDK
Build agents programmatically without the workspace UI:
python
1from inferencesh import Agent, tool, string2 3agent = Agent(4 api_key="inf_...",5 config={6 "core_app_ref": "infsh/claude-sonnet-4@latest",7 "name": "Assistant",8 "tools": [my_tool],9 }10)11 12response = agent.send_message("Hello!")