streaming
real-time token streaming via useAgentChat(). messages, tool calls, and status updates arrive as they happen.
agent
full-featured AI agent chat with state management, tool lifecycle, generative UI widgets, and human-in-the-loop approvals.
pnpm dlx shadcn@latest add @inferencesh/agentfull agent chat with streaming, tool lifecycle, generative widgets, and human-in-the-loop approvals. state management, message history, and auto-scrolling handled for you.
how can I help?
inference shell ui demo
wrap your app in AgentChatProvider, drop in Chat. streaming, tools, widgets, and approvals work out of the box. no manual SSE parsing or state wiring.
import { AgentChatProvider, Chat } from '@inference/ui/agent' export default function App() { return ( <AgentChatProvider agent="my-agent"> <Chat /> </AgentChatProvider> ) }
point to a published agent by namespace and version. no ad-hoc system prompts or tool wiring. the agent config lives on inference.sh, your UI just references it.
// use a published agent by reference <AgentChatProvider config={{ agent: 'okaris/image-gen@latest' }}> <Chat /> </AgentChatProvider>
features
real-time token streaming via useAgentChat(). messages, tool calls, and status updates arrive as they happen.
tools render inline with pending, in-progress, completed, and failed states. collapsible details, JSON results.
tool calls that require approval render an approve/reject UI inline. no modal interruptions.
agents return structured JSON that renders as rich UI — forms, cards, charts, data tables. 30+ widget types.
define tools that run in the browser. agents can read DOM state, fill forms, trigger navigation.
point to a published agent by name and version. no ad-hoc config needed.
the agent block pulls in chat, tools, and widgets as dependencies. you get the full stack — chat container, message bubbles, input, tool invocations, widget renderer, and the AgentChatProvider state manager.
start with the hosted platform. deploy your own when you're ready.
we use cookies
we use cookies to ensure you get the best experience on our website. for more information on how we use cookies, please see our cookie policy.
by clicking "accept", you agree to our use of cookies.
learn more.