streaming
real-time token streaming with useAgentChat(). no manual SSE parsing. state managed for you.
react components
chat, generative UI, tool approvals. shadcn/ui compatible. connect to any inference shell agent.
pnpm dlx shadcn@latest registry add @inferenceshhow can I help?
inference shell ui demo
blocks
full agent chat with state management, tool lifecycle, and generative UI. streaming, approvals, widgets — all wired to a runtime. 4 lines to ship.
explore →how can I help?
inference shell ui demo
30+ typed widgets your agent can render. forms, cards, charts, data displays. the agent returns JSON, the widget renderer handles the rest.
explore →departure
5h 45m
on timearrival
partly cloudy
H: 72° L: 58°
large • oat milk • less ice
medium • regular sugar
pending, in-progress, completed, failed, awaiting approval. every tool state handled inline with collapsible details, approval UI, and widget results.
explore →{
"query": "inference shell pricing"
}{"urls":["https://inference.sh/pricing"],"snippets":["pay per second, no minimums"]}{
"path": "/data/old-backup.tar.gz"
}container, messages, input, status indicators. composable building blocks for any chat UI. auto-resizing input, file upload, virtualized rendering for 1000+ messages.
explore →how can I help?
chat primitives demo
streaming output, status indicators, tabbed views, auto-scrolling logs. display long-running agent task results with real-time updates.
explore →high-performance markdown renderer with syntax-highlighted code blocks, tables, images, YouTube embeds, and zoomable images. optimized for token-by-token streaming.
explore →build AI-powered apps with inference shell. the platform handles infrastructure, you write the logic.
const agent = new Agent({ tools: [searchWeb, analyzeData],})await agent.run("find recent papers on RLHF")agents can use tools, render widgets, and stream responses in real-time.
| feature | status |
|---|---|
| streaming | supported |
| tool calls | supported |
| widgets | 30+ types |
why inference shell ui
real-time token streaming with useAgentChat(). no manual SSE parsing. state managed for you.
HITL gates render as UI. user clicks approve or reject inline. no modal interruptions.
agents render structured widgets — forms, cards, charts — not just text. typed with JSON schemas.
Next.js · Remix · SvelteKit · Hono · Express
no. it's a full generative UI system. your agent can render tables, charts, forms, cards, not just text. components are typed with JSON schemas.
start with the hosted platform. deploy your own when you're ready.
we use cookies
we use cookies to ensure you get the best experience on our website. for more information on how we use cookies, please see our cookie policy.
by clicking "accept", you agree to our use of cookies.
learn more.