Inference Logoinference.sh

Installing the Engine

Set up private workers on your hardware.

Requirements

  • Linux (Ubuntu 20.04+ recommended)
  • Docker installed
  • NVIDIA GPU with drivers (for GPU tasks)
  • Outbound internet access

Install

bash
1curl -fsSL https://engine.inference.sh/install.sh | sh

Initialize

bash
1inference-engine init

Enter your API key when prompted.

Start

bash
1inference-engine start

Verify

Check Engines in the workspace.

Your engine should appear as online.

Run as service

For production, run as a systemd service:

bash
1sudo systemctl enable inference-engine2sudo systemctl start inference-engine

Next

→ Configuration

previouswhy private?nextconfiguration

we use cookies

we use cookies to ensure you get the best experience on our website. for more information on how we use cookies, please see our cookie policy.

by clicking "accept", you agree to our use of cookies.
learn more.