Skip to Content

Installation

Detailed installation instructions for all supported platforms.

macOS

The simplest way to install Inferno on macOS:

brew install inferno

To update to the latest version:

brew upgrade inferno

Desktop Application

  1. Download the .dmg file from the downloads page
  2. Open the downloaded file
  3. Drag Inferno to your Applications folder
  4. Open Inferno from Applications

Build from Source

Requires Rust toolchain:

git clone https://github.com/ringo380/inferno.git
cd inferno
cargo build --release

The binary will be at target/release/inferno.

Linux

Binary Installation

Download the pre-built binary:

# Replace VERSION with the latest release
curl -LO https://github.com/ringo380/inferno/releases/download/VERSION/inferno-linux-x64.tar.gz
tar -xzf inferno-linux-x64.tar.gz
sudo mv inferno /usr/local/bin/
sudo chmod +x /usr/local/bin/inferno

Cargo

If you have Rust installed:

cargo install inferno

Build from Source

git clone https://github.com/ringo380/inferno.git
cd inferno
cargo build --release
sudo cp target/release/inferno /usr/local/bin/

Windows

Installer

  1. Download the .exe installer from the downloads page
  2. Run the installer
  3. Follow the installation wizard
  4. Inferno will be added to your PATH automatically

Cargo

If you have Rust installed:

cargo install inferno

Build from Source

Requires Rust toolchain:

git clone https://github.com/ringo380/inferno.git
cd inferno
cargo build --release

The binary will be at target\\release\\inferno.exe.

Docker

Pull the Image

docker pull ghcr.io/ringo380/inferno:latest

Run a Container

docker run -it --rm \
  -p 8080:8080 \
  -v ~/inferno-models:/models \
  ghcr.io/ringo380/inferno:latest \
  serve --port 8080

With GPU Support (NVIDIA)

docker run -it --rm --gpus all \
  -p 8080:8080 \
  -v ~/inferno-models:/models \
  ghcr.io/ringo380/inferno:latest \
  serve --port 8080

GPU Support

NVIDIA (CUDA)

  1. Install NVIDIA drivers
  2. Install CUDA Toolkit 11.x or later
  3. Inferno will automatically detect and use CUDA

AMD (ROCm)

  1. Install ROCm drivers
  2. Inferno will detect ROCm automatically

Apple Silicon (Metal)

Metal support is built-in on Apple Silicon Macs (M1/M2/M3/M4). No additional setup required.

Intel Arc

  1. Install Intel Arc drivers
  2. Inferno will detect Intel GPU automatically

Verifying Installation

After installation, verify that Inferno is working:

# Check version
inferno --version
 
# List available commands
inferno --help
 
# Test inference
inferno run --model llama2 --prompt "Test"

Uninstalling

macOS (Homebrew)

brew uninstall inferno

Linux

sudo rm /usr/local/bin/inferno

Windows

Use “Add or Remove Programs” in Windows Settings, or run the uninstaller.

Cargo

cargo uninstall inferno

Next Steps