Skip to content

GPU compute

GPU compute for AI, your way.

Call AI models, rent GPU servers by the hour, run your own containers or reserve a dedicated cluster. All on one global GPU network.

Choose your level of control

One GPU network. Five ways in.

OpenGPU is the network. Relay is the easiest way to use it, for AI models, studio and GPU instances. The Client App runs your own containers, and Enterprise reserves dedicated GPU capacity.

For AI products and teams

One HTTPS endpoint, OpenAI-compatible, with card or invoice billing. Nothing new to set up.

  • 80+ LLM, image, video and audio models
  • Provider selection, retries and failover handled for you
  • Monthly invoices, usage analytics and team keys
  • Regional deployments with zero data retention

Native · Client App

For custom workloads

Publish your own container as a source, define routing rules and submit tasks directly to the network. Even lower pricing than Relay.

  • Any containerized workload: training, rendering, batch
  • Set GPU type, VRAM, budget and priority per task
  • Live logs and full task history
  • Direct to providers, no gateway in between
Relay APIClient AppRelay InstancesDedicated
InterfaceOpenAI-compatible APIClient App, SDK, CLISSHAny of these
What you runHosted modelsYour own containersAnything on a full machineProduction workloads
BillingPer tokenPer taskPer hourContract & invoice
CommitmentNoneNoneNone (1-hour minimum)Reserved, with SLAs
Best forAI products and agentsTraining, rendering, batchDev boxes, notebooks, servicesPredictable, large-scale demand

RelayStudio

AI video and images, no code.

Relay Studio turns a prompt into finished AI videos, images and voice-overs, then edits them into one video. Powered by the same models and network as the Relay API.

  • Full video

    Shot planning, filming, voice, music and the final edit, with the plan and cost shown first.

  • Clips & talking video

    Video clips, talking presenters and motion from a single photo.

  • Images & voice

    Image generation, voice-overs and audio in the same workspace.

  • Templates & editor

    Product showcases, before/after and more, in 9:16, 1:1 or 16:9, up to 3 minutes.

RelayInstances

Rent GPU servers by the hour.

When you need a full server, not a single task: pick hardware from hosts across the network, connect over SSH and run anything. Training runs, notebooks, long-running services or your own inference stack.

  • Choose your hardware

    Each offer shows the GPU, specs and host country, so you know exactly what you get.

  • Full control

    SSH access, your OS image, drivers and network settings.

  • Storage & networking

    Attached storage and networking features with every instance.

  • Hourly, no contract

    Start and stop when you want. One-hour minimum, no commitments.

Capacity

From edge devices to datacenter clusters.

GPUs, CPUs and specialized AI accelerators. The router sees all of it as one pool and places each job on the hardware that fits it best.

Datacenter

NVIDIA H100

80 GB HBM

Large-model training and high-throughput inference.

Datacenter

NVIDIA A100

40 / 80 GB HBM

Fine-tuning, distributed jobs and batch inference.

Prosumer

RTX 4090

24 GB GDDR6X

Image and video generation, rendering, mid-size LLMs.

Edge

Apple M-series

Unified memory

Lighter inference and on-device-class workloads.

  • GPUsConsumer to datacenter class
  • CPUsCPU-only nodes for lighter and pre/post-processing jobs
  • AI acceleratorsPurpose-built silicon for inference and training
  • Edge devicesCompact hardware for lightweight inference
  • Independent providersCost-efficient GPU nodes from independent operators in 40+ locations.
  • DatacentersEnterprise-grade clusters as a stable backbone.
  • Cloud overflowCloud GPUs for rare hardware types or extreme demand spikes.

Workloads

GPU workloads we run.

Each workload has a different resource profile. The router knows the difference.

  1. 01

    LLM inference

    Prefill is compute-bound and sets time to first token; decode is memory-bound and sets time per token. OpenGPU routes each request to GPUs that match its memory and speed needs, and scales out during traffic spikes.

  2. 02

    Training & fine-tuning

    Full pre-training, fine-tuning and continual training need large VRAM, steady I/O and resilience. Long jobs are matched to stable providers, GPUs are grouped for distributed runs, and checkpoints keep progress if a node drops.

  3. 03

    Generative media & 3D

    Image, video, audio and 3D generation range from bursty interactive requests to heavy batch runs. Latency-sensitive jobs land on fast nodes; batch jobs spread horizontally. No-code teams can create directly in Relay Studio.

  4. 04

    Rendering & video

    Scenes and videos are split into frames or segments, rendered in parallel across the network and collected back. Ray tracing, lighting passes, FX sims, transcoding and AI upscaling.

  5. 05

    Simulation & research

    Reinforcement learning, scientific simulation and evaluation sweeps run as many small jobs instead of one giant cluster. Scale up or down on demand and recycle idle GPUs into new tasks.

  6. 06

    RAG, embeddings & agents

    Embeddings, indexing, retrieval and agent loops run as batch or real-time jobs. Relay keeps agent systems running even when individual providers churn.

  • PyTorch
  • TensorFlow
  • JAX
  • Docker containers
  • REST API
  • Python SDK
  • OpenAI-compatible endpoints
  • Webhook callbacks

Pricing model

GPU pricing: pay for what you use.

Prices are set by the market. High-demand tasks attract more providers, prices adjust to network conditions, and you get the best performance for your budget.

  • Your unit

    Per token, per task or per hour, depending on how you use the network.

  • No idle cost

    Capacity comes from a live pool, so you never pay for an idle cluster.

  • No contracts for on-demand use

    No reserved instances, minimum spend or multi-year commitments. Dedicated capacity is reserved under an agreement.

  • Dynamic pricing

    Providers compete for tasks. The router finds the best price-performance match.

50%+Average saving on Relay vs centralized services
Up to 70%Saving on many workloads vs major clouds
$0Minimum commitment
<2sAverage routing time

On the roadmap

AI agents for the GPU network.

Agents will automate decisions for both sides of the marketplace, and an open Agent Marketplace will let developers publish and earn from their own.

  • For clients

    Automated task submission, deadline-aware scheduling, budget optimization across tasks and result validation.

  • For providers

    Automatic source registration, profitability-based task selection, hardware allocation and performance tuning.

  • Market intelligence

    Real-time pricing, supply and demand trends and dynamic fee adjustment.

  • Agent Marketplace

    An open market where independent developers publish agents and users pick the best performers.

Get GPU compute in minutes.

Get $10 of free credit on Relay, or open the Client App and submit your first task.

What do you want to do?