Back to Glossary
AI Inference
AI & ComputeThe process of running a pre-trained AI model to generate predictions or outputs from new input data. Inference is the most common GPU workload type, used for chatbots, image generation, and more.
The process of running a pre-trained AI model to generate predictions or outputs from new input data. Inference is the most common GPU workload type, used for chatbots, image generation, and more.