Inference

Working definition

Inference is running a trained model to produce outputs. This is where your AI bill actually comes from. Training is a one-time investment. Inference is the rent.