Inference

Letter I

Running a trained model to produce outputs. Training is a one-time investment. Inference is the rent.

Updated:

Working definition

Inference is running a trained model to produce outputs. This is where your AI bill actually comes from. Training is a one-time investment. Inference is the rent.