Inference

The process of using a trained AI or machine-learning model to produce a prediction, classification, or generated output from new input.

AI & Automation

In plain English

Training is when a model learns. Inference is when the trained model is actually used. Each time a model answers a prompt, recognizes an image, or predicts a value, it is performing inference.

Example

When a chatbot receives your question and generates a response using an already trained language model, that response is produced during inference.

Sources

  1. Google for Developers: Machine Learning Glossary