Temperature

A model-generation setting that adjusts the randomness of token selection, influencing how varied an AI model’s output can be.

AI & Automation

In plain English

A lower temperature generally makes a model’s responses more predictable; a higher one can make them more varied. It changes how the model chooses what to generate, but does not guarantee that an answer is accurate or creative.

Example

When asked to suggest a name for a project, a model set to a lower temperature may offer similar, straightforward options each time, while a higher setting may produce a wider mix of suggestions.

Sources

  1. Google Cloud: Content generation parameters | Generative AI on Vertex AI