top of page
  • Writer's pictureChris Hack

Temperature in ChatGPT

"The temperature parameter in ChatGPT completions is a crucial aspect that influences the model's output diversity and creativity. Essentially, it determines how the model selects tokens (words or word pieces) when generating text.


A higher temperature value (e.g., 1.0 or above) results in more randomness and creativity in the generated text, as the model assigns relatively equal probabilities to multiple tokens. This may lead to diverse and unexpected responses but can also compromise coherence and relevance.


On the other hand, a lower temperature value (e.g., 0.1 or below) makes the model more conservative and deterministic in token selection, as it strongly favors tokens with the highest probabilities. This usually results in more focused, consistent, and contextually accurate responses but may lack creativity or variety.


Thus, the temperature parameter allows users to fine-tune ChatGPT completions to obtain the desired balance between creativity and coherence, depending on the specific application or context." - ChatGPT 4


See e.g. https://gptforwork.com/guides/openai-gpt3-temperature

5 views0 comments

Recent Posts

See All

Whisper

Another use of AI is speech-to-text conversion. Recorded audio can be turned into text. It is possible to embed this functionality in your own apps using the (paid-for) OpenAI APIs? This seems to have

ChatGPT 3.5 vs ChatGPT 4

Did you know that the free version of ChatGPT uses something called the ChatGPT-3.5 engine but that an updated, more powerful version is available on paid-for accounts? This is ChatGPT 4 - it shows be

Fine Tuning ChatGPT

Did you know it's possible to 'fine tune' ChatGPT by pre-supplying it with model prompts and ideal responses? You need to do this via the paid for API and the details are necessarily a little technica

Comments


bottom of page