AI Blog

AI Blog

by Michele Laurelli

Back to Glossary

Top-K Sampling

Technique
Definition

Text generation technique sampling from only the K most likely next tokens.

Restricts sampling to top K tokens by probability. Reduces unlikely tokens while maintaining diversity. Common: K=40-50.

Examples

1

K=50 for balanced generation

2

Diverse text generation

3

Avoiding rare tokens

Related Terms

Nucleus Sampling (Top-P)

Text generation sampling from smallest set of tokens whose cumulative probability exceeds threshold P.

LLM (Large Language Model)

A neural network with billions of parameters trained on massive text datasets to understand and generate human language.

Michele Laurelli - AI Research & Engineering