Learn in the textbookGenerative Models and Large Language Models
DefinitionAn LLM is a generative AI model that learns from an enormous amount of text and produces natural text that continues a given sentence.
ExplanationIt is a language model, which predicts the probability of the next word in a sentence, built at a very large scale. It is first trained on vast data from a wide range of fields (pre-training) to gain general ability, and can then be adapted to a specific use through additional training (fine-tuning). A model that serves as the base for many uses in this way is called a foundation model.
AnalogyIt is like someone who has read countless books being shown an unfinished sentence and writing a perfectly plausible continuation.
Memory hookThe leading L is Large, the same L as on a large-size shirt.