Section 1 — The Model

    Training

    The process that sets a model's parameters, by exposing it to vast amounts of text and adjusting parameters to improve nexttoken prediction. A onetime, expensive process done by...

    Matt Pocock
    Matt Pocock

    The process that sets a model's parameters, by exposing it to vast amounts of text and adjusting parameters to improve next-token prediction. A one-time, expensive process done by the model provider. Encompasses both pre-training (the bulk run) and post-training (later refinements like instruction-following and safety); the distinction doesn't matter at this glossary's level.

    Usage:

    "Can we get it to know our internal API?"

    "Not via training — that's a months-long process by the model provider. Load the API docs into context instead, that's the lever you actually have."

    Want more than vocabulary?

    Join AI Hero for practical skills, thinking on AI engineering, and resources that keep you ahead of the curve.

    I respect your privacy. Unsubscribe at any time.

    Share