During the training process, these models discover how to forecast the next word in the sentence based upon the context supplied by the previous words. The model does this by means of attributing a probability score into the recurrence of words that were tokenized, damaged down into more compact s