How language models work

What happens inside the systems that read and write text, from words as numbers to the machinery that predicts what comes next.

• What is an embedding?draft

  How a computer can turn a word into a position, so that words with similar meanings end up near each other.