A field trip through the inner world of an LLM we don’t fully understand
Haven’t you ever wondered how an LLM is actually able to ‘think’? I’m not talking about the pipeline, the whole sequential thing of breaking a sentence into tokens, projecting those tokens into vector embeddings, running them through multi-head attention layers and feed-forward blocks until a probability distribution over the next token falls out the other…



