"The fourth planet color is"

Concepts in the Residual Stream of "is"

The last token accumulates all context  ยท  simulated activations across 100 layers

Input tokens (fading)
"the"
"fourth"
"planet"
"color"
"is"
J-space concepts (silent reasoning)
"Mars"
"space"
"rocky"
Output candidates (emerging)
"red"
"crimson"