The ability to predict brain activity from words before they occur can be explained by information shared between neighbouring words, without requiring next-word prediction by the brain.
Microsoft's Bing team has open-sourced Harrier, an embedding model family that tops the multilingual MTEB v2 benchmark under an MIT license.