Warning: Some posts on this platform may contain adult material intended for mature audiences only. Viewer discretion is advised. By clicking ‘Continue’, you confirm that you are 18 years or older and consent to viewing explicit content.
Benchmarks used to rank AI models are several years old, often sourced from amateur websites, and, experts worry, lending automated systems a dubious sense of authority
The most advanced models absolutely have modeling about what’s being discussed and relationships between concepts.
Even toy models have been shown to build world models from very basic training data.
Honestly, read at least a little bit of the relevant research:
https://www.anthropic.com/news/mapping-mind-language-model