Monday, 3 August 2026

"The 'AGI-is-near' community keeps committing the same logical fallacy over and over. Every time there’s an advance, I see the same error."

"Astra, a new model that OpenAI is testing internally, is amazing. No denying that:
"But at the same time, a whole raft of people, some fairly prominent, are running around making a deeply flawed argument about the implications. ...

"[One] tweet went so far as to claim that “the species just crossed a one-way threshold”; Elon Musk took it as evidence that we had reached The Singularity.

"Each is making essentially the same error.

"The fallacy has a name; it’s called the fallacy of composition. ...

"What’s the manifestation of the fallacy in the current case? Thinking that a system that is great at a certain kind of maths problem is great at all maths, great at science or even quite possibly great at everything. The 'AGI-is-near' community keeps committing the same logical fallacy over and over. Every time there’s an advance, I see the same error.

"Here’s how the fallacy works.
  1. Someone pretends that all cognition is created equally. (Totally untrue.)
  2. Whenever AI achieves success on some form of (fancy) cognition, they want you to believe that success on all forms of AI is imminent. 
"You don’t have to be a cognitive psychologist to realize that this inference just doesn’t follow."

No comments: