Reasoning failures highlighted by Apple research on LLMs

Underlying paper

Based on my limited experience with LLMs, I can’t say I’m surprised.

On a similar theme:

This AI Pioneer Thinks AI Is Dumber Than a Cat

LeCun says such talk is likely premature. When a departing OpenAI researcher in May talked up the need to learn how to control ultra-intelligent AI, LeCun pounced. “It seems to me that before ‘urgently figuring out how to control AI systems much smarter than us’ we need to have the beginning of a hint of a design for a system smarter than a house cat,” he replied on X.

He likes the cat metaphor. Felines, after all, have a mental model of the physical world, persistent memory, some reasoning ability and a capacity for planning, he says. None of these qualities are present in today’s “frontier” AIs, including those made by Meta itself.

I’m not surprised. I have been an AI skeptic all along.