It's a fascinating emergent behaviour but also one that could have been predicted?
I'd imagine that our brains have become similarly biased towards generating such a generalised symbolic structure over hundreds of millions of years of evolution?
I'm thinking how certain regions of the brain reliably represent things like motor skills, speech, abstract thought.
I agree. In retrospect, this seems almost inevitable. And our own minds at least to do some form of symbolic reasoning — literally language, which you are apparently capable of, dear reader, as a lower bound. There might be more symbolic reasoning in the conscious, unconscious, and subliminal parts of the mental workspace. I always hesitate to infer similarities between the brain/mind and LLMs, but I certainly track the comparison here.
I think of them more as by properties: Mercury hasn't even an atmosphere, it's too close to the sun; Venus is a hot earth so it sits closer than us; then comes its sister planet Earth; Mars is cool by comparison and sits further away than we do. Jupiter and Saturn are harder but sit before the ice giants Uranus and Neptune, again making logical sense. Whether Jupiter or Saturn comes first, I guess there's some memorisation, with or without some sentence about it
Blame I.T. - they keep resetting my password and I'm not allowed to write it down on a Post-It like back in the old days...
reply