Okay, yes, we aren’t doing single words at a time (technically some models do chunk long words anyway so even from near the beginning we weren’t doing “singular” words at any time)
However, you are both right and wrong in your assertion that LLMs our equivalent human responses.
The translation of thoughts to words and words to motor functions both can be approximated by ANNs. And yes, the work done to select words we use is a probabilistic process like you describe. We hear patterns in language and that makes us more likely to use that phrasing. The more you hear a phrase the more likely you are to use it over another and when two or more phrases would communicate what you want to say your brain basically just picks one.
So, If speech production (or sentence construction) was what you meant by saying “it’s the same for human responses,” then yes, we agree. Both are probabilistic word generators and likely work in similar ways. (In fact I think place cells were found in Wernicks area (?) or one of the other speech corteces which means some of our word selection is likely similar to the results from transformer architectures)
However, if you meant the entirety of human response—as in from hearing/reading a comment, thinking about it, responding—is the same as current LLMs generating text. I strongly disagree.
The actual process of “thinking” is not something an ANN (especially a non-recurrent one) can do. The ability to ruminate on thoughts and make changes/learn-new-things simply by trying to formulate ideas before even deciding to comment cannot be accomplished with a pre-trained static net, not even one with memory or the illusion of memory like current LLMs. (Not to mention that identity also plays a large role in our responses and it too cannot arise from current deterministic architectures)
As for me asserting human response is chemistry is more like asserting AI is electromagnetism, there are many reasons why, but the simplest illustration would be this:
I think it is entirely possible to build an inorganic but still functional human brain on electrical hardware. (In other words, full blown transhumanism or at the very least, “AGI”) If human response is chemistry in organics, it would be electromagnetism in silicon.
So, If speech production (or sentence construction) was what you meant by saying “it’s the same for human responses,” then yes, we agree. Both are probabilistic word generators and likely work in similar ways.
This is what I meant.
However, if you meant the entirety of human response—as in from hearing/reading a comment, thinking about it, responding—is the same as current LLMs generating text. I strongly disagree.
That would be crazy, I’m glad you would disagree with that.
As for me asserting human response is chemistry is more like asserting AI is electromagnetism, there are many reasons why, but the simplest illustration would be this:
I think it is entirely possible to build an inorganic but still functional human brain on electrical hardware. (In other words, full blown transhumanism or at the very least, “AGI”) If human response is chemistry in organics, it would be electromagnetism in silicon.
This is moving into a funny gray area, but what you are talking about is, I think, only possible if you take a route like the one covered in Jeff Hawkins’ “A thousand brains”. It’s not the most fun read if you’re not into neuroscience, but the second half is pretty relevant regardless.
Okay, yes, we aren’t doing single words at a time (technically some models do chunk long words anyway so even from near the beginning we weren’t doing “singular” words at any time)
However, you are both right and wrong in your assertion that LLMs our equivalent human responses.
The translation of thoughts to words and words to motor functions both can be approximated by ANNs. And yes, the work done to select words we use is a probabilistic process like you describe. We hear patterns in language and that makes us more likely to use that phrasing. The more you hear a phrase the more likely you are to use it over another and when two or more phrases would communicate what you want to say your brain basically just picks one.
So, If speech production (or sentence construction) was what you meant by saying “it’s the same for human responses,” then yes, we agree. Both are probabilistic word generators and likely work in similar ways. (In fact I think place cells were found in Wernicks area (?) or one of the other speech corteces which means some of our word selection is likely similar to the results from transformer architectures)
However, if you meant the entirety of human response—as in from hearing/reading a comment, thinking about it, responding—is the same as current LLMs generating text. I strongly disagree.
The actual process of “thinking” is not something an ANN (especially a non-recurrent one) can do. The ability to ruminate on thoughts and make changes/learn-new-things simply by trying to formulate ideas before even deciding to comment cannot be accomplished with a pre-trained static net, not even one with memory or the illusion of memory like current LLMs. (Not to mention that identity also plays a large role in our responses and it too cannot arise from current deterministic architectures)
As for me asserting human response is chemistry is more like asserting AI is electromagnetism, there are many reasons why, but the simplest illustration would be this:
This is what I meant.
That would be crazy, I’m glad you would disagree with that.
This is moving into a funny gray area, but what you are talking about is, I think, only possible if you take a route like the one covered in Jeff Hawkins’ “A thousand brains”. It’s not the most fun read if you’re not into neuroscience, but the second half is pretty relevant regardless.