Rendered at 22:28:53 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
mastercheif 2 hours ago [-]
This maps with experience taking the anti-seizure medication Topamax in college.
I trialed for a month it as an off-label migraine preventative on recommendation from my neurologist.
Topamax can dampen neuronal activity in the language area of the brain for some people.
It was a terrifying experience, but it was also a valuable one as it changed the way I view intelligence.
About 10 days in, my writing and speech skills had devolved to that of a primary school aged child. I tried to type a text message and struggled to come up with simple words like “and”. My speech slowed down considerably.
The terrifying thing was that my internal world was still as complex and meaningful as it was before. All of the emotions I felt were real and legitimate. My cognition outside of language was intact, I could do math just fine and conceptualize and abstract problems.
In spite of this, I was unable to convey what I was feeling and thinking to the outside world. It felt like I was trapped inside my own body.
After recovering, my intuitive understanding of the link between language and intelligence was changed forever.
Did you write more about that experience somewhere?
This seems to corroborate my feeling that aptitude with language is a very poor proxy for intelligence, although it's often used as one. My own experience is that I'm less struggling to find the right words and sounds more clever at the times when my brain is actually empty and I'm "not there", and at the contrary the more "self-aware" I am and the more I struggle to articulate my thoughts, as if my brain (or ego?) was stepping in the way and slowing me down by trying to supervise what I'm saying too closely, making me sounds dumb.
thejokeisonme 2 hours ago [-]
Was your understanding of language also impaired?
mastercheif 27 seconds ago [-]
No, it was not. My ability to process information aurally, textually, and visually was unaffected.
Lerando 3 days ago [-]
My ex-wife doesn't have internal dialogue. Instead, when she is thinking through something she has images in her head of shapes morphing. She told me that she felt having an internal monologue would be horribly annoying and horribly slow.
debugnik 4 hours ago [-]
I remember having more visual thinking until preteen, but then it gradually turned into a monologue and I hate it, because I can tell I got slower at mundane thoughts even if it helps me think through complex stuff.
chineseleftback 3 days ago [-]
Did her brain get bricked every time she saw something of high enough quantity?
gf000 2 hours ago [-]
AFAIK everyone's brain has a sort of hard coded number of "registers", around 3-4.
I think the visual "instant counting" also goes up to that number, so in some way we are all "bottlenecked" and require accessing "the heap".
triclops200 4 hours ago [-]
Not the OP, but, I'm also hyperphantasic, which is the name for that. For me, personally, I usually think in something akin to visuals, but, with all the other qualia mixed in as relevant, not just visuals.
Quantity is not necessarily a problem: it feels a lot like the same tradeoff as if you need to picture a lot of apples in an image of fixed resolution, you can make them smaller/less detailed just by, loosely, "allocating fewer pixels per apple", rather than needing the same detail for each that you'd need if you're trying to zoom in depth into one apple.
However, if I have a situation where I have to picture a lot of very detailed things of irreducible complexity (the details matter) that need to be placed in a specific configuration (the ordering matters), then it gets harder. Statistics was so intuitive for me that I would read the equations as visual images in my head because it was throwing out the individual details and dealing with population mechanics as individual objects of study. However, combinatorics was initially very hard for me to learn because it was dealing with very large numbers of hierarchies of orders as well as the specifics of their interrelations, so building intuitive understandings of why the theorems were correct was very difficult.
I have learned to lean on a very internally barebones representation of language/symbolic structures when needing to reason about certain complex topics that require it, but, even then, often when I'm conscious of it, it's almost like I'm visualizing the letters or forming the words as sound in my head. When I'm forming sentences to actually speak or write, it feels like I've got a concept that I've turned into a "rendering" that I'm trying to communicate via language substructures. To do so, I'll break it down into component parts and just start describing the substructures as if I'm perceiving it and describing it live in small parts. It feels like the learned skill required for speaking a language for me is learning how to decompose and reorder these objects into chunks that are expressible within the vocabulary and grammar of the target language and finding the correct words&patterns that represent and order these chunks most efficiently for effective communication. Almost feels like a SAT problem or a language diffusive process (and likely is, to some degree, related to those processes or similar under the hood), but, it actually qualitatively feels that way to me, consciously/experientially. Language feels almost bolted onto my experience rather than the primary mode of thought, even if I can think in it if needed.
nomel 2 hours ago [-]
Is there anything that you have noticed that seems "noticeably easier" for someone without hyperphantasic, compared to you?
metalman 3 days ago [-]
this must be symbolic of something, nebulous, like how statistics can mean anything that will get more grant funding, but nothing actualy specific or informative.
we can see the lesser version of this in click title writing everywhere, so the whole thing is a war for attention, but of course people seem to form some kind of resistance or more often get sucked further and further in, but then become essentialy zero sum partisipants.
thats why the quest is to get them young and lock them into lifetime spending routine
I grew up speaking 3 languages, and picked up a few more since then. To me it seems innately obvious that language is just a layer on top of the (much more complex) mental activity that goes on underneath all the time.
I do find myself thinking in one language or the other at times, but none is exclusive, often they get mixed together (the "next-token prediction" in my mind allows picking words in other languages that may more accurately describe an idea) and most frequently I do not have any internal dialogue at all.
I am pretty sure this is true for everybody, that the internal dialogue is not something natural but rather something people are so used to that we identify with it. Meditation and flow-state inducing activities (physical excercise, playing music, etc) make me think that this is the default for people, as these allow to access that lower layer of mental activity where internal dialogue disappears, even if briefly.
ashleyn 3 days ago [-]
Am I off base to view this as a strong hint AGI won't arrive through mere LLMs?
NitpickLawyer 4 hours ago [-]
First you'd have to come up with a commonly accepted definition. By some ~16 years old definitions from famous experts in the field, we've already achieved it. By today's definition (of the same expert) we haven't. There are people today that think we have it. There are people today that think we'll never have it. It's such a loaded term / topic.
Also, regarding LLMs, 2 years ago another famous expert in the field was adamant that LLMs can't plan, can't do math and they can't work at long contexts. Obviously they can do all of that now. So, really, no one knows.
nomel 2 hours ago [-]
Who uses just LLM these days!?
We use harnesses. Practically useful AI is a system of pieces already. It hasn't been pure LLM since ChatGPT 3.5 release.
krapp 3 days ago [-]
Probably not.
LLMs might be a step towards AGI (assuming that's possible) but the prevailing belief that LLMs and human brains (the latter being the most complex structures in the universe that we know of) are already functionally equivalent in every way that matters seems more like an article of faith to me than fact.
sharts 3 days ago [-]
There have been strong hints since the 60s.
8lamaster8 3 days ago [-]
Nice explainer. One nuance I’d be careful with: “the brain doesn’t think in words” is broader than what the study seems to establish. The stronger result is that the natural-language network is not necessary for the kinds of inductive and deductive reasoning tested here.
The AI implication is fascinating though. We tend to build systems where the language model is simultaneously the language interface, memory, planner, reasoner and controller. Human cognition may be pointing in the opposite architectural direction: separate persistent state, reasoning/control mechanisms and language, then let language be one tool among several.
That distinction seems more interesting to me than simply asking whether LLMs “reason in language.”
lo_zamoyski 4 hours ago [-]
One must be careful about what is meant by "language" here, which is actually language expression. LLMs don't possess conceptual content. They only operate on language expression.
Language as an internal conceptualization is still (obviously) essential to logical reasoning. The question of how language and logic relate can, therefore, concern either the internal language of concepts or the expressed language and its grammar, the latter of which is related to logic in that it reflects to some degree the internal language, but it is not identical with it.
myelinscience 3 days ago [-]
The study tested rule-induction puzzles (number sequences with hidden transformation rules) on two patients whose language networks were destroyed by stroke, plus fMRI on healthy volunteers solving the same puzzles silently. Both lines of evidence point the same way: the language network sits out during reasoning.
NitpickLawyer 4 hours ago [-]
> plus fMRI on healthy volunteers solving the same puzzles silently
Are they looking at blood flow in areas to map "language network" and other stuff? I remember a few recent papers that found that a) blood flow doesn't necessarily mean "active area" and b) two brands of fmri found completely different "areas" activating for the same patient + same puzzle.
chermi 4 hours ago [-]
disclaimer: I really don't nearly enough about this stuff to be taken seriously, these are just my immediate thoughts.
fMRI is one of the best tools we have, but that doesn't mean it's good. fMRI shit should always be taken with spoon of salt. source: a bunch of grad school friends in neuroscience and psychology a few years ago.
"on two patients whose language networks were destroyed by stroke, plus fMRI on healthy volunteers solving the same puzzles silently. Both lines of evidence point the same way: the language network sits out during reasoning."
that doesn't mean they didn't learn the meta-ability of how to solve such things without language. You can learn something with language, move it to a separate "database" in some abstracted form then pull from that "database" from a non-language component. In fact I would think the language-isn't-thinking people would favor an explanation where the thinking ability is stored independently of language. I guess my point is that no "language" component being lit up during a specific reasoning task doesn't exclude the possibility we learned that specific reasoning algorithm (for lack of a better word) via language + other things.
TL;DR maybe this specific "logic" ability is a learned-via-language+ component of the brain. Language not being active during that puzzle could just mean language+ generated that component and stored it in a more abstract form than language.
pixl97 3 hours ago [-]
What we need here, though is highly unethical, is people that were never taught language to compare to. A bunch of feral children or something like that. We do know from feral human studies that not learning language at a young age seems to make learning a lot of things nearly impossible later.
Because the system modifies itself it's going to be difficult to untangle cause and effect here.
I trialed for a month it as an off-label migraine preventative on recommendation from my neurologist.
Topamax can dampen neuronal activity in the language area of the brain for some people.
It was a terrifying experience, but it was also a valuable one as it changed the way I view intelligence.
About 10 days in, my writing and speech skills had devolved to that of a primary school aged child. I tried to type a text message and struggled to come up with simple words like “and”. My speech slowed down considerably.
The terrifying thing was that my internal world was still as complex and meaningful as it was before. All of the emotions I felt were real and legitimate. My cognition outside of language was intact, I could do math just fine and conceptualize and abstract problems.
In spite of this, I was unable to convey what I was feeling and thinking to the outside world. It felt like I was trapped inside my own body.
After recovering, my intuitive understanding of the link between language and intelligence was changed forever.
See the following for more info on Topamax/Topiramate language impairment: https://link.springer.com/article/10.1007/s10072-008-0906-5
This seems to corroborate my feeling that aptitude with language is a very poor proxy for intelligence, although it's often used as one. My own experience is that I'm less struggling to find the right words and sounds more clever at the times when my brain is actually empty and I'm "not there", and at the contrary the more "self-aware" I am and the more I struggle to articulate my thoughts, as if my brain (or ego?) was stepping in the way and slowing me down by trying to supervise what I'm saying too closely, making me sounds dumb.
I think the visual "instant counting" also goes up to that number, so in some way we are all "bottlenecked" and require accessing "the heap".
Quantity is not necessarily a problem: it feels a lot like the same tradeoff as if you need to picture a lot of apples in an image of fixed resolution, you can make them smaller/less detailed just by, loosely, "allocating fewer pixels per apple", rather than needing the same detail for each that you'd need if you're trying to zoom in depth into one apple.
However, if I have a situation where I have to picture a lot of very detailed things of irreducible complexity (the details matter) that need to be placed in a specific configuration (the ordering matters), then it gets harder. Statistics was so intuitive for me that I would read the equations as visual images in my head because it was throwing out the individual details and dealing with population mechanics as individual objects of study. However, combinatorics was initially very hard for me to learn because it was dealing with very large numbers of hierarchies of orders as well as the specifics of their interrelations, so building intuitive understandings of why the theorems were correct was very difficult.
I have learned to lean on a very internally barebones representation of language/symbolic structures when needing to reason about certain complex topics that require it, but, even then, often when I'm conscious of it, it's almost like I'm visualizing the letters or forming the words as sound in my head. When I'm forming sentences to actually speak or write, it feels like I've got a concept that I've turned into a "rendering" that I'm trying to communicate via language substructures. To do so, I'll break it down into component parts and just start describing the substructures as if I'm perceiving it and describing it live in small parts. It feels like the learned skill required for speaking a language for me is learning how to decompose and reorder these objects into chunks that are expressible within the vocabulary and grammar of the target language and finding the correct words&patterns that represent and order these chunks most efficiently for effective communication. Almost feels like a SAT problem or a language diffusive process (and likely is, to some degree, related to those processes or similar under the hood), but, it actually qualitatively feels that way to me, consciously/experientially. Language feels almost bolted onto my experience rather than the primary mode of thought, even if I can think in it if needed.
I do find myself thinking in one language or the other at times, but none is exclusive, often they get mixed together (the "next-token prediction" in my mind allows picking words in other languages that may more accurately describe an idea) and most frequently I do not have any internal dialogue at all.
I am pretty sure this is true for everybody, that the internal dialogue is not something natural but rather something people are so used to that we identify with it. Meditation and flow-state inducing activities (physical excercise, playing music, etc) make me think that this is the default for people, as these allow to access that lower layer of mental activity where internal dialogue disappears, even if briefly.
Also, regarding LLMs, 2 years ago another famous expert in the field was adamant that LLMs can't plan, can't do math and they can't work at long contexts. Obviously they can do all of that now. So, really, no one knows.
We use harnesses. Practically useful AI is a system of pieces already. It hasn't been pure LLM since ChatGPT 3.5 release.
LLMs might be a step towards AGI (assuming that's possible) but the prevailing belief that LLMs and human brains (the latter being the most complex structures in the universe that we know of) are already functionally equivalent in every way that matters seems more like an article of faith to me than fact.
The AI implication is fascinating though. We tend to build systems where the language model is simultaneously the language interface, memory, planner, reasoner and controller. Human cognition may be pointing in the opposite architectural direction: separate persistent state, reasoning/control mechanisms and language, then let language be one tool among several.
That distinction seems more interesting to me than simply asking whether LLMs “reason in language.”
Language as an internal conceptualization is still (obviously) essential to logical reasoning. The question of how language and logic relate can, therefore, concern either the internal language of concepts or the expressed language and its grammar, the latter of which is related to logic in that it reflects to some degree the internal language, but it is not identical with it.
Are they looking at blood flow in areas to map "language network" and other stuff? I remember a few recent papers that found that a) blood flow doesn't necessarily mean "active area" and b) two brands of fmri found completely different "areas" activating for the same patient + same puzzle.
fMRI is one of the best tools we have, but that doesn't mean it's good. fMRI shit should always be taken with spoon of salt. source: a bunch of grad school friends in neuroscience and psychology a few years ago.
"on two patients whose language networks were destroyed by stroke, plus fMRI on healthy volunteers solving the same puzzles silently. Both lines of evidence point the same way: the language network sits out during reasoning." that doesn't mean they didn't learn the meta-ability of how to solve such things without language. You can learn something with language, move it to a separate "database" in some abstracted form then pull from that "database" from a non-language component. In fact I would think the language-isn't-thinking people would favor an explanation where the thinking ability is stored independently of language. I guess my point is that no "language" component being lit up during a specific reasoning task doesn't exclude the possibility we learned that specific reasoning algorithm (for lack of a better word) via language + other things.
TL;DR maybe this specific "logic" ability is a learned-via-language+ component of the brain. Language not being active during that puzzle could just mean language+ generated that component and stored it in a more abstract form than language.
Because the system modifies itself it's going to be difficult to untangle cause and effect here.