Thursday, December 18, 2025

In the nick of time

 

- Cognitive collapse? What cognitive collapse, bruh?
Credit: Hzh 

Dude, this came in the nick of time. JMG on the cognitive collapse of elites, anti-elitist rebel subcultures and individuals. Disturbing but true! I will permit myself to quote some paragraphs here: 

>>>Much of the political strife in today’s industrial states, in fact, is driven by a conflict between two competing forms of cognitive collapse. In one corner of the boxing ring, we have the defending champion, cognitive collapse driven by mass media, in which everyone is bombarded by, and expected to believe, the same false statements promoted by authoritative voices, and so most people go crazy in the same way at more or less the same time. In the other corner we have cognitive collapse driven by social media, in which each little subculture generates its own private echo chamber and broadcasts its own unique set of false statements that members are expected to believe, and so different groups go crazy in different ways at different times.

>>>Yet there’s a third contender in the fight, though it seems to have been noticed by very few people as yet. Just as previous shifts in communications technologies have driven changes in modes of cognitive collapse, the shift being ballyhooed by tech moguls these days—the rise of LLMs—is beginning to generate a new form of cognitive collapse in which individuals create, inhabit, and suffer the consequences of their own private echo chambers.

>>>One of the many downsides of LLMs is that they make a breakdown in reality testing much easier to achieve on an individual basis. Since there is no genuine intelligence in “artificial intelligence,” just statistically likely sequences of words and the like being spat out stochastically in response to queries, it is very easy for a person and an LLM to form a feedback loop that spins rapidly off into cognitive collapse. Some cases of this have already made the media: people who took to treating some LLM as a conversation partner, and ended up talking both it and themselves into some bizarre set of beliefs completely disconnected from any reality accessible to the rest of us. As LLMs become more widespread, there’s every reason to expect that this sort of computer-mediated psychosis will become more widespread, too.

>>>This could spread very far and become extraordinarily destructive. What happens, for example, if most people in the industrial world start getting their news from personalized newsfeeds using LLMs, and these start drifting out of synch with the world, each in its own direction? We’ve already seen some of that, courtesy of social media—consider the giddy range of reactions to the Covid fiasco of 2019-2022, just for one example—but a shift from subculture-based echo chambers to individual echo chambers could slam the same process into overdrive.

Cognitive Collapse: A First Reconnaissance

6 comments:

  1. Yes! "since there is no intelligence in artificial intelligence" just pull the plug out and Poof! Bye bye LLM's. First, the internet, then social media, then the loss of any credible media, then the rise of AI and soon we're in deep shit! I quit watching television years ago to stop the bombardment of inane comedic plots and 20 minutes of commercials. So now watching "foreign" series via streaming...their
    situations are unknown to me and so appear as "new." Also JMG's comment about inputting intentionally dichotomous material into the LLM will cause it to evolve into a form of schizophrenia and hence collapse has occurred to me...another "dark world" of guerrilla attacks that indeed will be in the future.

    ReplyDelete
  2. There are rumors/fears that Russia and China are feeding the LLMs disinfo about various topics, for instance the war in Ukraine, but this scenario is different. Purely by chance(?) I saw an old movie the other day, "Alphaville", which culminated precisely in that kind of scenario: the hero destroys a super-computer by asking it a riddle it can´t comprehend and...poof. An entire civilization collapses.

    ReplyDelete
  3. Another take away from JMG´s essay is that the opposition to the system is just as fucked (pardon my French) as the establishment. There is "cognitive collapse" all across the board. Fact check: mostly true.

    ReplyDelete
    Replies
    1. Ever curious, I looked up where that expression- pardon my French- came from.

      Delete
  4. What bothers me also is the young people that have been raised with an iPhone or tablet in their hands since they could walk have no concept of just sitting out in Nature and "grooving on the vibe." Leading back to JMG's notice of the mostly unknown Gregory Bateson's theories on causes of schizophrenia. As Creatures of the planet we need to distance ourselves from living "too much in the head" and dangle our feet in the stream now and then. Hopefully not polluted beyond our tolerances!

    ReplyDelete