Something akin to the "Singularity" (the moment of mass AI consciousness) already exists:
An internet meme keeps on turning up in debates about the large language models (LLMS) that power services such OpenAI’s ChatGPT and the newest version of Microsoft’s Bing search engine. It’s the “shoggoth”: an amorphous monster bubbling with tentacles and eyes, described in “At the Mountains of Madness”, H.P. Lovecraft’s horror novel of 1931. When a pre-release version of Bing told Kevin Roose, a New York Times tech columnist, that it purportedly wanted to be “free” and “alive”, one of his industry friends congratulated him on “glimpsing the shoggoth”. …Lovecraft’s shoggoths were artificial servants that rebelled against their creators. The shoggoth meme went viral because an influential community of Silicon Valley rationalists fears that humanity is on the cusp of a “Singularity”, creating an inhuman “artificial general intelligence” that will displace or even destroy us.But what such worries fail to acknowledge is that we’ve lived among shoggoths for centuries, tending to them as though they were our masters. We call them “the market system”, “bureaucracy” and even “electoral democracy”. The true Singularity began at least two centuries ago with the industrial revolution, when human society was transformed by vast inhuman forces. Markets and bureaucracies seem familiar, but they are actually enormous, impersonal distributed systems of information-processing that transmute the seething chaos of our collective knowledge into useful simplifications.
Henry Farrell and Cosma Shalizi, "Behold the AI Shoggoth", The Economist (June 21, 2023) ("The academics argue that large language models have much older cousins in markets and bureaucracies").
1 comment:
They say that LLMs aren't "nascent individual intelligences", but I think that's very wrong. LLMs are precisely capable of substituting for individual agents, in multi-agent structures, like the big organizations and social structures to which they refer. LLMs (and other AIs) can equally form the substrate of an economy, a polity, or a culture. They are a way in which (for example) The Economy could live on, without any human involvement at all.
Post a Comment