The textual content anticipated a number of fashionable AI security issues, together with the opportunity of machine consciousness, self-replication, and people shedding management of their technological creations. These themes later appeared in works like Isaac Asimov’s The Evitable Battle and the Matrix movies.
Butler’s letter dug deep into the taxonomy of machine evolution, discussing mechanical “genera and sub-genera” and pointing to examples like how watches had developed from “cumbrous clocks of the thirteenth century”—suggesting that, like some early vertebrates, mechanical species would possibly get smaller as they turned extra refined. He expanded these concepts in his 1872 novel Erewhon, which depicted a society that had banned most mechanical innovations. In his fictional society, residents destroyed all machines invented throughout the earlier 300 years.
Butler’s issues about machine evolution obtained combined reactions, in line with Butler within the preface to the second version of Erewhon. Some reviewers, he stated, interpreted his work as an try and satirize Darwin’s evolutionary concept, although Butler denied this. In a letter to Darwin in 1865, Butler expressed his deep appreciation for The Origin of Species, writing that it “completely fascinated” him and defined that he had defended Darwin’s concept in opposition to critics in New Zealand’s press.
What makes Butler’s imaginative and prescient significantly exceptional is that he was writing in a vastly completely different technological context when computing gadgets barely existed. Whereas Charles Babbage had proposed his theoretical Analytical Engine in 1837—a mechanical laptop utilizing gears and levers that was by no means inbuilt his lifetime—probably the most superior calculating gadgets of 1863 have been little greater than mechanical calculators and slide guidelines.
Butler extrapolated from the easy machines of the Industrial Revolution, the place mechanical automation was remodeling manufacturing, however nothing resembling fashionable computer systems existed. The first working program-controlled laptop would not seem for an additional 70 years, making his predictions of machine intelligence strikingly prescient.
Some issues by no means change
The controversy Butler began continues at the moment. Two years in the past, the world grappled with what one would possibly name the “nice AI takeover scare of 2023.” OpenAI’s GPT-4 had simply been launched, and researchers evaluated its “power-seeking conduct,” echoing issues about potential self-replication and autonomous decision-making.
GPT-4’s launch impressed a number of open letters signed by AI researchers and tech executives warning of potential extinction-level dangers posed by superior synthetic intelligence. One of many letters, harking back to fears about nuclear weapons or pandemics, referred to as for a worldwide pause on AI improvement. Across the similar time, OpenAI CEO Sam Altman testified of AI risks in entrance of the US Senate.
