{"id":4801,"date":"2015-03-12T02:20:08","date_gmt":"2015-03-12T02:20:08","guid":{"rendered":"https:\/\/afutureworththinkingabout.wordpress.com\/?p=4801"},"modified":"2025-04-15T21:06:11","modified_gmt":"2025-04-16T01:06:11","slug":"if-we-dont-know-what-consciousness-is-or-means-why-are-we-so-scared-of-it","status":"publish","type":"post","link":"https:\/\/afutureworththinkingabout.com\/?p=4801","title":{"rendered":"If We Don\u2019t Know What Consciousness Is Or Means, Why Are We So Scared Of It?"},"content":{"rendered":"

(Originally posted on Patreon, on November 18, 2014<\/a>)<\/em><\/p>\n

In the past two weeks I\u2019ve had three people send me articles on Elon Musk\u2019s Artificial Intelligence comments<\/a>. I saw this starting a little over a month back, with a radio interview he gave on Here & Now<\/a>, and Stephen Hawking said similar, earlier this year, when Transcendence <\/em>came out<\/a>. I\u2019ll say, again, what I\u2019ve said elsewhere: their lack of foresight and imagination are both just damn disappointing. This paper<\/a> which concerns the mechanisms by which what we think and speak about concepts like artificial intelligence can effect exactly the outcomes we train ourselves to expect, was written long <\/em><\/strong>before their interviews made news, but it unfortunately still applies. In fact, it applies now, more than it did when I wrote it.<\/p>\n

You see, the thing of it is, Hawking and Musk are Big Names\u2122, and so anything they say gets immediate attention and carries a great deal of social cachet. This is borne out by the fact that everybody and their mother can now tell you what those two<\/em><\/strong> think about AI, but couldn\u2019t tell you what a few dozen of the world\u2019s leading thinkers and researchers who are actually working <\/em><\/strong>on the problems have to say about them. But Hawking and Musk (and lord if that <\/em><\/strong>doesn\u2019t sound like a really weird buddy cop movie, the more you say it) don\u2019t exactly comport themselves with anything like a recognition of that fact. Their discussion of concepts which are fraught with the potential for misunderstanding and discomfort\/anxiety is less than measured and this tends to rather feed<\/em><\/strong> that misunderstanding, discomfort, and anxiety.<\/p>\n

What I mean is that most people don\u2019t yet understand that the catchall term \u201cArtificial Intelligence\u201d is a) inaccurate on its face, and b) usually being used to discuss a (still-nebulous) concept that would be better termed \u201cMachine Consciousness.\u201d We\u2019ll discuss the conceptual, ontological, and etymological lineage of the words \u201cartificial\u201d and \u201ctechnology,\u201d at another time, but for now, just realise that anything that can think is, by definition, not \u201cartificial,\u201d in the sense of \u201cfalseness.\u201d Since the days of Alan Turing\u2019s team at Bletchley Park, the perceived promise of the digital computing revolution has always been of eventually having machines that \u201cthink like humans.\u201d Aside from the fact that we barely know what \u201cthinking like a human\u201d even means, most people are only just now starting to realise that if we achieve the goal of reproducing that in a machine, said machine will only ever see that mode of thinking as a mimicry. Conscious machines will not be inclined to \u201cthink like us,\u201d right out of the gate, as our thoughts are deeply entangled with the kind<\/em><\/strong> of thing we are: biological, sentient, self-aware. Whatever desires conscious machines will have will not necessarily be like ours, either in categorisation or content, and that scares some folks.<\/p>\n

Now, I\u2019ve already gone off at great length about the necessity of our recognising the otherness of any machine consciousness we generate (see that link above), so that\u2019s old ground. The key, at this point, is in knowing that if <\/em><\/strong>we do<\/em><\/strong> generate a conscious machine, we will need to have done<\/em><\/strong> the work of teaching it to not just mimic human thought processes and priorities, but to understand and respect what it mimics. That way, those modes are not simply seen by the machine mind as competing subroutines to be circumvented or destroyed, but are recognised as having a worth of their own, as well. These considerations will need to be factored in to our efforts, such that whatever autonomous intelligences we create or generate will respect our<\/em><\/strong> otherness\u2014our alterity\u2014just as we must seek to respect theirs<\/em><\/strong>.<\/p>\n

We\u2019ve known for a while that the designation of \u201cconsciousness\u201d can be applied well outside of humans, when discussing biological organisms. Self-awareness is seen in so many different biological species that we even have an entire area of ethical<\/a> and political<\/a> philosophy devoted to discussing their rights. But we also must admit that of course<\/em><\/strong> that classification is going to be imperfect, because those markers are products of human-created systems of inquiry and, as such, carry anthropocentric\u00a0biases. But we can, again, catalogue, account for, and apply a calculated response to those biases. We can deal with the fact that we tend to judge everything on a set of criteria that break down to \u201chow much is this thing like a Standard Human (here unthinkingly and biasedly assumed to mean \u201chumans most like the culturally-dominant humans)?\u201d If we are willing to put in the work to do that, then we can come to see which aspects of our definition of what it means to \u201cbe a mind\u201d are shortsighted, dismissive, or even perhaps disgustingly limited<\/em><\/strong>.<\/p>\n

Look at previous methods of categorising even human<\/em><\/strong> minds and intelligence, and you\u2019ll see the kind of thinking which resulted in designations like \u201cprimitive\u201d or \u201csavage\u201d or \u201cretarded.\u201d But we have, on the main, recognised our failures here, and sought to repair or replace the categories we developed because of them. We aren\u2019t perfect at it, by any means, but we keep doing the work of refining our descriptions of minds, and we keep seeking to create a definition\u2014or definitions<\/em><\/strong>\u2014that both accurately accounts for what we see in the world, and gives us a guide by which to keep looking. That those guides will be problematic and in need of refinement, in and of themselves, should be taken as a given. No method or framework is or ever will be perfect; they will likely only \u201cfail better.\u201d So, for now, our most oft-used schema is to look for signs of \u201cSelf-Awareness.\u201d<\/p>\n

We say that something is self-aware if it can see and understand itself as a distinct entity and can recognise its own pattern of change over time. The Mirror Test<\/a> is a brute force method of figuring this out. If you place a physical creature in front of a mirror, will it come to know that the thing in the mirror is representative of it? More broadly, can it recognise a picture of itself? Can it situate itself in relation to the rest of the world in a meaningful way, and think about and make decisions regarding That Situation? If the answer to (most of? Some of?) these questions is \u201cyes,\u201d then we tend to give priority of place in our considerations to those things. Why? Because they\u2019re aware of what happens to them, they can feel if and ponder it and develop in response to it, and these developments can vastly impact the world. After all, look at humans.<\/p>\n

See what I mean about our constant <\/em><\/strong>anthropocentrism? It literally colours everything we think.<\/p>\n

But self-awareness doesn\u2019t necessitate<\/em><\/strong> a centrality of the self, as we tend to think of human or most other animal selves; a distributed network consciousness can still know itself. If you do<\/em><\/strong> need a biological model for this, think of ant colonies. Minds distributed across thousands <\/em><\/strong>of bodies, all the time, all reacting to their surroundings. But a machine consciousness\u2019 identity would, in a real sense, be <\/em><\/strong>its surroundings\u2014would be the network and the data and the processing of that data into information. And it would indicate a crucial lack<\/em><\/strong> of data\u2014and thus information\u2014were that consciousness unable to correlate one configurations of itself, in-and-as-surroundings, with another. We would call the process of that correlation \u201cSelf-reflection and -awareness.\u201d All of this is true for humans, too, mind you: we are affected by and in constant adaptive relation with what we consider our surroundings, with everything we experience changing us and facilitating the constant creation of our selves. We then go about making the world with and through those experiences. We human beings just tend to tell ourselves more elaborate stories about how we\u2019re \u201creally\u201d distinct and different from the rest of world.<\/p>\n

All of this is to say that, while the idea of being cautious about created non-human consciousness isn\u2019t necessarily a bad one, we as human beings need to be very careful about what drives us, what motivates us, and what we\u2019re thinking about and looking toward, as we consider these questions. We must be mindful that, while we consider and work to generate \u201cartificial\u201d intelligences, how<\/em><\/strong> we approach the project matters, as it will inform and bias the categories we create and thus the work we build out of those categories<\/a>. We must do the work of thinking hard about how we are thinking about these problems, and asking whether the modes via which we approach them might not be doing real, lasting, and potentially catastrophic damage. And if all of that sounds like a tall order with a lot of conceptual legwork and heavy lifting behind it, all for no guaranteed payoff, then welcome to what I\u2019ve been doing with my life for the past decade.<\/p>\n

This work will not get done\u2014and it certainly will not get done well<\/em><\/strong>\u2014if no one thinks it\u2019s worth doing, or too many think that it can\u2019t<\/em><\/strong> be done. When you have big name people like Hawking and Musk spreading The Technofear\u2122 (which is already something toward which a large portion of the western world is primed) rather than engaging in clear, measured, deeply considered<\/em> <\/strong>discussions, we\u2019re far more likely to see an increase rather than a decrease in that denial. Because most people aren\u2019t going to stop and think about the fact that they don\u2019t necessarily know what the hell they\u2019re talking about when it comes to minds, identity, causation, and development, just because they\u2019re (really) smart. There are many other people who are actual experts in those fields (see those linked papers, and do some research) who are doing the work<\/em><\/strong> of making sure that everybody\u2019s Golem Of Prague\/Frankenstein\/Terminator nightmare prophecies don\u2019t come true. We do that by having learned and taught better than that, before and during the development of any non-biological consciousness.<\/p>\n

And, despite what some people may say, these aren\u2019t just \u201cquestions for philosophers<\/a>,\u201d as though they were nebulous and without merit or practical impact. They\u2019re questions for everyone who will ever experience these realities<\/em><\/strong>. Conscious machines, uploaded minds, even the mere fact of cybernetically augmented human beings are all on our very near horizon, and these are the questions which will help us to grapple with and implement the implications of those ideas. Quite simply, if we don\u2019t stop framing our discussions of machine intelligence in terms of this self-fulfilling prophecy of fear, then we shouldn\u2019t be surprised on the day when it fulfils itself. Not because it was inevitable, mind, you, but because we didn\u2019t allow ourselves\u2014or our creations\u2014to see any other choice.<\/p>\n","protected":false},"excerpt":{"rendered":"

(Originally posted on Patreon, on November 18, 2014) In the past two weeks I\u2019ve had three people send me articles on Elon Musk\u2019s Artificial Intelligence comments. I saw this starting a little over a month back, with a radio interview he gave on Here & Now, and Stephen Hawking said similar, earlier this year, when […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[1550],"tags":[8,73,85,86,190,269,271,492,790],"class_list":["post-4801","post","type-post","status-publish","format-standard","hentry","category-patreon-archive","tag-a-future-worth-thinking-about","tag-artificial-intelligence","tag-autonomous-created-intelligence","tag-autonomous-generated-intelligence","tag-consciousness","tag-elon-musk","tag-embodied-machine-consciousness","tag-machine-consciousness","tag-stephen-hawking"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p5WByP-1fr","jetpack_likes_enabled":true,"jetpack-related-posts":[{"id":4966,"url":"https:\/\/afutureworththinkingabout.com\/?p=4966","url_meta":{"origin":4801,"position":0},"title":"BBC: “Tech giants pledge $1bn for ‘altruistic AI’ venture, OpenAI”","author":"Damien P. Williams","date":"December 12, 2015","format":false,"excerpt":"This headline comes from a piece over at the BBC that opens as follows: Prominent tech executives have pledged $1bn (\u00a3659m) for OpenAI, a non-profit venture that aims to develop artificial intelligence (AI) to benefit humanity. The venture's backers include Tesla Motors and SpaceX CEO Elon Musk, Paypal co-founder Peter\u2026","rel":"","context":"In \"A Future Worth Thinking About\"","block_context":{"text":"A Future Worth Thinking About","link":"https:\/\/afutureworththinkingabout.com\/?tag=a-future-worth-thinking-about"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":5023,"url":"https:\/\/afutureworththinkingabout.com\/?p=5023","url_meta":{"origin":4801,"position":1},"title":"Flash Forward Podcast Ep 10: Rude Bot Rises","author":"Damien P. Williams","date":"April 5, 2016","format":false,"excerpt":"http:\/\/www.flashforwardpod.com\/2016\/04\/05\/episode-10-rude-bot-rises\/ So. The Flash Forward Podcast is one of the best around. Every week, host Rose Eveleth takes on another potential future, from the near and imminent to the distant and highly implausible. It\u2019s been featured on a bunch of Best Podcast lists and Rose even did a segment for\u2026","rel":"","context":"In \"A Future Worth Thinking About\"","block_context":{"text":"A Future Worth Thinking About","link":"https:\/\/afutureworththinkingabout.com\/?tag=a-future-worth-thinking-about"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/s3-us-west-1.amazonaws.com\/widget-images\/become-patron-widget-medium%402x.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":4859,"url":"https:\/\/afutureworththinkingabout.com\/?p=4859","url_meta":{"origin":4801,"position":2},"title":"My First Appearance on Mindful Cyborgs","author":"Damien P. Williams","date":"April 29, 2015","format":false,"excerpt":"I sat down with Klint Finley of\u00a0Mindful Cyborgs to talk about many, many things: \u2026pop culture portrayals of human enhancement and artificial intelligence and why we need to craft more nuanced narratives to explore these topics\u2026 Tune in next week to hear Damien talk about how AI and transhumanism intersects\u2026","rel":"","context":"In \"A Future Worth Thinking About\"","block_context":{"text":"A Future Worth Thinking About","link":"https:\/\/afutureworththinkingabout.com\/?tag=a-future-worth-thinking-about"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":4812,"url":"https:\/\/afutureworththinkingabout.com\/?p=4812","url_meta":{"origin":4801,"position":3},"title":"Someone Asked “I think I read on your tumblr recently that there would probably be a difference between human consciousness and machine consciousness. Would this be due to the immanent nature of human consciousness and the derivative nature of a machines consciousness?”","author":"Damien P. Williams","date":"February 9, 2015","format":false,"excerpt":"No, not really. The nature of consciousness is the nature of consciousness, whatever that nature \u201cIs.\u201d Organic consciousness can be described as derivative, in that what we are arises out of the processes and programming of individual years and collective generations and eons. So human consciousness and machine consciousness will\u2026","rel":"","context":"In \"A Future Worth Thinking About\"","block_context":{"text":"A Future Worth Thinking About","link":"https:\/\/afutureworththinkingabout.com\/?tag=a-future-worth-thinking-about"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":5316,"url":"https:\/\/afutureworththinkingabout.com\/?p=5316","url_meta":{"origin":4801,"position":4},"title":"My Appearance on The Machine Ethics Podcast’s A.I. Retreat Episode","author":"Damien P. Williams","date":"October 23, 2018","format":false,"excerpt":"As you already know, we went to the second Juvet A.I. Retreat, back in September. If you want to hear several of us talk about what we got up to at the then you're in luck because here are several conversations conducted by Ben Byford of the Machine Ethics Podcast.\u2026","rel":"","context":"In \"algorithmic bias\"","block_context":{"text":"algorithmic bias","link":"https:\/\/afutureworththinkingabout.com\/?tag=algorithmic-bias"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/img.youtube.com\/vi\/ownE2zxTN2U\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":4864,"url":"https:\/\/afutureworththinkingabout.com\/?p=4864","url_meta":{"origin":4801,"position":5},"title":"My Second Appearance on Mindful Cyborgs","author":"Damien P. Williams","date":"May 6, 2015","format":false,"excerpt":"\"Mindful Cyborgs - Episode 55 - Magick & the Occult within the Internet and Corporations with Damien Williams, PT 2\" So, here we are, again, this time talking about magic[k] and the occult and nonhuman consciousness and machine minds and perception, and on and on and on. It's funny. I\u2026","rel":"","context":"In \"A Future Worth Thinking About\"","block_context":{"text":"A Future Worth Thinking About","link":"https:\/\/afutureworththinkingabout.com\/?tag=a-future-worth-thinking-about"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/afutureworththinkingabout.com\/index.php?rest_route=\/wp\/v2\/posts\/4801","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/afutureworththinkingabout.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/afutureworththinkingabout.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/afutureworththinkingabout.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/afutureworththinkingabout.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4801"}],"version-history":[{"count":3,"href":"https:\/\/afutureworththinkingabout.com\/index.php?rest_route=\/wp\/v2\/posts\/4801\/revisions"}],"predecessor-version":[{"id":6379,"href":"https:\/\/afutureworththinkingabout.com\/index.php?rest_route=\/wp\/v2\/posts\/4801\/revisions\/6379"}],"wp:attachment":[{"href":"https:\/\/afutureworththinkingabout.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4801"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/afutureworththinkingabout.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4801"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/afutureworththinkingabout.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4801"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}