I recently watched all of Star Trek: Picard, and while I was definitely on board with the vast majority of it, and extremely pleased with certain elements of it, some things kind of bothered me.
And so, as with much of the pop culture I love, I want to spend some time with the more critical perspective, in hopes that it’ll be taken as an opportunity to make it even better.
[Promotional image for Star Trek: Picard, featuring all of the series main cast.]
Below are the slides, audio, and transcripts for my talk ‘”Any Sufficiently Advanced Neglect is Indistinguishable from Malice”: Assumptions and Bias in Algorithmic Systems,’ given at the 21st Conference of the Society for Philosophy and Technology, back in May 2019.
(Cite as: Williams, Damien P. ‘”Any Sufficiently Advanced Neglect is Indistinguishable from Malice”: Assumptions and Bias in Algorithmic Systems;’ talk given at the 21st Conference of the Society for Philosophy and Technology; May 2019)
Now, I’ve got a chapter coming out about this, soon, which I can provide as a preprint draft if you ask, and can be cited as “Constructing Situated and Social Knowledge: Ethical, Sociological, and Phenomenological Factors in Technological Design,” appearing in Philosophy And Engineering: Reimagining Technology And Social Progress. Guru Madhavan, Zachary Pirtle, and David Tomblin, eds. Forthcoming from Springer, 2019. But I wanted to get the words I said in this talk up onto some platforms where people can read them, as soon as possible, for a couple of reasons.
[Free vector image of a white, female-presenting person, from head to torso, with biometric facial recognition patterns on her face; incidentally, go try finding images—even illustrations—of a non-white person in a facial recognition context.]
All these things taken together are what made me finally go ahead and get the transcript of that talk done, and posted, because these are events and policy decisions about which I a) have been speaking and writing for years, and b) have specific inputs and recommendations about, and which are, c) frankly wrongheaded, and outright hateful.
And I want to spend time on it because I think what doesn’t get through in many of our discussions is that it’s not just about how Artificial Intelligence, Machine Learning, or Algorithmic instances get trained, but the processes for how and the cultural environments in which HUMANS are increasingly taught/shown/environmentally encouraged/socialized to think is the “right way” to build and train said systems.
That includes classes and instruction, it includes the institutional culture of the companies, it includes the policy landscape in which decisions about funding and get made, because that drives how people have to talk and write and think about the work they’re doing, and that constrains what they will even attempt to do or even understand.
All of this is cumulative, accreting into institutional epistemologies of algorithm creation. It is a structural and institutional problem.
So, as you know, back in the summer of 2017 I participated in SRI International’s Technology and Consciousness Workshop Series. This series was an eight week program of workshops the current state of the field around, the potential future paths toward, and the moral and social implications of the notion of conscious machines. To do this, we brought together a rotating cast of dozens of researchers in AI, machine learning, psychedelics research, ethics, epistemology, philosophy of mind, cognitive computing, neuroscience, comparative religious studies, robotics, psychology, and much more.
[Image of my name card from the Technology & Consciousness workshop series.]
We traveled from Arlington, VA, to Menlo Park, CA, to Cambridge, UK, and back, and while my primary role was that of conference co-ordinator and note-taker (that place in the intro where it says I “maintained scrupulous notes?” Think 405 pages/160,656 words of notes, taken over eight 5-day weeks of meetings), I also had three separate opportunities to present: Once on interdisciplinary perspectives on minds and mindedness; then on Daoism and Machine Consciousness; and finally on a unifying view of my thoughts across all of the sessions. In relation to this report, I would draw your attention to the following passage:
An objection to this privileging of sentience is that it is anthropomorphic “meat chauvinism”: we are projecting considerations onto technology that derive from our biology. Perhaps conscious technology could have morally salient aspects distinct from sentience: the basic elements of its consciousness could be different than ours.
All of these meetings were held under the auspices of the Chatham House Rule, which meant that there were many things I couldn’t tell you about them, such as the names of the other attendees, or what exactly they said in the context of the meetings. What I was able tell you, however, was what I talked about, and I did, several times. But as of this week, I can give you even more than that.
This past Thursday, SRI released an official public report on all of the proceedings and findings from the 2017 SRI Technology and Consciousness Workshop Series, and they have told all of the participants that they can share said report as widely as they wish. Crucially, that means that I can share it with you. You can either click this link, here, or read it directly, after the cut.
[This paper was prepared for the 2019 Towards Conscious AI Systems Symposium co-located with the Association for the Advancement of Artificial Intelligence 2019 Spring Symposium Series.
Abstract. This paper explores the moral, epistemological, and legal implications of multiple different definitions and formulations of human and nonhuman consciousness. Drawing upon research from race, gender, and disability studies, including the phenomenological basis for knowledge and claims to consciousness, I discuss the history of the struggles for personhood among different groups of humans, as well as nonhuman animals, and systems. In exploring the history of personhood struggles, we have a precedent for how engagements and recognition of conscious machines are likely to progress, and, more importantly, a roadmap of pitfalls to avoid. When dealing with questions of consciousness and personhood, we are ultimately dealing with questions of power and oppression as well as knowledge and ontological status—questions which require a situated and relational understanding of the stakeholders involved. To that end, I conclude with a call and outline for how to place nuance, relationality, and contextualization before and above the systematization of rules or tests, in determining or applying labels of consciousness.
Keywords: Consciousness, Machine Consciousness, Philosophy of Mind, Phenomenology, Bodyminds
[Overlapping images of an Octopus carrying a shell, a Mantis Shrimp on the sea floor, and a Pepper Robot]
As you already know, we went to the second Juvet A.I. Retreat, back in September. If you want to hear several of us talk about what we got up to at the then you’re in luck because here are several conversations conducted by Ben Byford of the Machine Ethics Podcast.
I am deeply grateful to Ben Byford for asking me to sit down and talk about this with him. I talk a great deal, and am surprisingly able to (cogently?) get on almost all of my bullshit—technology and magic and the occult, nonhuman personhood, the sham of gender and race and other social constructions of expected lived categories, the invisible architecture of bias, neurodiversity, and philosophy of mind—in a rather short window of time.
The goals for this summit were to start looking at the ways in which issues of algorithms, intelligent machine systems, human biotech, religion, surveillance, and more will intersect and affect us in the social, academic, political spheres. The big challenge in all of this was seen as getting better at dealing with this in the university and public policy sectors, in America, rather than the seeming worse we’ve gotten, so far.
Here’s the schedule. Full notes, below the cut.
Friday, June 8, 2018
Josh Brown on “the distinction between passive and active AI.”
Daylan Dufelmeier on “the potential ramifications of using advanced computing in the criminal justice arena…”
Mario Khreiche on the effects of automation, Amazon’s Mechanical Turk, and the Microlabor market.
Aaron Nicholson on how technological systems are used to support human social outcomes, specifically through the lens of policing in the city of Atlanta
Ralph Hall on “the challenges society will face if current employment and income trends persist into the future.”
Jacob Thebault-Spieker on “how pro-urban and pro-wealth biases manifest in online systems, and how this likely influences the ‘education’ of AI systems.”
Hani Awni on the sociopolitical of excluding ‘relational’ knowledge from AI systems.
Saturday, June 9, 2018
Chelsea Frazier on rethinking our understandings of race, biocentrism, and intelligence in relation to planetary sustainability and in the face of increasingly rapid technological advancement.
Ras Michael Brown on using the religions technologies of West Africa and the West African Diaspora to reframe how we think about “hybrid humanity.”
Damien Williams on how best to use interdisciplinary frameworks in the creation of machine intelligence and human biotechnological interventions.
Sara Mattingly-Jordan on the implications of the current global landscape in AI ethics regulation.
Kent Myers on several ways in which the intelligence community is engaging with human aspects of AI, from surveillance to sentiment analysis.
Emma Stamm on the idea that datafication of the self and what about us might be uncomputable.
I talked with Hewlett Packard Enterprise’s Curt Hopkins, for their article “4 obstacles to ethical AI (and how to address them).” We spoke about the kinds of specific tools and techniques by which people who populate or manage artificial intelligence design teams can incorporate expertise from the humanities and social sciences. We also talked about compelling reasons why they should do this, other than the fact that they’re just, y’know, very good ideas.
From the Article:
To “bracket out” bias, Williams says, “I have to recognize how I create systems and code my understanding of the world.” That means making an effort early on to pay attention to the data entered. The more diverse the group, the less likely an AI system is to reinforce shared bias. Those issues go beyond gender and race; they also encompass what you studied, the economic group you come from, your religious background, all of your experiences.
…
That becomes another reason to diversify the technical staff, says Williams. This is not merely an ethical act. The business strategy may produce more profit because the end result may be a more effective AI. “The best system is the one that best reflects the wide range of lived experiences and knowledge in the world,” he says.
[Image of two blank, white, eyeless faces, partially overlapping each other.]
To be clear, this is an instance in which I tried to find capitalist reasons that would convince capitalist people to do the right thing. To that end, you should imagine that all of my sentences start with “Well if we’re going to continue to be stuck with global capitalism until we work to dismantle it…” Because they basically all did.
All of that being said, I’m not the only person there with something interesting to say, and you should go check out the rest of my and other people’s comments.
…“You see this clump of failures below 25 percent and this clump of successes above 25 percent,” Centola says. “Mathematically, we predicted that, but seeing it in a real population was phenomenal.”
“What I think is happening at the threshold is that there’s a pretty high probability that a noncommitted actor”—a person who can be swayed in any direction—“will encounter a majority of committed minority actors, and flip to join them,” says Pamela Oliver, a sociologist at the University of Wisconsin at Madison. “There is therefore a good probability that enough non-committed actors will all flip at the same time that the whole system will flip.”
We talked about a lot, and much of it didn’t make it into the article, but one of the things that matters most about all of this is that we’re going to have to be increasingly mindful and intentional about the information we take in. We now know that we have the ability to move the needle of conversation, with not too much effort, and with this knowledge we can make progressive social change. We can use this to fight against the despair that can so easily creep into this work of spreading compassion and trying to create a world where we can all flourish.
[Argentina’s Mt Tronador Casaño Overa glacier, by McKay Savage]
But we have to know that there will also be those who see this as a target number to hit so that they might better disrupt and destabilize groups and beliefs. We already know that many such people are hard at work, trying to sow doubt and mistrust. We already have evidence that these actors will make other people’s lives unpleasant for the sake of it. With this new research, they’ll be encouraged, as well. As I said to Ed Yong:
“There are already a number of people out there who are gaming group dynamics in careful ways… If they know what target numbers they have to hit, it’s easy to see how they could take this information and create [or increase the output of the existing] sentiment-manipulation factory.”
The infiltration of progressive groups to move them toward chaos and internal strife is not news, just like the infiltration (and origin) of police and military groups by white supremacists is not news.
And so, while I don’t want to add to a world in which people feel like they have to continually mistrust each other, we do have to be intentional about the work we do, and how we do it, and we have to be mindful of who is trying to get us to believe what, and why they want us to believe it. Especially if we want to get others to believe and value as we do.
This research gives us a useful set of tools and a good to place to start.
This weekend, Virginia Tech’s Center for the Humanities is hosting The Human Futures and Intelligent Machines Summit, and there is a link for the video cast of the events. You’ll need to Download and install Zoom, but it should be pretty straightforward, other than that.
Late last month, I was at Theorizing the Web, in NYC, to moderate Panel B3, “Bot Phenomenology,” in which I was very grateful to moderate a panel of people I was very lucky to be able to bring together. Johnathan Flowers, Emma Stamm, and Robin Zebrowski were my interlocutors in a discussion about the potential nature of nonbiological phenomenology. Machine consciousness. What robots might feel.
I led them through with questions like “What do you take phenomenology to mean?” and “what do you think of the possibility of a machine having a phenomenology of its own?” We discussed different definitions of “language” and “communication” and “body,” and unfortunately didn’t have a conversation about how certain definitions of those terms mean that what would be considered language between cats would be a cat communicating via signalling to humans.
It was a really great conversation and the Live Stream video for this is here, and linked below (for now, but it may go away at some point, to be replaced by a static youtube link; when I know that that’s happened, I will update links and embeds, here).
Hello there, I’m Damien Williams, or @Wolven many places on the internet. For the past nine years, I’ve been writing, talking, thinking, teaching, and learning about philosophy, comparative religion, magic, artificial intelligence, human physical and mental augmentation, pop culture, and how they all relate. I want to think about, talk about, and work toward, a future worth living in, and I want to do it with you. I can also be found at http://Technoccult.net (@Techn0ccult).