Legal Studies Research Paper Series

This paper can be downloaded without charge from

the Social Science Research Network electronic

library at: http://ssrn.com/abstract=3844948

The Law of the Upload

João Marinotti & Asaf Lubin

Research Paper Number 451

2021

Electronic copy available at: https://ssrn.com/abstract=3844948

THE LAW OF THE UPLOAD

João Marinotti and Asaf Lubin*

ABSTRACT

In April 2020, Amazon released a new comedy series called “Upload.” The show extrapolates a future in which human consciousness is successfully simulated in silico. In this world, individuals pay to be “uploaded” into a digital afterlife. When uploaded, human consciousness is converted into data and executable code, which can be edited, reset, or even deleted depending on each upload’s membership and payment plan. The show breaks the boundaries between reality and virtual reality, consciousness and artificial intelligence, and even life and afterlife, entangling existing legal questions in novel ways. By addressing three of these legal issues, we hope to highlight how science fiction may help launch a more nuanced conversation about what is artificial in artificial intelligence, what is virtual in virtual reality, and what is digital in digital rights. We argue that becoming early adopters of a new reconceptualized language around “us” and “them”, the “self” and the “other,” can perhaps future proof our society from the technological perils that await us.

TABLE OF CONTENTS

INTRODUCTION ……………………………………………………………………………………………. 2

I. LOSS OF PERSONHOOD THROUGH CONTRACT AND COPYRIGHT …………. 3

II. POWER DYNAMICS OF TECHNOLOGY AS LIFE ………………………………………. 6

III. ARE DIGITAL RIGHTS ABOVE ALL OTHERS? ………………………………………… 9

CONCLUSION ………………………………………………………………………………………………. 10

* João Marinotti is a Visiting Fellow at the Information Society Project at Yale Law

School, a Visiting Fellow at the Center for Quantum Networks, a Fellow at the Indiana University Center for Intellectual Property Research, and the Jerome Hall Postdoctoral Fellow at Indiana University’s Center for Law Society and Culture.

Asaf Lubin is an Associate Professor of Law at Indiana University Maurer School of Law, a Fellow at the Center for Applied Cybersecurity Research at Indiana University, an Affiliated Fellow at the Information Society Project at Yale Law School, and a Faculty Associate at the Berkman Klein Center for Internet and Society at Harvard University.

We wish to thank the organizers and participants of the Artificial Intelligence and Fiction International Conference for reading our work and for any feedback provided during the conference.

Electronic copy available at: https://ssrn.com/abstract=3844948

2 THE LAW OF THE UPLOAD [12-May-21

INTRODUCTION

In April 2020, Amazon released a new comedy series called “Upload.”1 The show extrapolates a future in which advances in computation and neuroscience have led to the successful simulation of human consciousness in silico. In this world, individuals can pay to be “uploaded” into a series of competing digital afterlives.2 When uploaded, human consciousness is converted into stored memories and executable code, which can be edited, reset, throttled, or even deleted depending on each upload’s membership plan and payment status. By portraying this world, the show breaks the boundaries between reality and virtual reality, consciousness and artificial intelligence, and even life and afterlife, entangling various legal questions in novel ways.

The neuro-simulation technology depicted in the show is, in fact, already in development. The OpenWorm project, for example, used the fully mapped neural system of a nematode (C. elegans) to “‘copy-paste’ its brain into a computer, creating a virtual copy of the organism that reacts to stimuli the same way as the real thing.”3 The uploaded nematode can move around, hunt bacteria, and even respond to simulated physical stimuli.4 It does so relying on its virtual nervous system, which is simulated down to the level of individual ion channels on the nematode’s 302 neurons!5 Such successes, however, do not mean that human uploads are imminent. While petascale supercomputers may one day be able to support “cellular level simulations of the complete human brain,” mapping the various “elements, interactions, emergent properties, and time scales” of the brain remains a “massive challenge.”6

Seemingly rising to this challenge, a company called Humai came onto the scene in 2015 promising to transfer people’s consciousness into artificial bodies within 30 years.7 The company, however, was not a true tech venture. Commentators later noted that the company was simply “an effective way to rob people” and that the ambitious future it imagined “is about as likely as a

1 Upload (Amazon Prime Video, 2020). 2 Upload, Season 1, Episode 8, “Shopping Other Digital Afterlives,” 11:50 (“My son

Nathan would like to tour some new digital life extensions.”). 3 Alexandra Micu, A Worm’s Brain was Uploaded to a Hard Drive and Put to the Test,

ZME Science (Mar. 5, 2018), https://bit.ly/3w1pFvy. 4 Id. 5 Gopal P. Sarma, Chee Wai Lee, et al., OpenWorm: overview and recent advances in

integrative biological simulation of Caenorhabditis elegans, 373(1758) PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B (2018).

6 Henry Markram, Karlheinz Meier, et al., Introducing the Human Brain Project, 7 PROCEDIA COMPUTER SCIENCE, 39, 40 (2011).

7 Rob Thubron, New startup aims to transfer people's consciousness into artificial bodies so they can live forever, TechSpot (Nov. 26, 2015), https://bit.ly/3uMvWLu.

Electronic copy available at: https://ssrn.com/abstract=3844948

12-May-21] THE LAW OF THE UPLOAD 3

zombie apocalypse.”8 Given that such upload technologies will almost surely not exist anytime

soon,9 it may seem strange to give “Upload” any sort of legal analysis. The show’s world-building and narrative, however, provide an opportunity to explore—through a possible distant future—the legal, social, and business decisions being made today. It serves as an exaggerated mirror through which we can engage in “conscious psychological exploration and social criticism” of the legal norms currently taken for granted.10

Specifically, this short paper will examine three topics. First, it leverages the show’s advanced technology to question the distinction between human consciousness and artificial intelligence in the context of copyright and contract law. In so doing, it highlights how legal personhood may be doctrinally denied to “uploaded” human minds, even if they are—for the sake of argument—as capable, conscious, and creative as living human minds. It then builds on this conclusion to demonstrate how the power imbalance between individuals and technology companies will continue to exacerbate the problem of contracts of adhesion and surveillance capitalism (even after physical death!). Lastly, it demonstrates how an unyielding, unquestioning, myopic desire for digital rights (at all costs) may lead to the unintentional loss of crucial non-digital rights.

I. LOSS OF PERSONHOOD THROUGH CONTRACT AND COPYRIGHT

“Upload” raises complex questions in almost all areas of law, from tort

liability, to consumer protection, to estate planning. One of the most jarring, however, is how “Upload” depicts a future in which the current legal regimes of copyright and contract law may unintentionally reinstate a virtual form of servitude. Specifically, it demonstrates how current law may, in the face of technological change, conspire in such a way that robs individuals of agency, autonomy, and ultimately legal personhood.

To understand how this is so, consider first the existing law governing ownership of AI creations. In the United States, the Copyright Office has adopted a stringent “human authorship” requirement according to which the Office will only “register an original work of authorship, provided that the

8 David Moye, Dear Future Dead People, Don’t Trust This Guy’s Plan To Resurrect

You, HuffPost (Nov. 27, 2015), https://bit.ly/39L7twr. 9 It is possible, however, that much more limited “Brain-Computer Interface (BCI)”

technologies will continue to make progress in foreseeable future. Alexandre Gonfalonieri, What Brain-Computer Interfaces Could Mean for the Future of Work, Harvard Business Review Online (Oct. 6, 2020), https://bit.ly/2R5QS1C.

10 Patrick Brantlinger, The Gothic Origins of Science Fiction, 14(1) NOVEL: A FORUM ON FICTION 30, 41 (1980).

Electronic copy available at: https://ssrn.com/abstract=3844948

4 THE LAW OF THE UPLOAD [12-May-21

work was created by a human being.”11 For the Office, the “fruits of intellectual labor” are limited to those “founded in the creative powers of the mind”12—the living human mind that is. This position was reaffirmed in the now infamous “monkey selfie” case concerning a photo taken by a crested macaque named Naruto. In that case, the Ninth Circuit concluded that “a monkey—and all animals, since they are not human—lacks statutory standing under the Copyright act” and therefore is unable to seek damages or injunctive relief against copyright infringement.13

Even in jurisdictions that seem more welcoming to the idea that non-human generated content may be copyrightable, the ownership rights continue to belong to a company or living human individual. This is the case with AI-generated content whose rights are granted to the company or individual employing the AI and not to the AI itself. In 2020, for example, a court in Shenzhen, China, recognized that stories produced by an automated software called Dreamwriter possessed sufficient originality to qualify for copyright protection. The court, however, granted the rights over the stories not to the Dreamwriter AI but to the Chinese tech titan Tencent that created it.14

For our current purposes, such limits on the entitlement to and assignment of copyright protections may seem benign. This restriction, however, smuggles with it an undertheorized assumption about creativity and agency. It assumes that copyright law is only meant to incentivize and protect the legal interests of currently living biological humans.15 In the United States, such assumption is suspect even at the constitutional level. Doctrinally, federal copyright protection exists solely under the government’s constitutional power to “promote the Progress of Science and useful Arts” in society.16 Constitutionally, then, copyright law was a “distinctly utilitarian

11 COMPENDIUM OF U.S. COPYRIGHT OFFICE PRACTICES, Ch. 300, Sec. 306 (3rd ed.,

2014). 12 Id. 13 Naruto v. David John Slater, 888 F.3d 418, at 4 (9th Cir. 2018). Judge Carlos T. Bea

posited in obiter that because of the lack of “historical evidence that animals have ever been granted authority to sue,” even were Congress to act such a statutory grant of standing would raise “grave doubts” about its ability to survive scrutiny under an Article III standing analysis. Id., at 26, fn. 4 and accompanying text.

14 For further reading see Paul Sawers, Chinese court rules AI-written article is protected by copyright, VentureBeat (Jan. 10, 2020), https://bit.ly/3fez8H1.

15 Specifically in the context of the United States, such “individual rights” view of copyright may be in contradiction with the “distinctly utilitarian construct” of intellectual property at the time of the founding.

16 U.S. CONST. art 1 §8 cl. 8 (“[the United States Congress shall have power] To promote the Progress of Science and useful Arts, by securing for limited Times to Authors and Inventors the exclusive Right to their respective Writings and Discoveries.”).

Electronic copy available at: https://ssrn.com/abstract=3844948

12-May-21] THE LAW OF THE UPLOAD 5

construct” from the very beginning.17 By limiting the authorship requirement to living humans, the law “denies the incentive of copyright to an increasingly large group of works that are indistinguishable in substance and public value from works created by human beings.”18 Ultimately, though, the effectiveness of modern copyright doctrines in fulfilling their constitutional mandate is an empirical question outside the scope of this short paper.

More interesting, however, is a theoretical question raised by modern copyright doctrine. The law’s requirement of a living human author assumes that a discrete qualitative difference must exist between living human brains and computers.19 But where exactly is the boundary between an AI and the human mind? If a human brain is fully simulated, are its works worth any less to society, promoting the arts and sciences? If not, are simulated minds still less worthy of incentives?

The uploads in the show challenge the categorical distinction between human minds and algorithms by offering a clear edge test. Nathan, the protagonist of the show “Upload,” is now an uploaded human consciousness. When describing his current situation to a living human, he noted that “[i]n a sense both of our consciousnesses are simulations, mine on a silicon computer and yours on a computer made of meat, your brain.”20 If uploads do indeed mimic all of “the synaptic connections”21 in the original human’s brain cells as well as the complete “thousands of terabytes”22 of the human’s memory data, is the uploaded intelligence “artificial” in any meaningful sense merely because it is running on silicon?

While the “Upload” showrunners purposefully do not answer this question, they affirmatively portray a world in which the law also fails to address this critical issue. The law in Upload relies on inertia to deny the legal existence (or even relevance) of uploaded humans. Whether consciously or not, they seem to have premised their narrative on the likely scenario that law will lag behind technological innovation. Much like Naruto the crested macaque and the Dreamwriter AI, the uploads are not allowed to work, contract, or directly earn money in any way, as that would “driv[e] down wages for us meat folks.”23

More importantly, the scanned uploads are themselves “owned.” Nathan,

17 Sara K. Stadler, Forging a Truly Utilitarian Copyright, 91 IOWA LAW REVIEW 609,

611 (2006). 18 Robert C. Denicola, Ex Machina: Copyright Protection for Computer-Generated

Works, 69 RUTGERS UNIVERSITY LAW REVIEW 251, 286 (2016). 19 A distinction that is already being blurred by computer-brain-interface technologies.

See supra n. 9. 20 Upload, Season 1, Episode 7, “Bring Your Dad to Work Day,” 12:07. 21 Upload, Season 1, Episode 3, “The Funeral,” 3:12. 22 Id. 23 Upload, Season 1, Episode 4, “The Sex Suit,” 1:45.

Electronic copy available at: https://ssrn.com/abstract=3844948

6 THE LAW OF THE UPLOAD [12-May-21

when describing his relationship with his living girlfriend Ingrid says, “it’s definitely changed the relationship. I mean, now she literally owns me,”24 later noting that “I’m just this plaything for Ingrid, there when she wants me. [Ingrid] control[s] all my purchases, what I do, what I eat.”25 While the interpersonal dimensions of this reality are explored at length in the show, the legal ramifications are not.

One such ramification is in the law of copyright. Throughout the show the various uploads of Lakeview, the virtual world in which Nathan lives, continuously produce content: David hits cinematic golf shots, Dylan devises innovative new pranks to play on the local groundskeepers, and Nathan himself constantly writes and performs thoughtful and artistic prose. All of these creations, however, seem to be owned by Horizen, the company behind Lakeview, or by the Horizen account holder, a living individual paying Horizen to host the upload. The uploads are treated much like the Dreamwriter AI.

Uploaded human minds are not entitled to copyright protections nor are they allowed to contract around this limitation. They are stuck. Under fear of permanent deletion, they may be forced to engage in endless intellectual (or computational) labor. Despite their cognitive abilities and emotional responses, which are by presumption equivalent to those of living humans, they lack any and all entitlements of legal personhood.

II. POWER DYNAMICS OF TECHNOLOGY AS LIFE

Why does this lack of personhood matter? Given the historical and

theoretical connections between personhood and human rights,26 one can imagine the myriad problems this situation may create. In this paper, we will highlight just two. First, is the growing problem of contracts of adhesion in the face of life altering infrastructural technologies.27 Second, is surveillance capitalism’s role in transforming human minds into products available for purchase.28

24 Id., at 6:53. 25 Upload, Season 1, Episode 5, “The Grey Market,” 1:30. 26 Miguel Vatter & Mac de Leeuw, Human Rights, Legal Personhood and the

Impersonality of Embodied Life, LAW, CULTURE, & THE HUMANITIES (2019) available at https://doi.org/10.1177/1743872119857068.

27 Adhesion Contract in CONTRACT, Black's Law Dictionary (11th ed. 2019) (A contract of adhesion is a “standard-form contract prepared by one party, to be signed by another party in a weaker position, usually a consumer, who adheres to the contract with little choice about the terms.”).

28 Surveillance Capitalism, as defined by Shoshanna Zuboff, “includes the acquisition of ‘behavioral surplus,’ the creation of predictive products, and the implementation of behavioral modification.” Mariano-Florentino Cuéllar & Aziz Z. Huq, Economies of

Electronic copy available at: https://ssrn.com/abstract=3844948

12-May-21] THE LAW OF THE UPLOAD 7

Regarding the role of contract law, it is true that each and every upload ‘agreed’ to this loss of personhood in Horizen’s terms of service. As living humans (and legal persons), they were each informed of Horizen’s policies and consented to the relevant terms and conditions before being uploaded. Under current California law, for example, such terms—even of indispensable internet services—are routinely upheld as enforceable contracts.29 Not even “oppression or surprise due to unequal bargaining power” are enough to render a contract of adhesion unconscionable and therefore unenforceable.30 Presumably, enforcing such contracts is thought to somehow promote autonomy and the ability to rely on the promises of others.31

To render a contract of adhesion unenforceable, current law in California requires that the contract contain “substantive unconscionability” which focuses on “‘overly harsh’ or ‘one-sided’ results.”32 Notably, these results must be biased towards one of the parties to the contract. In the universe of “Upload” it seems clear from Horizen’s successful business model that courts do not treat the uploaded individuals as legal persons and therefore do not recognize their mistreatment as substantive unconscionability towards one of the contract parties. Ultimately, “dead person[s] cannot sue,”33 so uploads are not only be forever bound by Horizen’s terms of service, they also lack basic legal protections if or when Horizen breaches any of its own terms.

This is even more alarming because Horizen advertises such loss of legal personhood and legal recourse as a heavenly afterlife. It also targets individuals at an extremely vulnerable time: when they are dying. Nathan, for example, is forced to accept Horizen’s terms of service (without reading them) while dying on a hospital gurney. When he begins to question whether

Surveillance, 133 HARVARD LAW REVIEW 1280, 1287 (2020) reviewing and citing Shoshana Zuboff, reviewing SHOSHANA ZUBOFF, THE AGE OF SURVEILLANCE CAPITALISM: THE FIGHT FOR A HUMAN FUTURE AT THE NEW FRONTIER OF POWER (2019).

29 See e.g., In re Google Assistant Priv. Litig., 457 F. Supp. 3d 797, 837 (N.D. Cal. 2020) (“[N]ot all contracts of adhesion are unconscionable. Under California law, a contract provision is unconscionable, and therefore unenforceable, only if it is both procedurally and substantively unconscionable.”).

30 Id. 31 HANOCH DAGA & MICHAEL HELLER, THE CHOICE THEORY OF CONTRACTS 66 (2017)

(“[C]ontract serves autonomy by enabling people to legitimately enlist others in advancing their own projects and thus it expands the range of meaningful choices people can make to shape their own lives.”). Cf. Yitzhak Benbaji, Contract Law in A Just Society, 20 Theoretical Inquiries L. 411, 432 (2019) (Contract law “secures the ability of [] citizens to follow their universal moral duties and one of the means by which [the state] secures their being provided with primary goods.”).

32 In re Google Assistant Priv. Litig., 457 F. Supp. at 838. 33 Repko v. Our Lady of Lourdes Med. Ctr., Inc., 464 N.J. Super. 570, 574 (App. Div.

2020).

Electronic copy available at: https://ssrn.com/abstract=3844948

8 THE LAW OF THE UPLOAD [12-May-21

he should accept these terms, the Horizen representative taunts him: “Hit accept! … You can’t use our service without agreeing to the terms of service. Have you never gotten an app ever?”34 Under pressure from his loved ones and feeling humanity’s inherent “fear of mortality,”35 Nathan gives in and accepts the terms.

In the process and for an empty promise of eternal life, Nathan forfeits legal personhood, the ability to contract, the right to own any property or intellectual property, and any other future legal recourse. After scanning the minds of dying individuals, Horizen has the uploads locked in a golden cage where it not only collects monthly fees for hosting these poor unfortunate souls, but also has the legal power to make further profit off all the fruits of their labor. The uploads have only their Horizen account holders to turn to, who themselves may at any moment, and for whatever reason, decide to delete, freeze, or alter their uploads without recourse.

In fact, the relationship between Horizon, the uploads, and the living account holders who pay for the uploads’ maintenance raises the second problem inherent in the power dynamics of the show: surveillance capitalism. In the modern digital marketplace, “if you are not paying for the product, you are the product.”36 This phrase has become a modern proverb. Some have argued, however, that this axiom is already outdated. Nowadays, “[n]o matter how much you pay, under current US law, you’re the product if the company’s privacy policy says so.”37

This is taken to the extreme in “Upload.” Horizen presents itself as offering a service for the individual uploaded, but uploads are not the ones who pay. They are not the ones to whom Horizon is obliged. Rather, Horizen must bow to the pressure of living individuals who continue to pay for the maintenance of each upload. The simulation of a loved one’s mind is the product being sold as an experience or service to living individuals. If you are that simulated mind, you are the product being sold in a much more concrete sense than ever before. One’s very existence can be extinguished whenever the consumers who pay for the service—the living individuals—cancel their subscription.

In this way, “Upload” demonstrates what can happen when individuals

34 Upload, Season 1, Episode 1, “Welcome to Upload,” 14:13. 35 Philip J. Cozzolino, Laura E.R. Blackie & Lawrence S. Meyers, Self-Related

Consequences of Death Fear and Death Denial, 38(6) DEATH STUDIES 418, 422 (2014) (“[H]umans seek to deny their personal vulnerability to death by embracing that which cannot die.”).

36 Daniel Hövermann, If You Are Not Paying for the Product, You Are the Product!, Medium (Sep. 24, 2020), https://bit.ly/3tIaPZx (emphasis added).

37 Lauren Scholz, Paying to be the Product, JOTWELL: J. THINGS WE LIKE 1 (2019) (reviewing Stacy-Ann Elvy, Commodifying Consumer Data in the Era of the Internet of Things, 59 BOSTON COLLEGE LAW REVIEW 423 (2018)).

Electronic copy available at: https://ssrn.com/abstract=3844948

12-May-21] THE LAW OF THE UPLOAD 9

are reduced to only two roles: consumers or products. If you cannot be a consumer (because you are dead) and you cannot be a product (because there is no market for whatever it is you have to offer) then you quite simply (and literately) cease to exist.

Ultimately, this situation can lead to even further abuse by Horizen. Not only can it sell your existence as a service to living individuals it can also engage in product placement, adding “contextual cues” to “shape emerging habits” of the living individuals who come see and interact with you.38 If the entire world in which uploads exist is a manipulable digital environment, Horizen could easily “nudge” its consumers—the living individuals—towards even more profit-making purchases and activities.39 In this scenario, the fact that uploads’ minds are as powerful and as feeling as those of living humans is irrelevant. Simulated minds are merely digital services used to sell advertisements or engage in other profit-earning activities, all while collecting more and more data.

III. ARE DIGITAL RIGHTS ABOVE ALL OTHERS?

In spite of these terrifying possibilities, the allure of an eternal digital

afterlife was too much for society to bear. Human rights defenders on the show, for example, were so blinded by the fact that wealthy individuals get to experience digital immortality, that their immediate goal was to democratize this technology.

According to the activists, everyone should have the right to Horizen’s digital life extension. If Horizen’s technology is seen as a form of health care or life support, this conclusion might make sense. As we have shown, however, the reality is much more complicated. Instead of fighting for the rights of uploads, activists are fighting for the rights of humans to be uploaded.40 In other words, they are fighting for the purported human right to freely enter what amounts to a labor camp and retail shop for consciousnesses.

An obsessive focus digital rights blinds these activists from the fact that what they are fighting for is actually for the right to be imprisoned. Horizen has, after all, created the perfect prison. Much like in Jeremy Bentham’s

38 Understanding and Shaping Consumer Behavior in the Next Normal, McKinsey &

Co. (Jul. 24, 2020), https://mck.co/3hk5F3e. 39 Id. 40 Upload, Season 1, Episode 4, “The Sex Suit,” 11:44.

Electronic copy available at: https://ssrn.com/abstract=3844948

10 THE LAW OF THE UPLOAD [12-May-21

Panopticon,41 by inducing “a sense of conscious and permanent visibility,”42 Horizen mastered a new form of power and control. Entrapped in a simulated complex space, the uploads are subject to “instrumental coding”43 of their minds. This is a new form of “political anatomy,” in the Foucauldian context,44 a mode of ordering by omnipresent surveillance and a feeling of futility and perpetuity.

In this age of cyber instability new digital rights are cropping left, right, and center. From a “right to be forgotten”45 to a “right to cybersecurity”46 to a “right to internet access.”47 But perhaps the biggest lesson to be learned from the “Upload” is that we must resist our tendencies to immediately embrace and apply human rights law, and reassess “the ethical foundations underlying” the very field exploring the “outer limits” of the discourse and its potential pitfalls.48 Especially when the subject matter to be regulated is a paradigm-shifting technology, we should consider leaving some of our legal paradigms at the door.

CONCLUSION

“Upload” portrays many different visions for the future, but perhaps none

more profound than the idea that society will inevitably subjugate its AI creations. What sets “Upload” apart from any other show about technological servitude (and robotic uprising), like “Westworld” for example, is that in

41 In 1791 Jeremy Bentham wrote the “Panoticon or Inspection House” which described

“a new principle of construction applicable to any sort of establishment, in which persons of any description are to be kept under inspection.” JEREMY BENTHAM, THE WORKS OF JEREMY BENTHAM 40-45 (vol. 4, 1843). The goal of such a building was to guarantee perfect observation of any of the subjects at any given moment. Bentham also highlighted the idea of “apparent omnipresence” achieved through games of light and blinds and the establishment of a central guard tower. Id. For further analysis of the Panopticon theory and its application to modern day mass surveillance techniques, see REG WHITAKER, THE END OF PRIVACY: HOW TOTAL SURVEILLANCE IS BECOMING A REALITY 32-47, 139-189 (1999).

42 MICHEL FOUCAULT, DISCIPLINE AND POWER: THE BIRTH OF THE PRISON 201(ALAN SHERIDAN TRANS., 1977).

43 Id., at 153. 44 Id., at 138. 45 Edward Lee, Recognizing Rights in Real Time: The Role of Google in the EU Right

to Be Forgotten, 49 U.C. DAVIS LAW REVIEW 1017 (2016). 46 Ido Kilovaty, An Extraterritorial Human Right to Cybersecurity, 10(1) Notre Dame

Journal of Interntaitonal and Comparative Law 35 (2020). 47 Stephen Tully, A Human Right to Access the Internet? Problems and Prospects, 14(2)

HUMAN RIGHTS LAW REVIEW 175 (2014). 48 Dafna Dror-Shpolianky & Yuval Shany, It's the End of the (Offline) World as We

Know It: from Human Rights to Digital Human Rights – a Proposed Typology, HEBREW UNIVERSITY OF JERUSALEM LEGAL RESEARCH PAPER NO. 20-36 (2020), available at https://bit.ly/3vXNlB2.

Electronic copy available at: https://ssrn.com/abstract=3844948

12-May-21] THE LAW OF THE UPLOAD 11

“Upload” human consciousness is the AI. It is our minds, our memories, our thoughts and feelings, which are being scanned and uploaded, not an algorithmic version of them. In the world of “Upload,” we are so doomed by technological determinism that we voluntarily put our very consciousness on the stake.

But as if that’s not enough, after waiving all of their rights in the process, uploaded individuals clamor for the technology that would allow them to “download” their consciousness back into printed flesh.49 It is perhaps the ultimate testament to the fact that a person without personhood isn’t a person at all. The uploads and their living next of kin seek to reverse their own doing, translating consciousness back into a synaptic map of (synthetic but physical) brain cells. By perusing the move from the physical to the digital and then back to the physical again, “Upload” demonstrates how humanity is forever chained to its antiquity, even in the face of groundbreaking innovation and technological advancement.

In this paper, we analyzed the law of “Upload.” We hope that this discussion can serve as a launching pad for a more nuanced conversation about what is artificial in artificial intelligence, what is virtual in virtual reality, and what is the digital in digital rights. We argue that becoming early adopters of a new reconceptualized language around “us” and “them”, the “self” and the “other” can perhaps future proof our society from the cyborg perils that await us in the undoubtfully arduous and tumultuous road ahead. This way we may possibly be able to trade a looming Horizen for at least a slightly better horizon.

49 Upload, Season 1, Episode 3, “The Funeral,” 0:00–4-22 (“We are about to witness a

human consciousness reinserted into a printed clone body….They are effectively reversing the upload process, bringing us closer to endless corporeal life… many would agree the opportunity to live again in real life is worth any price…the team is now cueing up the reinsertion process. This will carry thousands of terabytes of data into the clone. And that data is that’s his consciousness… The machine is a reverse scanner reorganizing the synaptic connections in his brain cells.”).

Electronic copy available at: https://ssrn.com/abstract=3844948