Data and Society Lecture 9: Data Governance and

Ethics

4/21/17

Announcements 4/21

• No class next Wednesday

• Pecha Kucha next week (last class!). You can still sign up. Let me know.

– If you’re doing the Pecha Kucha, send your presentation to woodst@rpi.edu by Wednesday, April 26 at 5:00.

– TK’s Pecha Kucha office hours: Today (4/21) at 2 in CII 7128.

• Be sure to sign the attendance sheet!!

Current Class Scores (not all final)

0

1

2

3

4

5

6

72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97

No. of Students

Wednesday Section Friday lecture

First Half of Class Second Half of Class Assignments

January 18 : NO class January 20 L!: Class Intro + Logistics / Survey / Digital Data in the 21st Century

Presentation Model / Op-Ed Instructions

January 25: NO class January 27 L2: Big data applications / Data and the election; Data and Target; Discussion

4 Presentations

February 1: 6 presentations February 3

L3: Data and Health / PDB, Precision Medicine; Discussion

4 Presentations

February 8: NO class February 10 L4: Data and Science / Earthquakes, LHC; Paper Instructions

4 Presentations Op-Ed Draft Due

February 15: 6 presentations

February 17 L5: Data Cyberinfrastructure; Discussion

4 Presentations Op-Ed Draft Back

February 22: 6 presentations

February 24 L6: Data Stewardship and Data Preservation; Discussion

4 presentations Op-Ed Final Due

March 1: NO class March 3 NO class

March 8: 6 presentations March 10 L7: Data Futures – Internet of Things; Discussion

4 presentations Paper Draft Due

March 15: Spring Break March 17 Spring Break

March 22: NO class March 24 L8: Data rights and policy / U.S. and EU 4 presentations Paper Draft Back

March 29: 6 presentations March 31 Op-Ed Pecha-Kucha

April 5: NO class April 7 NO class

April 12: 5 presentations April 14 Hilary Mason Guest Lecture 4 presentations Final Paper Due

April 19: 6 presentations April 21 L9: Data Governance and Ethics; Discussion 4 presentations

April 26: No class April 28 Paper Pecha-Kucha

Today (4/21/17)

• Lecture 9: Data Governance and Ethics

• Discussion

• 4 Student Presentations

5

Lecture 9: Data Governance and Ethics

Why do social rules matter?

• Social rules help address:

– What is appropriate and inappropriate behavior? What happens as a consequence of inappropriate behavior?

– What is the public good? Whose responsibility is it to promote the public good?

– Who defines and enforces community and individual rights? Who defines and promotes community ethics?

– Who adjudicates conflicts and how?

• What does government do?

– Government “is a political system by which a country or region is managed or controlled. The government is in charge of creating and regulating laws, managing the economy and enforcing policies.“ [Reference.com, https://www.reference.com/government-politics/government-f228d84d469d2f4c]

Viable social and governance structure will be needed to meet the potential of the Internet of

Things • IoT will increasingly blend cyber

systems, the physical/natural environment, and biological entities.

• Social rules needed for this complex structure that promote individual rights, the public good, and a sustainable environment.

• Vehicles for creating this include policy and regulation, community practice and beliefs, “instrumented” systems and devices, etc.

Cyber Physical

Biological

Technology has no ethics – up to humans to develop systems and social structures needed to

make the most from technology

http://contractingbusiness.com/residential-hvac/email-still-best-social-

network-marketing-tool

“Stone Age” of The Internet of Things

Internet of Things (IoT) – interconnected environment that

integrates devices, systems, humans and organizations to intuit

and respond to a spectrum of needs

Enabling environment or Lord of the Flies? How should the IoT

be managed / organized?

• Who develops its “laws”?

• Who enforces them?

• Can you opt out?

Who is accountable when your self-driving car hits someone?

Which decisions should be made by technology?

When does your privacy matter more than the needs of others?

Does your computer know good from evil?

Wikimedia: Self-driving car Image courtesy of Steve Jurvetson, Mariordo; HAL9000 image from https://www.flickr.com/photos/zanotti/312159382

Social Behavior: Asimov’s Rules for Robots

Over 50 years ago, Isaac Asimov introduced laws of robotics:

0. A robot may not harm humanity, or, by inaction, allow humanity to come to harm.

1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.

2. A robot must obey the orders given it by human beings except where such orders would conflict with the First Law.

3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Laws.

What rules of behavior should be in place for the heterogeneous and hybrid community of entities (devices, systems, people, etc.) that will form the IoT?

Francine Berman Robot image from http://hereandnow.wbur.org/2014/10/07/artificial-intelligence-strickland, iRobot, 20th

Century Fox

First serious discussions on IoT “Governance”

happening now

"The Circle is a genre novel, with its simplistic fabrication meant to be obvious. The symbolism is abundantly clear, because it is Eggers' only way of

bringing his message to the ear: How do we mean to handle the right to sovereignty of interpretation over

one's own life in the future?“

Thomas Andre review in Der Spiegel

Privacy

• What do you think you should control access to (and under what circumstances)?

– The data you generate?

– The data that is generated about you?

– Other people’s data?

• Who should be able to view/use your data and data about you (and under what circumstances)?

– Companies? Bots? The Government?

– In an emergency? When a crime is suspected? Any time?

Rights

• What should your rights be in

the IoT?

– Right to be forgotten?

– Right to access your data?

– Right to control your data?

– Right to delete your data?

– Right to opt out?

– Right to privacy?

– Right to prevail over the behavior / intention of autonomous systems? (a la Asimov)

• How would this work in

practice?

Public Good

• What is the “public good” in the IoT?

• When should individual privacy be more important than the public good?

– How do we trade off transparency / public value of information with privacy / private value of information?

Self-determination: Mauritius declaration

• 36th International Conference of Data Protection and Privacy Commissioners created the “Mauritius Declaration on the Internet of Things”:

• “Self-determination is an inalienable right for human beings. Personal development should not be defined by what business and government know about you.”

• “Data processing starts from the moment the data are collected. All protective measures should be in place from the outset.”

Should you have the right to opt out of the IoT?

Images from http://www.fastcompany.com/3044283/the-messy-business-of-reinventing-happiness?_escaped_fragment_=#!; https://www.flickr.com/photos/manoftaste-de/9637127712; https://commons.wikimedia.org/wiki/File:'Map'_by_Aram_Bartholl,_part_of_the_show_'From_Here_On'_during_Rencontres_Arles,_France_2011.jpg

• More environments will use surveillance and monitoring to keep us safe, ensure productivity, customize experience, etc.

• Should you have the right to opt out? Should you have the right to access your data? Control your data? Delete your data? How would this work?

• Is it even possible to opt out of the IoT?

Responsibility and Accountability in the IoT

Increasing autonomy brings questions of responsibility, accountability, privacy:

• Who is accountable when your self-driving car hits someone?

• What policy / regulation is needed in a “car –net” environment where vehicles communicate with one another to make autonomous / group decisions?

• How should autonomous systems decide between multiple bad options?

Image from http://www.nbcnews.com/tech/innovation/can-l-kill-traffic-self-driving-cars-n217211

Francine Berman

How will we effectively regulate autonomous systems to benefit individuals,

organizations, and society?

http://cyberlaw.stanford.edu/wiki/index.php/Automated_Driving:_Legislative_and_Regulatory_Action

http://www.roboticstomorrow.com/news/2016/04/06/ieee-standards-association-introduces-global-initiative-for-ethical-considerations-in-the-design-of-autonomous-systems/7917/

States with bills about self-driving vehicles

Francine Berman

Automated Decision-Making: When should there be a human in the loop?

• IoT automated systems will increasingly

manage behavior in the background

• Which decisions should be made by

technology and when should there be a

human in the loop?

– Whose interests should systems

represent?

• How do we ensure that automated

systems don’t limit our choices?

• When there is a human in the loop, should

they be accountable for not taking

control?

Image: https://commons.wikimedia.org/wiki/File:HAL9000.svg

HAL9000 image from https://www.flickr.com/photos/zanotti/312159382

Ethics

• How do we promote the ethical use of technology?

• Whose ethics should

they be?

• Do we need artificial

ethics to

complement artificial

intelligence?

“Future Work” – academic underpinnings and public development of governance, policy and social

structures

• Is the IoT a society?

– Who are its citizens? What are their rights? What is its ethnography? Will it be possible to live outside the IoT?

– What should its ethical code be? What is the “common good”? Do we need “artificial ethics” in conjunction with artificial intelligence?

– How do we implement and enforce social and governance structures for communities of devices, humans, systems, organizations, groups, hybrids? Does your toaster get a vote?

We make the most of data when the context is there to understand its meaning and

consequences • Technology can’t be divorced from its overarching ecosystem of social and

ethical behavior and governance

• Not just what the technology can do but its unintended consequences,

potential for misuse, role in larger complex environment that ultimately helps

determine its success

• Alignment of technological advancement with social impacts critical to create

an ecosystem that sustains and helps us get the best from data

• Digital Ethics and the future of humanity:

Gerd Leonhard, TedXBrussels (20 min):

https://www.youtube.com/watch?v=DD5XVDKcuSo

Lecture 9 Sources (not already on slides)

• Wikipedia, “Internet of Things”, “The Circle”,

http://en.wikipedia.org/wiki/Internet_of_Things

• Wikipedia, World Governance Index,

https://en.wikipedia.org/wiki/Worldwide_Governance_Indicato

rs

• “Social and Ethical Behavior in the Internet of Things,” CACM,

http://cacm.acm.org/magazines/2017/2/212443-social-and-

ethical-behavior-in-the-internet-of-things/fulltext

Discussion

• Reading for next week:

“When fridges attack: the new ethics for the Internet of Things,” The Guardian, https://www.theguardian.com/science/alexs-adventures-in-numberland/2014/sep/08/when-fridges-attack-the-new-ethics-of-the-internet-of-things

Pecha Kucha – April 28

• Kusuma B.

• Harrison L.

• Ylonka M.?

• Xiaoyu Z.

• Mary L.

• Lee C.

Presentations for April 21

(data and ethics)

• “Yuval Noah Harari on big data, Google and the end of free will”, Financial Times, https://www.ft.com/content/50bb4830-6a4c-11e6-ae5b-a7cc5dd5a28c [Grig A.]

• “Is your company using data ethically?”, Harvard Business Review, https://hbr.org/2017/03/is-your-company-using-employee-data-ethically [Priyanka K.]

• “Digital doubles bringing actors back to life”, CBS News, http://www.cbsnews.com/news/digital-doubles-bringing-actors-back-to-life/ [Ningyuan H.]

• “Fake news and a 400 year old problem: we need to resolve the ‘post-truth’ crisis,” The Guardian, https://www.theguardian.com/technology/2016/nov/29/fake-news-echo-chamber-ethics-infosphere-internet-digital [Robert B.]