[논문]AI and Ethics When Human Beings Collaborate With AI Agents

Cañ; as, José; J.

doi:10.3389/fpsyg.2022.836650

AI and Ethics When Human Beings Collaborate With AI Agents 원문보기

Frontiers in psychology, v.13, 2022년, pp.836650 -

Cañas, José , J.

Abstract ▼ AI-Helper

The relationship between a human being and an AI system has to be considered as a collaborative process between two agents during the performance of an activity. When there is a collaboration between two people, a fundamental characteristic of that collaboration is that there is co-supervision, with each agent supervising the actions of the other. Such supervision ensures that the activity achieves its objectives, but it also means that responsibility for the consequences of the activity is shared. If there is no co-supervision, neither collaborator can be held co-responsible for the actions of the other. When the collaboration is between a person and an AI system, co-supervision is also necessary to ensure that the objectives of the activity are achieved, but this also means that there is co-responsibility for the consequences of the activities. Therefore, if each agent's responsibility for the consequences of the activity depends on the effectiveness and efficiency of the supervision that that agent performs over the other agent's actions, it will be necessary to take into account the way in which that supervision is carried out and the factors on which it depends. In the case of the human supervision of the actions of an AI system, there is a wealth of psychological research that can help us to establish cognitive and non-cognitive boundaries and their relationship to the responsibility of humans collaborating with AI systems. There is also psychological research on how an external observer supervises and evaluates human actions. This research can be used to programme AI systems in such a way that the boundaries of responsibility for AI systems can be established. In this article, we will describe some examples of how such research on the task of supervising the actions of another agent can be used to establish lines of shared responsibility between a human being and an AI system. The article will conclude by proposing that we should develop a methodology for assessing responsibility based on the results of the collaboration between a human being and an AI agent during the performance of one common activity.

주제어

참고문헌 (37)

Cañas J. J. ( 2021 ). “The human mind and engineering models,” in International Conference on Human–Computer Interaction ( Cham : Springer ), 197 – 208 . 10.1007/978-3-030-77431-8_12
Carruthers P. Smith P. ( 1996 ). Theories of Theories of Mind . Cambridge : Cambridge University Press . 10.1017/CBO9780511597985
Chiou E. K. Demir M. Buchanan V. Corral C. C. Endsley M. R. Lematta G. J. . ( 2021 ). Towards human–robot teaming: tradeoffs of explanation-based communication strategies in a virtual search and rescue task . Int. J. Soc. Robot. 10.1007/s12369-021-00834-1. [Epub ahead of print].
Clark A Chalmers D. ( 1998 ). The extended mind . Analysis 58 , 7 – 19 . 10.1093/analys/58.1.7

상세보기
Encyclopaedia Britannica ( 2021 ). Available online at: https://www.britannica.com/topic/accountability (accessed November, 2021).
Endsley M. ( 1995 ). Toward a theory of situation awareness in dynamic systems . Human Factor 37 , 32 – 64 . 10.1518/001872095779049543

상세보기
Endsley M. R. Jones W. M. ( 2001 ). “A model of inter and intra team situation awareness: Implications for design, training and measurement,” in New Trends in Cooperative Activities: Understanding System Dynamics in Complex Environments , eds M. McNeese, E. Salas, and M. Endsley ( Santa Monica, CA : Human Factors and Ergonomics Society ), 1 – 24 .
Etemad-Sajadi R. Soussan A. Schöpfer T. ( 2022 ). How ethical issues raised by human–robot interaction can impact the intention to use the robot? Int. J. Soc. Robot . 10.1007/s12369-021-00857-8. [Epub ahead of print]. 35043067
European Commission ( 2022 ). Available online at: https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai (accessed April, 2019).
Floridi L. ( 2016 ). Faultless responsibility: on the nature and allocation of moral responsibility for distributed moral actions . Philos. Trans. R. Soc. London A 374 , 20160112 . 10.1098/rsta.2016.0112 28336791

상세보기
French P. A. Wettstein H. K. ( 2006 ). Shared Intentions and Collective Responsibility . Boston, MA : Blackwell Publishing .
Frith C. D. Frith U. ( 1999 ). Interacting minds – a biological basis . Science 286 , 1692 – 1695 . 10.1126/science.286.5445.1692 10576727

상세보기
Gibson J. ( 1950 ). Perception of the Visual World . Boston, MA : Houghton Mifflin .
Gibson J. ( 1979 ). The Ecological Approach to Visual Perception . Boston, MA : Houghton Mifflin .
Google ( 2022 ). Available online at: https://ai.google/principles/ (accessed February, 2022).
Hernández-Orallo J. Vold K. ( 2019 ). “AI extenders: the ethical and societal implications of humans cognitively extended by AI,” in Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society ( Honolulu ), 507 – 513 . 10.1145/3306618.3314238
Hutchins E. ( 1999 ). “Cognitive artifacts,” in The MIT Encyclopedia of the Cognitive Sciences , eds R. A. Wilson and F. Keil ( MIT Press ), 126 – 127 .
Hutchins E. ( 2000 ). “Distributed cognition,” in International Encyclopedia of the Social and Behavioral Sciences , eds N. J. Smelser and P. B. Baltes ( Elsevier Science ), 138 .
Kadar E. E. Köszeghy A. Virk G. S. ( 2017 ). “Safety and ethical concerns in mixed human–robot control of vehicles,” in, A World With Robots , eds M. I. A. Ferreira, J. S. Sequeira, M. O. Tokhi, E. E. Kadar, and G. S. Virk ( Springer ), 135 – 144 . 10.1007/978-3-319-46667-5_10
Kyriakidis M. de Winter J. C. Stanton N. Bellet T. van Arem B. Brookhuis K. . ( 2019 ). A human factors perspective on automated driving . Theor. Iss. Ergon. Sci. 20 , 223 – 249 . 10.1080/1463922X.2017.1293187

상세보기
Lazarus R. S. ( 1982 ). Thoughts on the relations between emotion and cognition . Am. Psychol. 37 , 1019 – 1024 . 10.1037/0003-066X.37.9.1019

상세보기
Lee D. N. ( 1976 ). A theory of visual control of braking based on information about time-to-collision . Perception 5 , 437 – 459 . 10.1068/p050437 1005020

상세보기
Lee J. D. See K. A. ( 2004 ). Trust in automation: d esigning for appropriate reliance . Human Factors 46 , 50 – 80 . 10.1518/hfes.46.1.50.30392 15151155

상세보기
Licklider J. C. ( 1960 ). Man–computer symbiosis . IRE Trans. Human Factors Electr. 1 , 4 – 11 . 10.1109/THFE2.1960.4503259

상세보기
Mayer R. C. Davis J. H. Schoorman F. D. ( 1995 ). An integrative model of organizational trust . Acad. Manag. Rev. 20 , 709 – 734 . 10.2307/258792

상세보기
Mishler S. Chen J. ( 2018 ). “Effect of response method on driver responses to auditory warnings in simulated semi-autonomous driving,” in Proceedings of the Human Factors and Ergonomics Society Annual Meeting , Vol. 62 ( Los Angeles, CA ), 1934 – 1938 . 10.1177/1541931218621439
Munoz-de-Escalona E. Cañas J. J. ( 2017 ). “Online measuring of available resources,” in H-Workload 2017: The First International Symposium on Human Mental Work ( Dublin : Springer ).
Parasuraman R. Riley V. ( 1997 ). Humans and automation: use, misuse, disuse, abuse . Human Factors 39 , 230 – 253 . 10.1518/001872097778543886 18689046

상세보기
Parasuraman R. Sheridan T. B. Wickens C. D. ( 2000 ). A model for types and levels of human interaction with automation . IEEE Trans. Syst. Man Cybernet . A 30 , 286 – 297 . 10.1109/3468.844354 11760769

상세보기
Phillips E. Ososky S. Grove J. Jentsch F. ( 2011 ). “From tools to teammates: toward the development of appropriate mental models for intelligent robots,” in Proceedings of the Human Factors and Ergonomics Society Annual Meeting , Vol. 55 ( Los Angeles, CA ), 1491 – 1495 . 10.1177/1071181311551310
Sheridan T. B. ( 2002 ). Humans and Automation: System Design and Research Issues . Santa Monica, CA : Wiley/Human Factors and Ergonomics Society .
Skitka L. J. Mosier K. Burdick M. D. ( 2000 ). Accountability and automation bias . Int. J. Human Comp. Stud. 52 , 701 – 717 . 10.1006/ijhc.1999.0349

상세보기
Stahl B. C. Obach M. Yaghmaei E. Ikonen V. Chatfield K. Brem A. ( 2017 ). The responsible research and innovation (RRI) maturity model: linking theory and practice . Sustainability 9 , 1036 – 1019 . 10.3390/su9061036

상세보기
Stanton N. A. ( 2019 ). Thematic issue: driving automation and autonomy . Theor. Iss. Ergon. Sci. 20 , 1 – 7 . 10.1080/1463922X.2018.1541112

상세보기
Wickens C. D. Rice S. Keller D. Hutchins S. Hughes J. Clayton K. ( 2009 ). False alerts in air traffic control conflict alerting system: Is there a “cry wolf” effect? Human Factors 51 , 446 – 462 . 10.1177/0018720809344720 19899356

상세보기
Winfield A. F. T. ( 2018 ). Experiments in artificial theory of mind: from safety to story-telling . Front. Robot. AI 5 , 75 . 10.3389/frobt.2018.00075 33500954

상세보기
Zhang Y. Zhang M. Cui Y. Zhang D. ( 2020 ). Detection and tracking of human track and field motion targets based on deep learning . Multimedia Tools Appl. 79 , 9543 – 9563 . 10.1007/s11042-019-08035-9

상세보기

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

AI and Ethics When Human Beings Collaborate With AI Agents 원문보기

Abstract ▼ AI-Helper

주제어

참고문헌 (37)

이 논문을 인용한 문헌

관련 콘텐츠

원문 보기

원문 URL 링크

오픈액세스(OA) 유형

연관된 기능

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트