기존의 여러 연구들에서 디지털 도서관 평가를 위한 기준들이 제시되어 왔으나, 대부분의 연구에서 평가기준에 대한 이용자 관점을 이해하려는 노력이 부족하였다. 본 연구는 디지털 도서관 평가 기준들에 대한 이용자들의 의견을 미국 내 5개 대학교에서 10명의 교수 이용자와 20명의 학생 이용자에게 설문을 통해 직접 조사하였다. 설문 참여자들은 본 연구진에 의해 제시된 8개 영역 (장서, 정보조직, 맥락 등) 내 평가 기준들의 중요성에 대해 7점 척도로 응답하였다. 설문의 결과는 이용자들이 장서의 이용과 품질, 서비스와 관련된 항목들을 도서관 운영항목에 비해 상대적으로 더 중요하게 생각하고 있었음을 보여주었다. 본 연구의 결과는 이용자 중심의 디지털 도서관 개발과 관련하여 이용자의 요구와 선호를 반영하는 도서관 평가체계 구축에 도움이 될 것이다.
기존의 여러 연구들에서 디지털 도서관 평가를 위한 기준들이 제시되어 왔으나, 대부분의 연구에서 평가기준에 대한 이용자 관점을 이해하려는 노력이 부족하였다. 본 연구는 디지털 도서관 평가 기준들에 대한 이용자들의 의견을 미국 내 5개 대학교에서 10명의 교수 이용자와 20명의 학생 이용자에게 설문을 통해 직접 조사하였다. 설문 참여자들은 본 연구진에 의해 제시된 8개 영역 (장서, 정보조직, 맥락 등) 내 평가 기준들의 중요성에 대해 7점 척도로 응답하였다. 설문의 결과는 이용자들이 장서의 이용과 품질, 서비스와 관련된 항목들을 도서관 운영항목에 비해 상대적으로 더 중요하게 생각하고 있었음을 보여주었다. 본 연구의 결과는 이용자 중심의 디지털 도서관 개발과 관련하여 이용자의 요구와 선호를 반영하는 도서관 평가체계 구축에 도움이 될 것이다.
Criteria for evaluating digital libraries have been suggested in prior studies, but limited research has been done to understand users' perceptions of evaluation criteria. This study investigates users' opinions of the importance of digital library evaluation criteria. Thirty user participants, incl...
Criteria for evaluating digital libraries have been suggested in prior studies, but limited research has been done to understand users' perceptions of evaluation criteria. This study investigates users' opinions of the importance of digital library evaluation criteria. Thirty user participants, including 10 faculty members and 20 students, were recruited from five universities across the United States. They were asked to rate the importance of evaluation criteria in eight dimensions (e.g. collections, information organization, context, etc.). The results demonstrate that users care about evaluation criteria related to the use and quality of collection and services rather than the operation of digital libraries. The findings of this study are relevant to the development of user-centered digital libraries and associated evaluation frameworks through the incorporation of unique users' needs and preferences.
Criteria for evaluating digital libraries have been suggested in prior studies, but limited research has been done to understand users' perceptions of evaluation criteria. This study investigates users' opinions of the importance of digital library evaluation criteria. Thirty user participants, including 10 faculty members and 20 students, were recruited from five universities across the United States. They were asked to rate the importance of evaluation criteria in eight dimensions (e.g. collections, information organization, context, etc.). The results demonstrate that users care about evaluation criteria related to the use and quality of collection and services rather than the operation of digital libraries. The findings of this study are relevant to the development of user-centered digital libraries and associated evaluation frameworks through the incorporation of unique users' needs and preferences.
* AI 자동 식별 결과로 적합하지 않은 문장이 있을 수 있으니, 이용에 유의하시기 바랍니다.
문제 정의
This paper focuses on the identification of the importance of evaluation criteria from users’ perspectives.
제안 방법
The investigation of user perceptions is a fundamental step in devising an evaluation framework that focuses on user needs and characteristics. In this study, the authors suggested a wide range of evaluation criteria in eight dimensions of digital libraries based on the document analysis. For the suggested evaluation criteria, this study examines to what extent users perceive the importance of each criterion in the evaluation of digital libraries.
Each institution recruited six digital library users to participate in the study. The study employed purposeful sampling strategy. The sample included academic users with prior experience interacting with digital collections.
A comprehensive survey was administered to investigate users' perceptions of the importance of evaluation criteria in digital library evaluation. To suggest an initial set of evaluation criteria, a comprehensive document analysis was conducted. Using keywords of different combinations of “digital library”, “evaluation”, “criteria”, and other terms, relevant research papers were collected through Google Scholar and EBSCOhost databases.
대상 데이터
Subjects of this study were recruited from these partner libraries: (1) University of Denver, (2) University of Florida, (3) University of Nevada Las Vegas, (4) Drake University, and (5) University of Wisconsin-Milwaukee. Each institution recruited six digital library users to participate in the study. The study employed purposeful sampling strategy.
The authors partnered with five academic libraries across the United States to collect data. Subjects of this study were recruited from these partner libraries: (1) University of Denver, (2) University of Florida, (3) University of Nevada Las Vegas, (4) Drake University, and (5) University of Wisconsin-Milwaukee. Each institution recruited six digital library users to participate in the study.
However, not all users are the same. The subjects of this study represent academic user group of digital libraries. In addition to general users’ perceptions of digital library evaluation criteria, they also have their unique needs and opinions because of their academic background.
To ensure the maximum variation sampling, participants were recruited from different groups of academic users with different gender and different majors, such as Linguistics, English, Psychology, and Computer Science. The user subjects included 10 faculty, 12 graduate students, and 8 undergraduate students. A $30 gift card was given to each subject as an incentive for his/her participation of the study.
성능/효과
Digital library evaluation criteria were extracted from the retrieved pool of documents. Based on the document analysis, ten essential dimensions of digital libraries have been identified, including collection, information organization, interface design, system and technology, effects on users, services, preservation, administration, user engagement, and context. The administration and preservation dimensions were excluded from the user survey because users don’t have enough knowledge of these dimensions.
후속연구
Therefore, the investigation of other expert groups, such as digital librarians and scholars, is imperative to develop a comprehensive evaluation framework. Further analysis is going to investigate to examine opinions from other stakeholders including scholars and digital librarians. In addition, the authors plan to compare the opinions of those three groups to identify similarities and differences among them.
참고문헌 (22)
Borgman, C. L., G. H. Leazer, A. J. Gilliland-Swetland, and R. Gazan. 2000. "Evaluating Digital Libraries for Teaching and Learning in Undergraduate Education: A Case Study of the Alexandria Digital Earth Prototype (ADEPT)." Library Trends, 49: 228-250.
Candela, L., D. Castelli, P. Pagano,, C. Thanos, Y. Ioannidis, G. Koutrika, S. Ross, H. Schek, and H. Schuldt. 2007. Setting the Foundations of Digital Libraries: The DELOS Manifesto. D-Lib Magazine, 13(3/4).[cited 2014.1.14]. .
Fox, E. A., R. M. Akscyn, R. K. Furuta, and J. J. Leggett. 1995. "Digital Libraries." Communications of the ACM, 38(4): 23-28.
Fuhr, N., P. Hansen, M. Mabe, A. Micsik, and I. Solvberg. 2001. "Digital Libraries: A Generic Classification and Evaluation Scheme." Lecture Notes in Computer Science, 2163: 187-199.
Fuhr, N., G. Tsakonas, T. Aalberg, M. Agosti, P. Hansen, S. Kapidakis, C. Klas, L. Kovacs, M. Landoni, A. Micsik, C. Papatheodorou, C. Peters, and I. Solvberg. 2007. "Evaluation of Digital Libraries."International Journal on Digital Libraries, 8(1): 21-38.
Hill, L.L., R. Dolin, J. Frew, R.B. Kemp, M. Larsgaard, D.R. Montello, M.-A. Rae, and J. Simpson. 1997."User Evaluation: Summary of the Methodologies and Results for the Alexandria Digital Library, University of California at Santa Barbara." Proceedings of 60th ASIST Annual Meeting. (pp. 225-243, 369). Medford, NJ: Information Today.
Hill, L. L., L. Carver, M. Larsgaard, R. Dolin, T. R. Smith, J. Frew, and M.-A. Rae. 2000. "Alexandria Digital Library: User Evaluation Studies and System Design." Journal of the American Society for Information Science, 51: 246-259.
Joo, S. and J. Lee. 2011. "Measuring the Usability of Academic Digital Libraries: Instrument Development and Validation." The Electronic Library, 29(4): 523-537.
Marchionini, G., C. Plaisant, and A. Komlodi. 1998. " Interfaces and Tools for the Library of Congress National Digital Library Program." Information Processing & Management, 34(5): 535-555.
Matusiak, K. K. 2012. " Perceptions of Usability and Usefulness of Digital Libraries." The International Journal of Humanities and Arts Computing, 6(1-2): 133-147.
Nielson. J. 1993. Usability Engineering. Academic Press: Cambridge.
Noh, Y. 2010. "A Study on Developing Evaluation Criteria for Electronic Resources in Evaluation Indicators of Libraries." Journal of Academic Librarianship, 36(1): 41-52.
Saracevic, T. and L. Covi. 2000. "Challenges for Digital Library Evaluation." Proceedings of the American Society for Information Science, 37: 341-350.
Saracevic, T. 2004. Evaluation of Digital Libraries: An Overview. Presented at the DELOS Workshop on the Evaluation of Digital Libraries. [cited 2014.2.14]. -> need cited date. .
Tsakonas, G., S. Kapidakis, and C. Papatheodorou. 2004. Evaluation of User Interaction in Digital Libraries. In M. Agosti, N. Fuhr (eds.) Notes of the DELOS WP7 Workshop on the Evaluation of Digital Libraries, Padua, Italy.
Van House, N. A., M. H. Butler, V. Ogle, and L. Schiff. 1996. "User-centered Iterative Design for Digital Libraries: The Cypress Experience." D-Lib Magazine, 2.
Xie, I. 2006. "Evaluation of Digital Libraries: Criteria and Problems from Users' Perspectives." Library & Information Science Research, 28(3): 433-452.
Xie, I. 2008. "Users' Evaluation of Digital Libraries: Their Uses, Their Criteria, and Their Assessment." Information Processing & Management, 44(3): 1346-1373.
Zhang, Y. 2010. "Developing a Holistic Model for Digital Library Evaluation." Journal of the American Society for Information Science and Technology, 61(1): 88-110.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.