[논문]과학 교육 평가에서 나타나는 고등학생들의 성취 불일치 사례 - 정의적 영역 검사 도구를 중심으로 -

정수임; 신동희

doi:10.14697/jkase.2017.37.5.891

과학 교육 평가에서 나타나는 고등학생들의 성취 불일치 사례 - 정의적 영역 검사 도구를 중심으로 -
Cases of Discrepancy in High School Students' Achievement in Science Education Assessment: Focusing on Testing Tool in Affective Area 원문보기

한국과학교육학회지 = Journal of the Korean association for science education, v.37 no.5, 2017년, pp.891 - 909

초록
AI-Helper

이 연구는 과학 교육 현장에서 인지적 정의적 평가를 중심으로 한 양적 자료와 질적 자료에서 나타나는 몇 가지 불일치 사례를 분석했다. 308명의 고등학교 2학년 학생을 대상으로 학업 성취도와 정의적 성취도를 양적 자료로 수집했고, 그 중 33명의 학생을 면담한 질적자료를 분석했다. 주로 검사 도구의 측면에서 불일치 사례의 원인과 유형을 고찰했다. 연구 결과 양적 자료인 인지적 성취와 정의적 성취 영역 각각에서 과목별, 구인별 차이가 크게 나타나는 학생들이 상당수 있었고, 특히 두 영역 간 성취도 경향이 일치하지 않는 학생들도 20% 이상 분석되었다. 선택한 진로와 진학을 위해 의도적으로 과학 학습을 조절한 사례, 학교 과학과 과학에 대한 인식 차이에 따라 다른 반응 등의 사례가 면담을 통해 발견되었다. 도구로 측정한 양적 자료와 학생들의 면담 내용인 질적 자료를 비교한 결과 스스로 반응한 양적 자료와 다르게 자신을 평가하는 학생들이 대부분이었다. 이는 다양한 특성을 지닌 학생들이 검사 도구와 상호작용하는 과정에서 비롯된다. 검사 도구와 관련된 불일치 유형은 '문항 개발자가 의도한 개념과 학생들이 이해하는 개념 간 차이'와 '표현된 반응과 속마음 간의 차이'로 나타났다. 검사 도구에서 사용한 용어가 학생들에게 모호하게 인식될 때 자의적이거나 일관성 없이 반응하는 경우가 전자에, 사회적 바람직성이나 자아 방어 기제에 의한 반응 왜곡은 후자에 해당한다. 이상 연구 결과를 바탕으로 자기보고식 검사 도구가 학생들의 실제 인식을 잘 반영하고 있는지 검토하고 정교화하려는 노력, 학습 경험을 획일적으로 고정시키는 평가 개선 등이 필요하다.

Abstract ▼ AI-Helper

This study analyzed some of the discrepancies in quantitative and qualitative data focusing on cognitive and affective achievement in science education. Academic and affective achievement score of 308 high school students were collected as quantitative data, and 33 students were interviewed for qualitative data. We examined the causes and types of discrepancies in terms of testing tools. As a result from quantitative data, there were a large number of students with a big difference between subjects in cognitive achievement, and constructs in affective achievement. More than 20% of the students did not match tendency between achievements in two areas. Through interviews, some examples such as intentional control of science learning for future study and careers, different responses by differences in perception between school science and science, appeared. A comparison of quantitative data by testing tool between qualitative ones and interviews showed conflicting result, where most students evaluated themselves differently from their own quantitative data. That is due to the students' interaction with the testing tools. Two types of discrepancy related to testing tool are found. One is 'the concept difference between the item developer and students,' the other is 'the difference between students' exposed response and their real mindset.' These are related to the ambiguity of the terms used in the tool and response bias due to various causes. Based on this study, an effort is required to elaborate the testing item that matches students' actual perception and to apply students' science learning experience to testing items.

주제어

질의응답

핵심어	질문	논문에서 추출한 답변
	반응 왜곡의 대표적 사례는 무엇인가?	Messick(1991)은 이를 다시 검사에 상관없이 개인적 특성으로 나타나는 반응 양식(response style)과 검사 상황에 따라 발생하는 현상인 반응 세트(response set)로 분류했다. 반응 왜곡의 대표적 사례로 사회적으로 인정받으려는 방향으로 응답하려는 사회적 바람직성(social desirability)이 있는데 이는 응답자의 반응에 체계적 오류를 일으켜 잘못된 결과를 도출하는 주요 오염원이다(Bae, Lee, & Ham, 2015; Crowne & Marlowe, 1960; Cronbach, 1946). 따라서 자기보고식 검사 도구를 사용하는 심리학 영역에서는 일찍이 반응 왜곡을 통제하려는 체계적 노력을 기울이고 있는데 사회적 바람직성을 감지하는 척도를 개발하고 활용하는 연구(Bae, Lee, & Ham, 2015; Stöber, 2001; Paulhus, 1984; Crowne &Marlowe, 1960)와 측정 문항만을 통계적으로 처리해서 적합도 지수를 산출해서 활용하는 연구(Ferrando & Chico, 2001; Reise & Flannery, 1996) 등의 방향으로 수행되고 있다.
	검사 도구 개발 단계에에서 측정하려는 개념과 상황을 명확히 하려는 노력이 반영되기 위해서는 무엇을 해야하는가?	넷째, 검사 도구 개발 단계에는 측정하려는 개념과 상황을 명확히 하려는 노력(Chung & Shin, 2016)이 반영되어야 한다. 이를 위해서는 측정 개념을 표현하는 용어의 의미를 구체적으로 한정하는 과정을 안내서로 만들어야 한다. 문항의 진술을 분절 단위에서 전체 맥락으로 분석하고 문장의 의미를 명확히 하는 부속 성분까지 검토하는 단계가 포함된다.
	우리나라 학생들이 다른 나라에 비해 정의적 성취가 낮은 이유로 국내 연구자들은 무엇을 제시하였는가?	, 2016a). 우리나라 학생들이 다른 나라에 비해 정의적 성취가 낮은 이유에 대해서 국내 연구자들은 높은 성취 수준에 비교되는 자신감 부족(Kim et al., 2012), 동양 문화권의 특색(Park et al., 2004), 중간 반응 선호 경향(Shin & Sohn, 2014) 등을 제시했다. 그러나 국가 간 두 영역의 성취 경향을 비교해서 나타난 불일치 현상을 해석하는 것은 쉽지 않다.

참고문헌 (73)

Abd-El-Khalick, F., Summers, R., Said, Z., Wang, S., & Culbertson, M. (2015). Development and large-scale validation of an instrument to assess Arabic-speaking students' attitudes toward science. International Journal of Science Education, 37(16), 2637-2663.

상세보기
Aikenhead, G. (2001). Students' ease in crossing cultural borders into school science. Science Education, 85, 180-188.

상세보기
Aikenhead, G., & Jegede, O. J. (1999). Cross-cultural science education: A cognitive explanation of a cultural phenomenon. Journal of Research in Science Teaching, 36(3), 269-289.

상세보기
Au, Y. (2007). A search on social desirability according to administered mode and demonstrable condition of a psychology testing. Journal of Educational Evaluation, 20(4), 235-258.
Bae, B., Lee, D., & Ham, K. (2015). Validation of the Korean short-version of social desirability scale(SDS-9) using the Rasch model. Korean Journal of Counseling, 16(6), 177-197.

상세보기
Charmaz, K. (2006). Constructing grounded theory: A practical guide through qualitative analysis. Thousand Oaks, CA: Sage.
Chi, E. (2011). Applying the Rasch model to explore the differences between countries for tests administered across countries. Journal of Educational Evaluation, 24(1), 89-106.
Cho, Y. (2003). A study on I-consciousness-we-consciousness-relationships between I-consciousness-we-consciousness and individuality relatedness, psychosocial maturity, and interpersonal problem. The Korean Journal of Counseling and Psychotherapy, 15(1), 91-109.
Cho, J., Kim, S., Kim, M., Ok, H., Lim, H., & Son, S. (2012). Ways of improving Korean students' affective characteristic based on PISA and TIMSS results. Seoul: Korea Institute for Curriculum and Evaluation.
Choe, S., Ku, J., Kim, J., Park, S., Oh, E., Kim, J., & Baek, H. (2013). Strategies for improving the affective characteristics of Korean students based on the results of PISA and TIMSS. Seoul: Korea Institute for Curriculum and Evaluation.
Choi, S. (2004). Social psychology of Korean people. The Korean Psychological Association, 2, 151-162.
Chung, S., & Shin, D. (2016). Trends of assessment research in science education. Journal of the Korean Association for Science Education, 36(4), 563-579.

원문보기 상세보기
Corbin, J., & Strauss, A. (2008). Basics of qualitative research: Techniques and procedures for developing grounded theory(3rd ed.). Thousand Oaks, CA: Sage.
Costa, V. (1995). When science is "another world": Relationships between worlds of family, friends, school, and science. Science Education, 79(3), 313-333.

상세보기
Cronbach, L. (1946). Response sets and test validity. Educational and Psychological Measurement, 6(3), 475-494.

상세보기
Crowne, D., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24, 349-354.

상세보기
Dudley, N., McFarland, L., Goodman, S., Hunt, S., & Sydell, E. (2005). Racial differences in socially desirable responding in selection contexts: Magnitude and consequences. Journal of Personality Assessment, 85(1), 50-64.

상세보기
Ferrando, P., & Chico, E. (2001). Detecting dissimulation in personality test scores: A comparison between person-fit indices and detection scales. Educational and Psychological Measurement, 61, 997-1012.

상세보기
Ferrari, J., Bristow, & Cowman, S. (2005). Looking good or being good? The role of social desirability tendencies in student perception of institutional mission and values. College Student Journal, 39(1), 7-13.
Fives, H., Huebner, W., Birnbaum, A., & Nicolich, M. (2014). Developing a measure of scientific literacy for middle school students. Science Education, 98(4), 549-580.

상세보기
Ganster, D., Hennessey, H., & Luthans, F. (1983). Social desirability response effects: Three alternative models. Academy of Management Journal, 26(2), 321-331.

상세보기
Heine, S., Lehman, D., Peng, K., & Greenholtz, J. (2002). What's wrong with cross-cultural comparisons of subjective Likert scales?: The reference-group effect. Journal of Personality and Social Psychology, 82(6), 903-918.

상세보기
J？rges, H., Schneider, K., & B？chel, F. (2005). The effect of central exit examinations on student achievement: Quasi-experimental evidence from TIMSS Germany. Journal of the European Economic Association, 3(5), 1134-1155.

상세보기
Keillor, B., Owens, D., & Pettijohn, C. (2001). A cross-cultural/cross-national study of influencing factors and socially desirable response biases. International Journal of Market Research, 43(1), 63-84.

상세보기
Ku, J., Kim, S., Lee, H., Cho, S., & Park, H. (2016a). OECD Programme for International Student Assessment: An analysis of PISA 2015 results. Seoul: Korea Institute for Curriculum and Evaluation.
Ku, J., Kim, S., Lee, H., Cho, S., & Park, H. (2016b). OECD Programme for International Student Assessment: Establishing a foundation of PISA 2018 field trial. Seoul: Korea Institute for Curriculum and Evaluation.
Kim, S., Kim, K., & Park, J. (2014). The effect of mathematics achievement on changes in mathematics interest and values for middle school students. Journal of Research in Curriculum Instruction, 18(3), 683-701.

상세보기
Kim, K., Kim, S., Kim, M., Kim, S., Kang, M., Park, H., & Jung, S. (2009). Comparative analysis of curriculum and achievement characteristics between Korea and high performing countries in PISA & TIMSS. Seoul: Korea Institute for Curriculum and Evaluation.
Kim, S. (2013). Measurement of social norms: An experimental study of response bias. Korean Political Studies, 22(2), 153-178.
Kim, S., Seo, H. (2011). Self-regulated learning ability related to science inquiry skill and affective domain of science in middle school students. Journal of Science Education, 35(2), 307-323.
Kim, M., & Cho, J. (2013). Analysis of the properties of affective achievement in science based on TIMSS and science teachers' perception. Journal of the Korean Association for Science Education, 33(1), 46-62.

원문보기 상세보기
Kim, S., Park, J., Kim, H., Jin, E., Lee, M., Kim, J., Ahn, Y., & Seo, J. (2012). Findings from TIMSS for Korea: TIMSS 2011 international results. Seoul: Korea Institute for Curriculum and Evaluation.
Kim, Y. (2010). Development of a social desirability scale(SDS-24). Journal of Korean Social Welfare Administration, 12(3), 1-39.

상세보기
Kind, P., Jones, K., & Barmby, P. (2007). Developing attitudes towards science measures. International Journal of Science Education, 29(7), 871-893.

상세보기
Koballa, T. R. (1988). Attitude and related concepts in science education. Science Education, 72(2), 115-126.

상세보기
Krynowsky, B. (1988). Problems in assessing student attitude in science education: A partial solution. Science Education, 72(4), 575-584.

상세보기
Kwak, Y. (2017). Exploration of features of Korean eighth grade students' attitudes toward science. Journal of the Korean Association for Science Education, 37(1), 135-142.
Lee, J. (2016). Analysis of changes in the learning environments of middle school science classes. Journal of the Korean Association for Science Education, 36(5), 717-727.

원문보기 상세보기
Lee, M., & Kim, K. (2004). Relationship between attitudes toward science and science achievement. Journal of the Korean Association for Science Education, 24(2), 399-407.
Lee, M., Sohn, W., & No, U. (2007). The results from PISA 2006. Seoul: Korea Institute for Curriculum and Evaluation.
Lee, M., Park, S., Sohn, W., & Nam, M. (2007). Technical report for PISA 2006 main study. Seoul: Korea Institute for Curriculum and Evaluation.
Lee, M., Choi, J., Lee, J., & Shin, M. (2016). A preliminary study of defensive response style on a self-report personality assessment. The Journal of the Korean Association of Psychotherapy, 8(2), 61-80.
MaCrae, R., & Costa, P. (1983). Social desirability scales: More substance than style. Journal of Consulting and Clinical Psychology, 51, 882-888.

상세보기
Martin, M., Mullis, I., & Foy, P. (2012). TIMSS 2011 international science report. MA: Boston College.
Messick, S. (1991). Psychology and methodology of response styles. In R. E. Snow & D. E. Willey(Eds.). Improving inquires in social science. Hillsdale, NJ: Erlbaum.
Ministry of Education Science, and Technology (2011). Science curriculum. Notification No. 2011-361 of MOEST. Seoul: MOEST.
Mullis, I., Martin, M., & Foy, P. (2012). TIMSS 2011 international mathematics report. MA: Boston College.
Murayama, K., Zhou, M., & Nesbit, J. (2009). A cross-cultural examination of the psychometric properties of response to the achievement goal questionnaire. Educational and Psychological Measurement, 69(2), 266-286.

상세보기
Myeong, J., & Crawley, F. E. (1993). Predicting and understanding Korean high school students' science track choice: Testing the theory of reasoned action by structural equation modeling. Journal of Research in Science Teaching, 30(4), 381-400.

상세보기
Ones, D., Viswesvara, C., & Reiss, A. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679.

상세보기
Osborne, J., Simon, S., & Collins, S. (2003). Attitudes towards science: A review of the literature and its implications. International Journal of Science Education, 25(9), 1049-1079.

상세보기
Osborne, J., Simon, S., & Tytler, R. (2009). Attitudes towards science: An update. Paper presented at the annual meeting of the American Educational Research Association, San Diego, California.
Park, C. (2007). The trend in the Korean middle school student's affective variables toward mathematics and its effect on their mathematics achievement. The Mathematical Education, 46(1), 19-31.
Park, C. Jeong, E., Kim, K., Han, K., Jun, H., & Lee, S. (2004). Teachers, instruction, and achievement based on TIMSS 1999. Seoul: Korea Institute for Curriculum and Evaluation.
Park, H., (2008). Test of group invariance for the structural model among motivation, self-concept and student achievement: Using PISA 2006 data. Journal of Educational Evaluation, 21(3), 43-67.

상세보기
Paulhus, D. (1984). Two component models of socially desirable responding. Journal of Personality and Social Psychology, 46, 589-609.
Paulhus, D. (1998). Interpersonal and intrapsychic adaptiveness of trait self-enhancement: A mixed blessing? Journal of Personality and Social Psychology, 74, 1197-1208.

상세보기
Reise, S., & Flannery, W. (1996). Assessing person-fit on measures of typical performance. Applied Measurement in Education, 9(1), 9-26.

상세보기
Saldana, J. (2009). The coding manual for qualitative researchers. Thousand Oaks, London: Sage.
Sang, K., Kwak, Y., Park, J., & Park, S. (2016). The Trends in International Mathematics and Science Study (TIMSS): Findings from TIMSS 2015 for Korea. Seoul: Korea Institute for Curriculum and Evaluation.
Schluf, Boaz, Hattie, J., & Dixon, R. (2008). Factors affecting responses to Likert type questionnaires: Introduction of the ImpExp, a new comprehensive model. Social Psychology of Education, 11(1), 59-78.

상세보기
Schunk, D., & Pajares, F. (2009). Self efficacy theory. In Wentzel, K., & Wigfield, A. (Eds). Handbook of motivation at school. New York: Routledge.
Seo, J., Choi, J., & Kim, Y. (2007). Comparison of life learning skills of gifted science students and normal students in high school. Biology Education, 35(1), 61-72.
Shen, C., & Pedulla, J. (2000). The relationship between students' achievement and their self-perception of competence and rigour of mathematics and science: A cross-national analysis. Assessment in Education, 7(2), 237-253.

상세보기
Shin, H., & Sohn, W. (2014). Applying a mixed Rasch model to investigate response styles in TIMSS 2011 math enjoyment scale. Journal of Educational Evaluation, 27(2), 429-448.
Sohn, W. (2017). Individual difference and consistency in response scale use. Korean Journal of Educational Research, 55(1), 23-43.
Son, E., Cha, J., & Kim, A. (2007). Test of construct equivalence of personality inventory in low and high socially desirable responding groups. Korean Journal of Social and Personality Psychology, 21(2), 71-87.
Song, H. (2010). Development of a self-reported executive function rating scale for the Korean high school students: A preliminary study. The Korean Journal of Clinical Psychology, 29(1), 109-124.

상세보기
Stephen, A. (2000). A quantitative review of the effect of computerized testing on the measurement of social desirability. Educational and Psychological Measurement, 60(3), 340-360.

상세보기
Stober, J. (2001). The social desirability scale-17(SDS-17): Convergent validity, discriminant validity, and relationship with age. European Journal of Psychological Assessment, 17(3), 222-232.

상세보기
Strauss, A. L. (1987). Qualitative analysis for social scientists. Cambridge: Cambridge University Press.
Suzuki, L., & Ponterotto, J. (2007). Handbook of multicultural assessment: Clinical, psychological, and educational applications. San Francisco, CA: John Wiley & Sons, Inc.
Vailant, G. (1992). Ego mechanism of defense. Washington: American Psychiatric Press.

저자의 다른 논문 :

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증