[논문]설명가능한 인공지능 기술을 이용한 인공신경망 기반 수질예측 모델의 성능향상

이원진; 이의훈

doi:10.3741/jkwra.2023.56.11.801

설명가능한 인공지능 기술을 이용한 인공신경망 기반 수질예측 모델의 성능향상
Performance improvement of artificial neural network based water quality prediction model using explainable artificial intelligence technology 원문보기

Journal of Korea Water Resources Association = 한국수자원학회논문집, v.56 no.11, 2023년, pp.801 - 813

이원진 (충북대학교 토목공학과) , 이의훈 (충북대학교 토목공학부)

초록
AI-Helper

최근 인공신경망(Artificial Neural Network, ANN)의 연구가 활발하게 진행되면서 ANN을 이용하여 하천의 수질을 예측하는 연구가 진행되고 있다. 그러나 ANN은 Black-box의 형태이기 때문에 ANN 내부의 연산과정을 분석하는데 어려움이 있다. ANN의 연산과정을 분석하기 위해 설명가능한 인공지능(eXplainable Artificial Intelligence, XAI) 기술이 사용되고 있으나, 수자원 분야에서 XAI 기술을 활용한 연구는 미비한 실정이다. 본 연구는 XAI 기술 중 Layer-wise Relevance Propagation (LRP)을 사용하여 낙동강의 다산 수질관측소의 수온, 용존산소량, 수소이온농도 및 엽록소-a를 예측하기 위한 Multi Layer Perceptron (MLP)을 분석하였다. LRP를 기반으로 수질을 학습한 MLP를 분석하여 수질을 예측하기 위한 최적의 입력자료를 선정하고, 최적의 입력자료를 이용하여 학습한 MLP의 예측결과에 대한 분석을 실시하였다. LRP를 이용하여 최적의 입력자료를 선정한 결과를 보면, 수온, 용존산소량, 수소이온농도 및 엽록소-a 모두 주변지역의 일 강수량을 제외한 입력자료를 학습한 MLP의 예측정확도가 가장 높았다. MLP의 용존산소량 예측결과에 대한 분석결과를 보면, 최고점에서 수소이온농도 및 용존산소량의 영향이 크고 최저점에서는 수온의 영향이 큰 것으로 분석되었다.

Abstract ▼ AI-Helper

Recently, as studies about Artificial Neural Network (ANN) are actively progressing, studies for predicting water quality of rivers using ANN are being conducted. However, it is difficult to analyze the operation process inside ANN, because ANN is form of Black-box. Although eXplainable Artificial Intelligence (XAI) is used to analyze the computational process of ANN, research using XAI technology in the field of water resources is insufficient. This study analyzed Multi Layer Perceptron (MLP) to predict Water Temperature (WT), Dissolved Oxygen (DO), hydrogen ion concentration (pH) and Chlorophyll-a (Chl-a) at the Dasan water quality observatory in the Nakdong river using Layer-wise Relevance Propagation (LRP) among XAI technologies. The MLP that learned water quality was analyzed using LRP to select the optimal input data to predict water quality, and the prediction results of the MLP learned using the optimal input data were analyzed. As a result of selecting the optimal input data using LRP, the prediction accuracy of MLP, which learned the input data except daily precipitation in the surrounding area, was the highest. Looking at the analysis of MLP's DO prediction results, it was analyzed that the pH and DO a had large influence at the highest point, and the effect of WT was large at the lowest point.

주제어

표/그림 (28)

그림 Fig. 1. Schematic figure of MLP
그림 Fig. 2. Schematic figures of forward propagation and relevance propagation
그림 Fig. 3. Location of monitoring stations
표 Table 1. Input data of MLP
그림 Fig. 4. Total relevance score of each input data for MLP learning WT using all input data
표 Table 2. Removed data according to LRP results for MLP learning WT
그림 Fig. 5. Training results of MLP learning WT using input data removed by each case
그림 Fig. 6. Prediction results of MLP learning WT using input data removed by each case
그림 Fig. 7. WT prediction results of Case 6
그림 Fig. 8. LRP results for WT lowest and highest points of Case 6 prediction results
그림 Fig. 9. Total relevance score of each input data for MLP learning DO using all input data
그림 Fig. 10. Training results of MLP learning DO using input data removed by each case
그림 Fig. 11. Prediction results of MLP learning DO using input data removed by each case
표 Table 3. Removed data according to LRP results for MLP learning DO
그림 Fig. 12. DO prediction results of Case 6
그림 Fig. 13. LRP results for DO lowest and highest points of Case 6 prediction results
그림 Fig. 14. Total relevance score of each input data for MLP learning pH using all input data
표 Table 4. Removed data according to LRP results for MLP learning pH
그림 Fig. 15. Training results of MLP learning pH using input data removed by each case
그림 Fig. 16. Prediction results of MLP learning pH using input data removed by each case
그림 Fig. 17. pH prediction results of Case 6
그림 Fig. 18. LRP results for pH lowest and highest points of Case 6 prediction results
그림 Fig. 19. Total relevance score of each input data for MLP learning Chl-a using all input data
그림 Fig. 20. Training results of MLP learning Chl-a using input data removed by each case
그림 Fig. 21. Prediction results of MLP learning Chl-a using input data removed by each case
그림 Fig. 22. Chl-a prediction results of Case 6
표 Table 5. Removed data according to LRP results for MLP learning Chl-a
그림 Fig. 23. LRP results for Chl-a lowest and highest points of Case 6 prediction results

참고문헌 (36)

Ahn, S.J., Yeon, I.S., Han, Y.S., and Lee, J.K. (2001). "Water quality？forecasting at Gongju station in Geum River using neural？network model." Journal of Korea Water Resources Association,？Vol. 34, No. 6, pp. 701-711.？
Ahn, S.R., Ha, R., Yoon, S.W., and Kim, S.J. (2014). "Evaluation of？future turbidity water and eutrophication in Chungju Lake by？climate change using CE-QUAL-W2." Journal of Korea Water Resources Association, Vol. 47, No. 2, pp. 145-159.？
Arras, L., Montavon, G., Muller, K.R., and Samek, W. (2017).？"Explaining recurrent neural network predictions in sentiment？analysis." arXiv, arXiv:1706.07206.？
Bach, S., Binder, A., Montavon, G., Klauschen, F., Muller, K.R.,？and Samek, W. (2015). "On pixel-wise explanations for nonlinear classifier decisions by layer-wise relevance propagation."？PloS One, Vol. 10, No. 7, e0130140.？

상세보기
Carbone, G., Bortolussi, L., and Sanguinetti, G. (2022). "Resilience？of bayesian layer-wise explanations under adversarial attacks."？Proceedings of the 2022 International Joint Conference on？Neural Networks (IJCNN), Padua, Italy, pp. 1-8.？
Chun, Y.E., Kim, S.B., Lee, J.Y., and Woo, J.H. (2021). "Study on？credit rating model using explainable AI." The Korean Data &？Information Science Society, Vol. 32, No. 2, pp. 283-295.？
Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2014). "Empirical？evaluation of gated recurrent neural networks on sequence？modeling." arXiv, arXiv:1412.3555.？
Dogan, E., Ates, A., Yilmaz, E.C., and Eren, B. (2008). "Application？of artificial neural networks to estimate wastewater treatment？plant inlet biochemical oxygen demand." Environmental Progress, Vol. 27, No. 4, pp. 439-446.？

상세보기
Drolc, A., and Koncan, J.Z. (1999). "Calibration of QUAL2E model？for the Sava River (Slovenia)." Water Science and Technology,？Vol. 40, No. 10, pp. 111-118.？

상세보기
Haghiabi, A.H., Nasrolahi, A.H., and Parsaie, A. (2018). "Water？quality prediction using machine learning methods." Water？Quality Research Journal, Vol. 53, No. 1, pp. 3-13.？
Hochreiter, S., and Schmidhuber, J. (1997). "Long short-term memory." Neural Computation, Vol. 9, No. 8, pp. 1735-1780.？

상세보기
Kim, S.H., Park, J.H., and Kim, B. (2021). "Prediction of cyanobacteria harmful algal blooms in reservoir using machine learning？and deep learning." Journal of Korea Water Resources Association, Vol. 54, No. 12, pp. 1167-1181.？
Lee, J., and Han, J. (2021). "Layer-wise Relevance Propagation (LRP)？based technical and macroeconomic indicator impact analysis？for an explainable deep learning model to predict an increase？and decrease in KOSPI." Journal of Korean Institute of Information Scientists and Engineers, Vol. 48, No. 12, pp. 1289-1297.？
Lee, J.H., Kim, J.S., Jang, H.W., and Lee, J.C. (2013). "Drought？forecasting using the multi layer perceptron (MLP) artificial？neural network model." Journal of Korea Water Resources？Association, Vol. 46, No. 12, pp. 1249-1263.？
Lee, S., and Lee, D. (2018). "Improved prediction of harmful algal？blooms in four Major South Korea's Rivers using deep learning？models." International Journal of Environmental Research and？Public Health, Vol. 15, No. 7, 1322.？
Lee, W.J., and Lee, E.H. (2023). "Improvement of multi layer perceptron performance using combination of adaptive moments？and improved harmony search for prediction of Daecheong？Dam inflow." Journal of Korea Water Resources Association,？Vol. 56, No. 1, pp. 63-74.？
Lim, H., An, H., Choi, E., and Kim, Y. (2020). "Prediction of the DO？concentration using the machine learning algorithm: case study？in Oncheoncheon, Republic of Korea." Korean Journal of？Agricultural Science, Vol. 47, No. 4, pp. 1029-1037.？
Lu, H., and Ma, X. (2020). "Hybrid decision tree-based machine？learning models for short-term water quality prediction."？Chemosphere, Vol. 249, 126169.？

상세보기
Luis, M.B., Sidinei, M.T., and Priscilla, C. (2010). "Limnological？effects of Egeria najas Planchon (Hydrocharita-ceae) in the？arms of Itaipu Reservoir (Brazil, Paraguay)." Limnology, Vol.？11, No. 1, pp. 39-47.？

상세보기
Lundberg, S.M., and Lee, S.I. (2017). "A unified approach to interpreting model predictions." Proceedings of the Advances in？Neural Information Processing Systems, Long Beach, CA,？U.S., Vol. 30. pp. 4768-4777.？
Luo, D.L. (2002). "Study on the distribution of dissolved oxygen in？Shenhu Bay and its relationship with phytoplankton and？suspended matter." Marine Science Bulletin, Vol. 21, No. 1,？pp. 31-36.？
Mahsa, M., and Lee, T. (2018). "Comparison of optimization algorithms in deep learning-based neural networks for hydrological？forecasting: Case study of Nam River daily runoff." Journal of？the Korean Society of Hazard Mitigation, Vol. 18, No. 6, pp.？377-384.？
McCulloch, W.S., and Pitts, W. (1943). "A logical calculus of the？ideas immanent in nervous activity." The Bulletin of Mathematical Biophysics, Vol. 5, pp. 115-133.？

상세보기
Mok, J.Y., Choi, J.H., and Moon, Y.I. (2020). "Prediction of multipurpose dam inflow using deep learning." Journal of Korea？Water Resources Association, Vol. 53, No. 2, pp. 97-105.？
Nahm, E-S. (2022). "Neural network modeling based XAI of activated？sludge process in wastewater treatment system for dissolved？oxygen control." The Transactions of the Korean Institute of？Electrical Engineers, Vol. 71, No. 8, pp. 1176-1181.？
Nawi, N.M., Atomi, W.H., and Rehman, M.Z. (2013). "The effect of？data pre-processing on optimized training of artificial neural？networks." Procedia Technology, Vol. 11, pp. 32-39.？
Park, S.Y., Choi, J.H., Wang, S., and Park, S.S. (2006). "Design of a？water quality monitoring network in a large river system using？the genetic algorithm." Ecological Modelling, Vol. 199, No. 3,？pp. 289-297.？

상세보기
Ribeiro, M.T., Singh, S., and Guestrin, C. (2016). ""Why should i？trust you?" Explaining the predictions of any classifier." Proceedings of the 22nd ACM SIGKDD International Conference？on Knowledge Discovery and Data Mining, San Francisco,？CA, U.S., pp. 1135-1144.？
Roh, S., and Park, D. (2021). "Sweet persimmons classification？based on a mixed two-step synthetic neural network." Journal？of Korea Multimedia Society, Vol. 24, No. 10, pp. 1358-1368.？
Rosenblatt, F. (1958). "The perceptron: A probabilistic model for？information storage and organization in the brain." Psychological review, Vol. 65, No. 6, pp. 386-408.

상세보기
Rumelhart, D.E., Hinton, G.E., and Williams, R.J. (1986). "Learning？representations by back-propagating errors." Nature, Vol. 323, No. 6088, pp. 533-536.？

상세보기
Sheng, T.Q., and Xu, Y.Z. (1993). "Distribution of dissolved oxygen？and pH in Kuroshio area of East of China Sea." Marine？Science Bulletin, Vol. 12, No. 4, pp. 55-62.？
Wang, T.S., Tan, C.H., Chen, L., and Tsai, Y.C. (2008). "Applying？artificial neural networks and remote sensing to estimate？chlorophyll-a concentration in water body." Proceedings 2008？Second International Symposium on Intelligent Information？Technology Application, IEEE, Shanghai, China, Vol. 1, pp.？540-544.？
Wu, H., Huang, A., and Sutherland, J.W. (2022). "Layer-wise relevance propagation for interpreting LSTM-RNN decisions in？predictive maintenance." The International Journal of Advanced？Manufacturing Technology, Vol. 118, pp. 963-978.？

상세보기
Yoo, Y., Kim, D., and Lee, J. (2020). "Performance analysis of various？activation functions in super resolution model." Proceedings？of the Korea Information Processing Society Conference, Vol.？27, No. 1, pp. 504-507.？
Zhou, T., Jiang, Z., Liu, X., and Tan, K. (2020). "Research on the？long-term and short-term forecasts of navigable river's water-level fluctuation based on the adaptive multilayer perceptron."？Journal of Hydrology, Vol. 591, 125285.

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증