This research focuses on the development of a system for measuring finger joint angles based on camera image and is intended for work within the field of medicine to track the movement and limits of hand mobility in multiple sclerosis. Measuring changes in hand mobility allows the progress of the di...
This research focuses on the development of a system for measuring finger joint angles based on camera image and is intended for work within the field of medicine to track the movement and limits of hand mobility in multiple sclerosis. Measuring changes in hand mobility allows the progress of the disease and its treatment process to be monitored. A static RGB camera without depth vision was used in the system developed, with the system receiving only the image from the camera and no other input data. The research focuses on the analysis of each image in the video stream independently of other images from that stream, and 12 measured hand parameters were chosen as follows: 3 joint angles for the index finger, 3 joint angles for the middle finger, 3 joint angles for the ring finger, and 3 joint angles for the pinky finger. Convolutional neural networks were used to analyze the information received from the camera, and the research considers neural networks based on different architectures and their combinations as follows: VGG16, MobileNet, MobileNetV2, InceptionV3, DenseNet, ResNet, and convolutional pose machine. The final neural network used for image analysis was a modernized neural network based on MobileNetV2, which obtained the best mean absolute error value of 4.757 degrees. Additionally, the mean square error was 67.279 and the root mean square error was 8.202 degrees. This neural network analyzed a single image from the camera without using other sensors. For its part, the input image had a resolution of 512 by 512 pixels, and was processed by the neural network in 7-15 ms by GPU Nvidia 2080ti. The resulting neural network developed can measure finger joint angle values for a hand with non-standard parameters and positions.
This research focuses on the development of a system for measuring finger joint angles based on camera image and is intended for work within the field of medicine to track the movement and limits of hand mobility in multiple sclerosis. Measuring changes in hand mobility allows the progress of the disease and its treatment process to be monitored. A static RGB camera without depth vision was used in the system developed, with the system receiving only the image from the camera and no other input data. The research focuses on the analysis of each image in the video stream independently of other images from that stream, and 12 measured hand parameters were chosen as follows: 3 joint angles for the index finger, 3 joint angles for the middle finger, 3 joint angles for the ring finger, and 3 joint angles for the pinky finger. Convolutional neural networks were used to analyze the information received from the camera, and the research considers neural networks based on different architectures and their combinations as follows: VGG16, MobileNet, MobileNetV2, InceptionV3, DenseNet, ResNet, and convolutional pose machine. The final neural network used for image analysis was a modernized neural network based on MobileNetV2, which obtained the best mean absolute error value of 4.757 degrees. Additionally, the mean square error was 67.279 and the root mean square error was 8.202 degrees. This neural network analyzed a single image from the camera without using other sensors. For its part, the input image had a resolution of 512 by 512 pixels, and was processed by the neural network in 7-15 ms by GPU Nvidia 2080ti. The resulting neural network developed can measure finger joint angle values for a hand with non-standard parameters and positions.
Zhou, Y., Jiang, G., Lin, Y..
A novel finger and hand pose estimation technique for real-time hand gesture recognition.
Pattern recognition,
vol.49,
102-114.
Kim, Jun Sik, Kim, Byung Kook, Jang, Minsu, Kang, Kyumin, Kim, Dae Eun, Ju, Byeong-Kwon, Kim, Jinseok.
Wearable Hand Module and Real-Time Tracking Algorithms for Measuring Finger Joint Angles of Different Hand Sizes with High Accuracy Using FBG Strain Sensor.
Sensors,
vol.20,
no.7,
1921-.
Lu, Sitong, Chen, Diansheng, Liu, Che, Jiang, Yongkang, Wang, Min.
A 3-D finger motion measurement system via soft strain sensors for hand rehabilitation.
Sensors and actuators. A, Physical,
vol.285,
700-711.
Kılıboz, Nurettin Çağrı, Güdükbay, Uğur.
A hand gesture recognition technique for human–computer interaction.
Journal of visual communication and image representation,
vol.28,
97-104.
Fan MediaPipe Hands: On-device Real-time Hand Tracking arXiv 2020
Kim, Kyun Kyu, Ha, InHo, Kim, Min, Choi, Joonhwa, Won, Phillip, Jo, Sungho, Ko, Seung Hwan.
A deep-learned skin sensor decoding the epicentral human motions.
Nature communications,
vol.11,
no.1,
2149-.
Ashiquzzaman, Akm, Lee, Hyunmin, Kim, Kwangki, Kim, Hye-Young, Park, Jaehyung, Kim, Jinsul.
Compact Spatial Pyramid Pooling Deep Convolutional Neural Network Based Hand Gestures Decoder.
Applied sciences,
vol.10,
no.21,
7898-.
Kim, Seo Yul, Han, Hong Gul, Kim, Jin Woo, Lee, Sanghoon, Kim, Tae Wook.
A Hand Gesture Recognition Sensor Using Reflected Impulses.
IEEE sensors journal,
vol.17,
no.10,
2975-2976.
Chawla Finger Vein Recognition Using Deep Learning Adv. Intell. Syst. Comput. 2021 10.1007/978-981-15-4992-2_7 1164 69
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., Jackel, L. D..
Backpropagation Applied to Handwritten Zip Code Recognition.
Neural computation,
vol.1,
no.4,
541-551.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.