Automated hand washing quality control and hand washing quality evaluation system with real-time feedback (Handwash)
Project No. lzp-2020/2-0309
About the project:
This project develops a quality control system for hand washing, specifically in the form of a prototype mobile phone application. The prototype will be able to evaluate the quality of hand washing, as well as provide real-time feedback. Several modalities for this purpose will be considered, including visual, audio and tactile. The results of the project will improve the well-being of health care professionals by reducing their cognitive load and health risks.
EDI tasks in the project:
Develop a machine vision solution for recognizing and classifying hand movements during washing according to the World Health Organization (WHO) guidelines, and integrate it into a mobile phone application.
Project partners:
Riga Stradins University
Institute of Electronics and Computer Science
Project results:
In collaboration with RSU Zenodo, three data sets with a total of 5,824 hand washing episodes (videos) and >10,000 annotations have been published
The machine learning models and code developed in the project have been published on GitHub: https://github.com/edi-riga/handwash
In collaboration with RSU, two scientific articles have been published and one master’s thesis has been defended.
Scientific articles:
1. Elsts, A., Ivanovs, M., Kadikis, R., and Sabelnikovs, O. “CNN for hand washing movement classification: What matters more—the approach or the dataset?” In 2022 Eleventh International Conference on Image Processing Theory, Tools and Applications (IPTA), pp. 1-6. IEEE, 2022.
2. Lulla, M., Rutkovskis, A., Slavinska, A., Vilde, A., Gromova, A., Ivanovs, M., Skadins, A., Kadikis, R. and Elsts, A., 2021. Hand-washing video dataset annotated according to the World Health Organization’s hand-washing guidelines. Data, 6(4), p.38.
Results presented at an international scientific conference in Austria: 2022 Eleventh International Conference on Image Processing Theory, Tools and Applications (IPTA)
Participating scientists
