VIRTUAL MOUSE CONTROL USING HAND GESTURES RECOGNITION

Abstract: The mouse is one of the amazing inventions of human-computer interaction (HCI). Currently, the device still uses a wireless or Bluetooth mouse and is not completely device-free, as it uses a battery for power and a dongle to connect to a computer. In the proposed artificial intelligence virtual mouse system, this limitation can be overcome by using a web camera or a built-in camera to capture hand gestures and hand tip detection using CV. The algorithm used in the system uses a machine learning algorithm. Based on hand gestures, the computer can be controlled virtually and can perform left-click, right-click, scroll, and computer cursor functions without using a physical mouse. The algorithm is based on deep learning for hand detection. Thus, the proposed system avoids the spread of COVID-19 by removing human intervention and the device's dependence on computer control.

Keywords: HCI, webcam, left-click, right-click, scrolling, intervention, eliminating