AI Based Mouse Controller Using Hand Gestures For Real-Time Applications

The interaction with the computers by utilizing a revolutionary gesture-based mouse control system has many applications in a variety of sectors, including virtual reality, media management, productivity tools, and gaming. This technology makes use of hand motions tracked by a regular webcam or depth camera to navigate and manage the computer interface, rather than relying on physical mouse devices. The system uses computer vision algorithms to recognize, track, and understand hand gestures in real time in order to execute mouse actions like cursor movement, clicking, and scrolling. The system's key components include hand detection, gesture recognition, and cursor mapping, all of which collaborate to create a seamless and user-friendly interface. The system tackles issues like gesture accuracy and user adaptability via ongoing improvement and feedback integration. Because it provides a more accessible and inclusive mode of interaction, it is particularly helpful for those with motor impairments. This solution, at its heart, illustrates how cutting-edge computer vision and pattern recognition can facilitate smooth and intuitive human-computer interaction, paving the way for intelligent, touchless interfaces.

@article{ijter2025212507236942,
  author = {Dr. Bharati Bidikar and Gorremuchu Jayasri},
  title = {AI Based Mouse Controller Using Hand Gestures For Real-Time Applications},
  journal = {International Journal of Technology &  Emerging Research },
  year = {2025},
  volume = {1},
  number = {3},
  pages = {87-93},
  issn = {3068-109X},
  url = {https://www.ijter.org/article/212507236942/ai-based-mouse-controller-using-hand-gestures-for-real-time-applications},
  abstract = {The interaction with the computers by utilizing a revolutionary gesture-based mouse control system has many applications in a variety of sectors, including virtual reality, media management, productivity tools, and gaming. This technology makes use of hand motions tracked by a regular webcam or depth camera to navigate and manage the computer interface, rather than relying on physical mouse devices. The system uses computer vision algorithms to recognize, track, and understand hand gestures in real time in order to execute mouse actions like cursor movement, clicking, and scrolling. The system's key components include hand detection, gesture recognition, and cursor mapping, all of which collaborate to create a seamless and user-friendly interface. The system tackles issues like gesture accuracy and user adaptability via ongoing improvement and feedback integration. Because it provides a more accessible and inclusive mode of interaction, it is particularly helpful for those with motor impairments. This solution, at its heart, illustrates how cutting-edge computer vision and pattern recognition can facilitate smooth and intuitive human-computer interaction, paving the way for intelligent, touchless interfaces.},
  keywords = {Computer vision, hand motion control, gesture-based interface, human-computer interaction, assistive technology},
  month = {Jul},
}

Copyright © 2025 Authors retain the copyright of this article. This article is an open access article distributed under the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.