Easily select icons on the screen in any environment.
This is part of the Hands Free Computing project. Built with OpenCV 3.12 and Python 3.8.
Sponsor us and we can add your link, banner or other promo materials!
- Install from PyPI:
$ pip install iconmatch
You can use the functions as shown in demo.py as a default entry point.
In the below example, the main set of functions is called within a callback function, as this allows the threshold value to be controlled from a GUI in OpenCV.
Image Scanner:
import cv2 as cv
import IconMatch.IconMatch from ImageScanner
src = cv.imread("source to your image file")
scanner = ImageScanner(thersh = 100)
detected_rectangles = scanner.scan(src)
# list of [(x,y,w,h),(x,y,w,h), ... , (x,y,w,h)]Screen Scanner:
import IconMatch.IconMatch from ScreenScanner
scanner = ScreenScanner(thersh = 100)
detected_rectangles = scanner.scan(bbox = (x,y,w,h))
# list of [(x,y,w,h),(x,y,w,h), ... , (x,y,w,h)]RealTime demo:
python rt_demo.py- Detection of areas with a high likelihood of being clickable icons.
- Detection of closest rectangle to point of interest (be it gaze, or mouse as in the examples)
The current available APIs encompass what your image processing pipeline should contain. Both APIs are currently still experimental as I learn more about OpenCV and optimize code.
Performs Canny detection on passed images and group overlapping rectangles
Scans your display, take screnshoots and call ImageScanners
- Detect regions of interest with moderate accuracy
- Detect candidate region based on proximity
- Detect icon-like objects on the screen
- [?] Context provision into regions of interest
Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are genuinely appreciated.
- Fork the Project
- Create your Feature Branch (
git checkout -b feature/AmazingFeature) - Commit your Changes (
git commit -m 'Add some AmazingFeature') - Push to the Branch (
git push origin feature/AmazingFeature) - Open a Pull Request
Distributed under the MIT License. See LICENSE for more information.
Original Creator: Luis Zugasti - @luis__zugasti Original Creator blog: https://luiszugasti.me
Current Maintainer: Piotr Walas - @Piotr__Walas
Project Link: https://github.com/NativeSensors/IconMatch