This is a web service for searching the CSM/online platform - very popular Polish worship tutorials database.
CSM/online website has a very lacking search functionality, no autocomplete despite the fact, that there are only few hundred songs. So I created a scraper, that indexes all the links. Then, a simple webapp with better client-side search can be used to find them faster.
- Java application uses jsoup library to log in to the website, impersonating my user. It scrapes HTML finding all songs, then creates JSON file with URLs to them.
- Simple React app reads this JSON file and presents it as a list, with autocomplete search.
You can try it out immediately via usual npm start. Updating the index of all the links can be done as follows:
- update
LAST_PAGE_NUMBERvariable in scraper source with the number of last page on the website (automatic detection is not implemented) - run
EMAIL="[email protected]" PASSWORD="heregoespassword" ./gradlew runwith Java 8 present in the shell
