Skip to content

Crawl and search the source code of a website for a particular code snippet.

Notifications You must be signed in to change notification settings

jevawin/searchthesourcecode

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

79 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Search the Source Code

Is a tool that finds snippets of source code on a website for you. It uses Scrapy, a Python library, to crawl a website you provide, parses the HTML for each URL it finds and searches that HTML for the snippet of code you provided.

For example, let's say you want to find out which pages on your site are running jQuery, you'd search for something like:

$(function() {

On https://www.yoursite.com/, and STSC would return the URLs it found that piece of code on.

You can search for anything you like, from a single character (you'll probably return a lot of URLs) to a full snippet of code.

Visit https://searchthesourcecode.com/ to try it out!

Running locally

git clone [email protected]:jevawin/searchthesourcecode.git
cd searchthesourcecode
npm install
pip install scrapy
node index.js

Then access on http://localhost:8080/?domain=www.domaintosearch.com&search=encodedhtml

About

Crawl and search the source code of a website for a particular code snippet.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published