README.md

Meta Spy

Meta Spy is a versatile Python-based tool designed to scrape various data from Instagram profiles and Facebook profiles, pages and search results. Whether you need basic information or want to delve deep into a user's activity, Facebook Spy has you covered.

Report Bug · Request Feature

Documentation is available here

Info

If you're using a Facebook account with a custom ID in the URL (e.g., https://www.facebook.com/zuck), Facebook Spy will work smoothly. However, for accounts with default IDs in the URL, certain scrapers may not function as expected. These include scrapers for work and education, contact data, visited places, family members, recent places, reviews, and likes. Rest assured, we're actively working to resolve this issue

About The Project

The project, known as "Meta Spy," is a powerful and versatile tool designed to gather information from Instagram profiles, Facebook profiles, pages and search results.

The project is under constant development to improve its functionality and address any issues that may arise.

One notable limitation of the tool is that some scrapers may not work correctly for profiles with default account IDs in the URL, such as "https://www.facebook.com/profile.php?id=100063142210972." These scrapers include work and education history, contact data, visited places, family members, recent places, reviews, and likes. However, this issue does not occur for profiles with custom IDs in the URL, like "https://www.facebook.com/zuck.".

Key Features

• Login - Perform a secure two-step verification process to log in to Facebook account with enhanced security settings or log in to Facebook account using the default login method.
• Scrape details like: friend list, images, recent places, videos, reels, reviews, posts, likes, groups, events etc.
• Local web application - User is able to run a loval web application to browse scraped data, create notes for specified Person object and easly search details in web.
• Video downloader - download all scraped videos from facebook account or just by add passed url.
• Create a graphical representation of connections between different Facebook profiles based on their friendships.
• Utilize a free open-source language model to generate a concise summary of a Facebook user's infromation based on the scraped data.
• Initiate a friend crawler for a specified Facebook account. Gether data about friends and contunue the process for subsequent users in the queue.
• Save scraped data for a specified Facebook user to PDF file for documentation and anylysis.
• Running scrapers in parallel to speed up the data collection process
• Save all scraped data to JSON files and database
• Scrape image urls and download them from Instagram profile and save data to JSON file
• Scrape Instagram profile stats (number of posts, number of followers, number of following)

Built With

• Python
  • Typer
  • FastAPI
  • Selenium
• SQLite
• HTML / CSS / Bootstrap5

Getting Started

Installation

1. Clone git repository

git clone https://github.com/DEENUU1/meta-spy.git

2. Create dotenv file and add required data

cp .env_example .env

3. Install all requirements

pip install -r requirements.txt

4. Change directory to metaspy to run commands

cd metaspy

Tests

To run pytests use this command

pytest

Examples

This is just a few examples of how you can use this tool. For more comments check Documentation

Version

python main.py version

Login

python main.py login-2-step

OR

python main.py login

Search

python main.py fb-search <"Search Query"> <results> <option_1> <option_2> ... 

Options:
--post # Search for posts based on given query
--results # Number of results 
--people # Search for people based on given query
--group # Search for group based on given query
--place # Search for place based on given query
--event # Search for event based on given query
--page # Search for page based on given query

Scrape Facebook account/page

python main.py fb-account <facebook_id> <option_1> <option_2> ...

Options:
--work # Scrape work and education information from the given facebook account
--contact # Scrape contact data from the given facebook account
--location # Scrape location data from the given facebook account
--family # Scrape family members data from the given facebook account
--name # Scrape full name from the given facebook account
--friends # Scrape friends list from the given facebook account 🛑 Page not support
--images # Scrape images from the given facebook account 
--recent # Scrape recent places from the given facebook account 🛑 Page not support
--reels # Scrape urls for reels from the given facebook account
--reviews # Scrape reviews from the given facebook account
--videos # Scrape urls for videos from the given facebook account
--da # Download all videos from the given facebook account
--dn # Download only new videos from the given facebook account
--posts # Scrape all posts from the given facebook account
--details # Scrape details of posts from the given facebook account
--likes # Scrape likes from the given facebook account
--groups # Scrape groups from the given facebook account
--events # Scrape events from the given facebook account

Scrape Instagram account

python  main.py insta-account <id> <option_1> <option_2> ...

Options:
--images
--stats

Friend crawler

This command works similarly to the command that scrapes data about a given user's friends list. The difference, however, is that after scraping and creating Friend objects, it also creates objects for the CrawlerQueue model and after successfully scraping friends for one user, it proceeds to scraping the list of friends for the next user in the queue.

python main.py friend-crawler <facebook_id>

Graph

Graph of connections between Person objects based on ther friends.

python main.py graph

License

See LICENSE.txt for more information.