Skip to content

Tweet scraping

Jump to bottom Edit New page
Davide Tampellini edited this page Apr 2, 2015 · 4 revisions

After configuring your installation of Dump Scraper, you are ready to fetch the tweets posted by Dump Monitor and save the linked dump files from PasteBin.

The actual command you have to run it's pretty simple:
dumpscraper scrape

Dump Scraper will fetch the dump files, starting from the last one you already downloaded. If the file was removed by PasteBin, it won't be retrieved; otherwise, it will be saved inside the folder data/day-of-the-tweet/tweet-id.txt.

Dump Scraper and its documentation are Copyright © 2015-2016 Davide Tampellini / FabbricaBinaria.

Dump Scraper is Open Source Software, distributed under the GNU General Public License, version 3 of the license, or (at your option) any later version.

The Dump Scraper Wiki content is provided under the GNU Free Documentation License, version 1.3 of the license, or (at your option) any later version.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license can be found on the GNU site.

Miscellanea

Clone this wiki locally