forked from lapp0/twitterscraper
-
Notifications
You must be signed in to change notification settings - Fork 0
/
changelog.txt
115 lines (87 loc) · 3.87 KB
/
changelog.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
# twitterscraper changelog
## 0.x.x
TBD
## 0.7.0 ( 2018-05-06 )
### Fixed
- By using linspace() instead of range() to divide the number of days into
the number of parallel processes, edge cases ( p = 1 ) now also work fine.
This fixes https://github.com/taspinar/twitterscraper/issues/108.
### Improved
- The default value of begindate is set to 2006-03-21. The previous value (2017-01-01)
was chosen arbitrarily and leaded to questions why not all tweets were retrieved.
This fixes https://github.com/taspinar/twitterscraper/issues/88.
### Added
- Users can now save the tweets in a csv-format, with the arguments "-c" or "--csv"
## 0.6.2 ( 2018-03-21 )
### Fixed
- Errors occuring during the serialization of a non-html response (everything after 1st request),
No longer crashes the program but is catched with a try / except.
- Fixes https://github.com/taspinar/twitterscraper/issues/93
- The '@' character in an username is now removed by the ".strip('\@')" method instead of "[1:]".
- This fixes issue https://github.com/taspinar/twitterscraper/issues/105
## 0.6.1 ( 2018-03-17 )
### Improved
- The way the number of days are divided over the number of parallel processes is improved.
- The maximum number of parallel processes is limited to the max no of days.
- Fixes https://github.com/taspinar/twitterscraper/issues/101
## 0.6.0 ( 2018-02-17 )
### Fixed
- PR #89: closed pools to prevent zombie processes.
## 0.5.1 ( 2018-02-17 )
### Fixed
- Fixed MaxRecursionError crashes which was introduced with version 0.5.0
## 0.5.0 ( 2018-01-11 )
### Added
- Added the html code of a tweet message to the Tweet class as one of its attributes
## 0.4.2 ( 2018-01-09 )
### Fixed
- Fixed backward compatability of the new --lang parameter by placing it at the end of all arguments.
## 0.4.1 ( 2018-01-07 )
### Fixed
- Fixed --lang functionality by passing the lang parameter from its CL argument form to the generater url.
## 0.4 ( 2017-12-19 )
-----------
### Added
- Added "-bd / --begindate" command line arguments to set the begin date of the query
- Added "-ed / --enddate" command line arguments to set the end date of the query.
- Added "-p / --poolsize" command line arguments which can change the number of parallel processes.
Default number of parallel processes is set to 20.
### Improved
- Outputfile is only created if tweets are actually retrieved.
### Removed
- The ´query_all_tweets' method in the Query module is removed. Since twitterscraper is starting parallel processes by default,
this method is no longer necessary.
### Changed
- The 'query_tweets' method now takes as arguments query, limit, begindate, enddate, poolsize.
- The 'query_tweets_once' no longer has the argument 'num_tweets'
- The default value of the 'retry' argument of the 'query_single_page' method has been increased from 3 to 10.
- The ´query_tweets_once' method does not log to screen at every single scrape, but at the end of a batch.
## 0.3.3 ( 2017-12-06 )
-----------
### Added
-PR #61: Adding --lang functionality which can retrieve tweets written in a specific language.
-PR #62: Tweet class now also contains the tweet url. This closes https://github.com/taspinar/twitterscraper/issues/59
## 0.3.2 ( 2017-11-12 )
-----------
### Improved
-PR #55: Adding --dump functionality which dumps the scraped tweets to screen, instead of an outputfile.
## 0.3.1 ( 2017-11-05 )
-----------
### Improved
-PR #49: scraping of replies, retweets and likes is improved.
## 0.3.0 ( 2017-08-01 )
-----------
### Added
- Tweet class now also includes 'replies', 'retweets' and 'likes'
## 0.2.7 ( 2017-01-10 )
-----------
### Improved
- PR #26: use ``requests`` library for HTTP requests. Makes the use of urllib2 / urllib redundant.
### Added:
- changelog.txt for GitHub
- HISTORY.rst for PyPi
- README.rst for PyPi
## 0.2.6 ( 2017-01-02 )
-----------
### Improved
- PR #25: convert date retrieved from timestamp to day precision