Skip to content

Commit

Permalink
npp-sorting: log progress while reading page content
Browse files Browse the repository at this point in the history
  • Loading branch information
siddharthvp committed Oct 1, 2023
1 parent 5aff80a commit 7a11feb
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion reports/npp-sorting/npp-sorting.js
Original file line number Diff line number Diff line change
Expand Up @@ -92,9 +92,11 @@ process.chdir(__dirname);
/* GET SHORT DESCRIPTIONS AND PAGE CONTENT */
let pagesWithShortDescs = 0;

let pageBatchesRead = 0;
for await (let page of bot.readGen(Object.values(revidsTitles), {
prop: 'revisions|description',
}, 50)) {
}, 200)) {
log(`[+] Reading contents and descriptions: ${++pageBatchesRead} batches read`);
if (page.missing) {
tableInfo[page.title].skip = true; // skip it and return
return;
Expand Down

0 comments on commit 7a11feb

Please sign in to comment.