Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Collaborative Launch 1733234400 (Tuesday Dec 3rd, 2024 14:00 UTC) #20

Closed
jurraca opened this issue Nov 26, 2024 · 9 comments
Closed

Collaborative Launch 1733234400 (Tuesday Dec 3rd, 2024 14:00 UTC) #20

jurraca opened this issue Nov 26, 2024 · 9 comments

Comments

@jurraca
Copy link
Contributor

jurraca commented Nov 26, 2024

Next collaborative launch is planned for 1733234400 (Tuesday, Dec 3rd 2024, 14:00:00 UTC).

./run map -w=1733234400 -irr -rv

The latest kartograf release is here. However, if you run from the master branch you should see a performance improvement, and we'd like to see how it goes on your machine! The requirements are Python 3.11 and we're still on rpki-client 9.3. We recommend you use Nix and run nix develop to enter an environment with the most recent dependency versions, including rpki-client 9.3.
@dunxen
Copy link

dunxen commented Dec 3, 2024 •
edited
Loading

My result: af69975d8325db35d43c4b91883893e78c1d9c562c774439c474215d501c0e2b

(Suspiciously short runtime)

Logs 
./run map -w=1733234400 -irr -rv

--- Start Kartograf ---

Kartograf version: 0.4.8
Using rpki-client version 9.3 (recommended).
Coordinated launch mode: Waiting until 1733234400 (2024-12-03 16:00:00 SAST) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1733234400 (2024-12-03 14:00:00 UTC, local: 2024-12-03 16:00:00 SAST)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /home/dunxen/repos/github.com/asmap/kartograf/data/1733234400/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /home/dunxen/repos/github.com/asmap/kartograf/data/1733234400/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /home/dunxen/repos/github.com/asmap/kartograf/data/1733234400/rpki/tals/arin.tal, file hash: 4f6c1e456fe5ab468beac1495e57d99a1eeeaa4d9f9e34519eaf58857c21af48
Downloaded TAL for LACNIC to /home/dunxen/repos/github.com/asmap/kartograf/data/1733234400/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /home/dunxen/repos/github.com/asmap/kartograf/data/1733234400/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Downloaded RPKI Data, hash sum: 4d5bdeb2f0fcf911a3c4a7bbdace33e5e1a5de35d345b05344b5bb5d2823631f
...finished in 0:03:47.445173

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 804bb3326f73b738c1b4647d0220225a22753bfc0a0a7098c428cef1154ee462
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 1177cfc11975f9b18cb73780e9a0ce0ff9ff3ed66e7b0e2d3242a941c7c55dba
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: d26382d56ee132154790a0bdc78f24617fa8cd6abdeccc7d45b0ab8fd81a7db9
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: 16586171264b9aef5b6e080326e03ad6783c9e2d1bb4703f84240452113d7e3a
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: e3e1e7edc06196228b871e843ea0fbf7eb90a1e13d9d611c4f2566b568068dab
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: 98207add80aede9d9b438ee6f1ea8b3112a129062e7d9217daca4298895e6642
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: e111ad979eca9f5fd71a5256cbf570072a5b06212c4aac8b76ff6af52c4c2e86
...finished in 0:00:56.011551

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2024/12/routeviews-rv2-20241201-1200.pfx2as.gz
Downloaded /home/dunxen/repos/github.com/asmap/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: da457126fca9645940a1aa3aeca423ad7c1e68352d1bd511fee61fb8e453e0e0
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2024/12/routeviews-rv6-20241202-1200.pfx2as.gz
Downloaded /home/dunxen/repos/github.com/asmap/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 21652943f2bf103ef0d9f4dfc46ef7e49439dc1f7230bf709a5cb05d4337f46d
...finished in 0:00:09.575981

--- Validating RPKI ---

Validating RPKI ROAs
270014 raw RKPI ROA files found.
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 270014/270014 [09:23<00:00, 479.41it/s]
270014 RKPI ROAs validated and saved to /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/rpki/rpki_raw.json, file hash: 3fb3feafd58017d1fb540067fd9ea5c9a5dc30261eb030878ac6cf07a8fc2258
...finished in 0:09:38.620070

--- Parsing RPKI ---

Parsing 270014 ROAs
Result entries written: 557758
Duplicates found: 72993
Invalids found: 1892
Incompletes: 0
Non-ROA files: 0
...finished in 0:01:10.828948

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/irr/afrinic.db
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/irr/apnic.db.route
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/irr/apnic.db.route6
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/irr/arin.db
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/irr/lacnic.db
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/irr/ripe.db.route
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/irr/ripe.db.route6
Found valid, unique entries: 1820027
...finished in 0:04:39.259183

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file:

Finished merging extra prefixes.
Finished filtering! Originally 1820027 entries filtered down to 377343
Merging base file with filtered extra file
...finished in 0:04:00.552500

--- Parsing Routeviews pfx2as ---

Unzipping /home/dunxen/repos/github.com/asmap/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /home/dunxen/repos/github.com/asmap/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /home/dunxen/repos/github.com/asmap/kartograf/out/1733234400/collectors/pfx2asn.txt
...finished in 0:02:10.410824

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file:

Finished merging extra prefixes.
Finished filtering! Originally 1246046 entries filtered down to 388172
Merging base file with filtered extra file
...finished in 0:03:42.884826

--- Sorting results ---

...finished in 0:00:12.711176

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: af69975d8325db35d43c4b91883893e78c1d9c562c774439c474215d501c0e2b
Total runtime: 0:30:29.716272
Machine Specs 

        a8888b.           Host        -  dunxen@brute
       d888888b.          Machine     -  Micro-Star International Co., Ltd. MS-7A32 1.0
       8P"YP"Y88          Kernel      -  6.12.1
       8|o||o|88          Distro      -  NixOS 25.05 (Warbler)
       8'    .88          DE          -  Hyprland
       8`._.' Y8.         Packages    -  38 (cargo), 6 (flatpak), 20973 (nix)
      d/      `8b.        Shell       -  nu
     dP        Y8b.       Terminal    -  alacritty
    d8:       ::88b.      Resolution  -  3840x2160
   d8"         'Y88b      Uptime      -  6d 10h 40m
  :8P           :888      CPU         -  AMD Ryzen 9 5950X 16-Core Processor (32)
   8a.         _a88P      CPU Load    -  2%
 ._/"Yaa     .| 88P|      Memory      -  18.5 GB / 131.8 GB
 \    YP"    `|     `.    Disk Space  -  543.8 GB / 999.1 GB
 /     \.___.d|    .'
 `--..__)     `._.'

@jurraca
Copy link
Contributor Author

jurraca commented Dec 3, 2024

Hash: af69975d8325db35d43c4b91883893e78c1d9c562c774439c474215d501c0e2b

Logs --- Start Kartograf ---

Kartograf version: 0.4.8
Using rpki-client version 9.3 (recommended).
Coordinated launch mode: Waiting until 1733234400 (2024-12-03 14:00:00 WET) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1733234400 (2024-12-03 14:00:00 UTC, local: 2024-12-03 14:00:00 WET)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /home/base/code/asmap/kartograf/data/1733234400/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /home/base/code/asmap/kartograf/data/1733234400/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /home/base/code/asmap/kartograf/data/1733234400/rpki/tals/arin.tal, file hash: 4f6c1e456fe5ab468beac1495e57d99a1eeeaa4d9f9e34519eaf58857c21af48
Downloaded TAL for LACNIC to /home/base/code/asmap/kartograf/data/1733234400/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /home/base/code/asmap/kartograf/data/1733234400/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Downloaded RPKI Data, hash sum: 4ed7860d4fe5aa6abf675f1a4db2838d58d0185fa494d3f021d677550b92b348
...finished in 0:16:44.571038

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 804bb3326f73b738c1b4647d0220225a22753bfc0a0a7098c428cef1154ee462
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 1177cfc11975f9b18cb73780e9a0ce0ff9ff3ed66e7b0e2d3242a941c7c55dba
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: d26382d56ee132154790a0bdc78f24617fa8cd6abdeccc7d45b0ab8fd81a7db9
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: 16586171264b9aef5b6e080326e03ad6783c9e2d1bb4703f84240452113d7e3a
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 233ccfdee718642236d9cac32e9ce5dd6cb66d01483f8d16b5d4cb8eb2a59cd0
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: 98207add80aede9d9b438ee6f1ea8b3112a129062e7d9217daca4298895e6642
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: e111ad979eca9f5fd71a5256cbf570072a5b06212c4aac8b76ff6af52c4c2e86
...finished in 0:01:04.961981 14:49:01 [42/212]

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2024/12/routeviews-rv2-20241201-1200.pfx2as.gz
Downloaded /home/base/code/asmap/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: da457126fca9645940a1aa3aeca423ad7c1e68352d1bd511fee61fb8e453e0e0
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2024/12/routeviews-rv6-20241202-1200.pfx2as.gz
Downloaded /home/base/code/asmap/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 21652943f2bf103ef0d9f4dfc46ef7e49439dc1f7230bf709a5cb05d4337f46d
...finished in 0:00:08.036130

--- Validating RPKI ---

Validating RPKI ROAs
270014 raw RKPI ROA files found.
100%|██████████████████████████████████████████████| 270014/270014 [28:32<00:00, 157.67it/s]
270014 RKPI ROAs validated and saved to /home/base/code/asmap/kartograf/out/1733234400/rpki/rpki_raw.json, file hash: 1766bd77916ff8263ad89fa962dfbc5f0613100f0886af7e761e3ea6d05ca6ea
...finished in 0:28:57.343738

--- Parsing RPKI ---

Parsing 270014 ROAs
Result entries written: 557758
Duplicates found: 72993
Invalids found: 1892
Incompletes: 0
Non-ROA files: 0
...finished in 0:01:46.466658

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /home/base/code/asmap/kartograf/out/1733234400/irr/afrinic.db
Parsing /home/base/code/asmap/kartograf/out/1733234400/irr/arin.db
Parsing /home/base/code/asmap/kartograf/out/1733234400/irr/ripe.db.route6
Parsing /home/base/code/asmap/kartograf/out/1733234400/irr/apnic.db.route6
Parsing /home/base/code/asmap/kartograf/out/1733234400/irr/lacnic.db
Parsing /home/base/code/asmap/kartograf/out/1733234400/irr/ripe.db.route
Parsing /home/base/code/asmap/kartograf/out/1733234400/irr/apnic.db.route
Found valid, unique entries: 1820027
...finished in 0:06:58.937351
--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file:

Finished merging extra prefixes.
Finished filtering! Originally 1820027 entries filtered down to 377343
Merging base file with filtered extra file
...finished in 0:07:28.093973

--- Parsing Routeviews pfx2as ---

Unzipping /home/base/code/asmap/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /home/base/code/asmap/kartograf/out/1733234400/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /home/base/code/asmap/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /home/base/code/asmap/kartograf/out/1733234400/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /home/base/code/asmap/kartograf/out/1733234400/collectors/pfx2asn.txt
...finished in 0:03:23.996033

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file:

Finished merging extra prefixes.
Finished filtering! Originally 1246046 entries filtered down to 388172
Merging base file with filtered extra file
...finished in 0:07:08.038607

--- Sorting results ---

...finished in 0:00:19.173228

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: af69975d8325db35d43c4b91883893e78c1d9c562c774439c474215d501c0e2b
Total runtime: 1:14:01.635536

(Suspiciously short runtime)

Glad the performance is looking better ;) Could you share your CPU count / memory machine specs?

I'm running with 16GB memory and 16 logical cores .

@fjahr
Copy link
Collaborator

fjahr commented Dec 3, 2024 •
edited
Loading

I got a match too: af69975d8325db35d43c4b91883893e78c1d9c562c774439c474215d501c0e2b

Logs 
$ ./run map -w=1733234400 -irr -rv

--- Start Kartograf ---

Kartograf version: 0.4.8
Using rpki-client version 9.3 (recommended).
Coordinated launch mode: Waiting until 1733234400 (2024-12-03 15:00:00 CET) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1733234400 (2024-12-03 14:00:00 UTC, local: 2024-12-03 15:00:00 CET)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /Users/FJ/projects/python/kartograf/data/1733234400/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /Users/FJ/projects/python/kartograf/data/1733234400/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /Users/FJ/projects/python/kartograf/data/1733234400/rpki/tals/arin.tal, file hash: 4f6c1e456fe5ab468beac1495e57d99a1eeeaa4d9f9e34519eaf58857c21af48
Downloaded TAL for LACNIC to /Users/FJ/projects/python/kartograf/data/1733234400/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /Users/FJ/projects/python/kartograf/data/1733234400/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Downloaded RPKI Data, hash sum: 1b21d261c811baeeff0ebca9fe419c4e6593e17ac558990e10e21f970b465c6b
...finished in 0:18:38.864034

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 804bb3326f73b738c1b4647d0220225a22753bfc0a0a7098c428cef1154ee462
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 1177cfc11975f9b18cb73780e9a0ce0ff9ff3ed66e7b0e2d3242a941c7c55dba
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: d26382d56ee132154790a0bdc78f24617fa8cd6abdeccc7d45b0ab8fd81a7db9
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: 16586171264b9aef5b6e080326e03ad6783c9e2d1bb4703f84240452113d7e3a
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 233ccfdee718642236d9cac32e9ce5dd6cb66d01483f8d16b5d4cb8eb2a59cd0
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: 98207add80aede9d9b438ee6f1ea8b3112a129062e7d9217daca4298895e6642
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: e111ad979eca9f5fd71a5256cbf570072a5b06212c4aac8b76ff6af52c4c2e86
...finished in 0:01:10.007556

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2024/12/routeviews-rv2-20241201-1200.pfx2as.gz
Downloaded /Users/FJ/projects/python/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: da457126fca9645940a1aa3aeca423ad7c1e68352d1bd511fee61fb8e453e0e0
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2024/12/routeviews-rv6-20241202-1200.pfx2as.gz
Downloaded /Users/FJ/projects/python/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 21652943f2bf103ef0d9f4dfc46ef7e49439dc1f7230bf709a5cb05d4337f46d
...finished in 0:00:07.364463

--- Validating RPKI ---

Validating RPKI ROAs
270014 raw RKPI ROA files found.
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 270014/270014 [44:25<00:00, 101.30it/s]
270014 RKPI ROAs validated and saved to /Users/FJ/projects/python/kartograf/out/1733234400/rpki/rpki_raw.json, file hash: cba7ad5442f8b171584e4365433be8a9376c174a08860e15b457c19eef88d125
...finished in 0:44:43.777997

--- Parsing RPKI ---

Parsing 270014 ROAs
Result entries written: 557758
Duplicates found: 72993
Invalids found: 1892
Incompletes: 0
Non-ROA files: 0
...finished in 0:01:05.898469

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /Users/FJ/projects/python/kartograf/out/1733234400/irr/lacnic.db
Parsing /Users/FJ/projects/python/kartograf/out/1733234400/irr/ripe.db.route
Parsing /Users/FJ/projects/python/kartograf/out/1733234400/irr/apnic.db.route6
Parsing /Users/FJ/projects/python/kartograf/out/1733234400/irr/apnic.db.route
Parsing /Users/FJ/projects/python/kartograf/out/1733234400/irr/arin.db
Parsing /Users/FJ/projects/python/kartograf/out/1733234400/irr/afrinic.db
Parsing /Users/FJ/projects/python/kartograf/out/1733234400/irr/ripe.db.route6
Found valid, unique entries: 1820027
...finished in 0:03:58.496450

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file:

Finished merging extra prefixes.
Finished filtering! Originally 1820027 entries filtered down to 377343
Merging base file with filtered extra file
...finished in 0:04:29.725629

--- Parsing Routeviews pfx2as ---

Unzipping /Users/FJ/projects/python/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /Users/FJ/projects/python/kartograf/out/1733234400/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /Users/FJ/projects/python/kartograf/data/1733234400/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /Users/FJ/projects/python/kartograf/out/1733234400/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /Users/FJ/projects/python/kartograf/out/1733234400/collectors/pfx2asn.txt
...finished in 0:02:05.070416

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file:

Finished merging extra prefixes.
Finished filtering! Originally 1246046 entries filtered down to 388172
Merging base file with filtered extra file
...finished in 0:04:55.519012

--- Sorting results ---

...finished in 0:00:12.596781

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: af69975d8325db35d43c4b91883893e78c1d9c562c774439c474215d501c0e2b
Total runtime: 1:21:29.711534

@0xB10C
Copy link

0xB10C commented Dec 3, 2024 

The SHA-256 hash of the result file is: af69975d8325db35d43c4b91883893e78c1d9c562c774439c474215d501c0e2b
Total runtime: 1:03:57.180829

@jurraca
Copy link
Contributor Author

jurraca commented Dec 3, 2024

Awesome 4/4 so far. thank you for participating. I'm also running it on a slower machine so i'll add that when it's done.

@jurraca
Copy link
Contributor Author

jurraca commented Dec 3, 2024

another match

The SHA-256 hash of the result file is: af69975d8325db35d43c4b91883893e78c1d9c562c774439c474215d501c0e2b
Total runtime: 2:16:02.870161

@jurraca jurraca mentioned this issue Dec 3, 2024
Merged
@jurraca
Copy link
Contributor Author

jurraca commented Dec 3, 2024

Opened the issue to validate the file update here.

@jurraca jurraca closed this as completed Dec 3, 2024
@fjahr
Copy link
Collaborator

fjahr commented Dec 3, 2024

@jurraca I would suggest to keep these issues open for ~24 hours so people have a bit more time to post their results. Even if there are all matches now it would still be good to see if there were more participants and maybe they don't post a response if they see the issue is already closed.

@jurraca jurraca reopened this Dec 4, 2024
@fjahr
Copy link
Collaborator

fjahr commented Dec 7, 2024

Here is the result file for anyone who needs it:
1733234400_final_result.txt.zip

@fjahr fjahr closed this as completed Dec 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@fjahr @dunxen @jurraca @0xB10C