Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: update csv dataset with script rerun #5

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

fix: update csv dataset with script rerun #5

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
e91c787
fix: remove `name = name.replace`
wayne-shih Feb 16, 2020
62f5880
fix: update dataset [2020, Feb]
wayne-shih Feb 16, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion nzbirdsonline_index.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -70,6 +70,7 @@ Moseley's rockhopper penguin,Sphenisciformes,Spheniscidae,Eudyptes moseleyi,Vagr
Fiordland crested penguin,Sphenisciformes,Spheniscidae,Eudyptes pachyrhynchus,Nationally Vulnerable,Endemic,http://nzbirdsonline.org.nz/species/fiordland-crested-penguin
Snares crested penguin,Sphenisciformes,Spheniscidae,Eudyptes robustus,Naturally Uncommon,Endemic,http://nzbirdsonline.org.nz/species/snares-crested-penguin
Erect-crested penguin,Sphenisciformes,Spheniscidae,Eudyptes sclateri,Declining,Endemic,http://nzbirdsonline.org.nz/species/erect-crested-penguin
Chatham Island crested penguin,Sphenisciformes,Spheniscidae,Eudyptes warhami,Extinct,Endemic,http://nzbirdsonline.org.nz/species/chatham-island-crested-penguin
Macaroni penguin,Sphenisciformes,Spheniscidae,Eudyptes chrysolophus,Vagrant,Native,http://nzbirdsonline.org.nz/species/macaroni-penguin
Royal penguin,Sphenisciformes,Spheniscidae,Eudyptes schlegeli,Vagrant,Native,http://nzbirdsonline.org.nz/species/royal-penguin
Yellow-eyed penguin,Sphenisciformes,Spheniscidae,Megadyptes antipodes,Nationally Endangered,Endemic,http://nzbirdsonline.org.nz/species/yellow-eyed-penguin
Expand Down Expand Up @@ -118,6 +119,7 @@ Cook's petrel,Procellariiformes,Procellariidae,Pterodroma cookii,Relict,Endemic,
Stejneger's petrel,Procellariiformes,Procellariidae,Pterodroma longirostris,Vagrant,Native,http://nzbirdsonline.org.nz/species/stejnegers-petrel
Pycroft's petrel,Procellariiformes,Procellariidae,Pterodroma pycrofti,Recovering,Endemic,http://nzbirdsonline.org.nz/species/pycrofts-petrel
Gould's petrel,Procellariiformes,Procellariidae,Pterodroma leucoptera,Migrant,Native,http://nzbirdsonline.org.nz/species/goulds-petrel
Collared petrel,Procellariiformes,Procellariidae,Pterodroma brevipes,Vagrant,Native,http://nzbirdsonline.org.nz/species/collared-petrel
Blue petrel,Procellariiformes,Procellariidae,Halobaena caerulea,Migrant,Native,http://nzbirdsonline.org.nz/species/blue-petrel
Broad-billed prion,Procellariiformes,Procellariidae,Pachyptila vittata,Relict,Native,http://nzbirdsonline.org.nz/species/broad-billed-prion
Salvin's prion,Procellariiformes,Procellariidae,Pachyptila salvini,Migrant,Native,http://nzbirdsonline.org.nz/species/salvins-prion
Expand Down Expand Up @@ -443,21 +445,23 @@ Waitaki penguin,Sphenisciformes,Spheniscidae,Kairuku waitaki,Extinct,Endemic,htt
Grebneff's penguin,Sphenisciformes,Spheniscidae,Kairuku grebneffi,Extinct,Endemic,http://nzbirdsonline.org.nz/species/grebneffs-penguin
Mannering's penguin,Sphenisciformes,Spheniscidae,Waimanu manneringi,Extinct,Endemic,http://nzbirdsonline.org.nz/species/mannerings-penguin
Waipara penguin,Sphenisciformes,Spheniscidae,Waimanu tuatahi,Extinct,Endemic,http://nzbirdsonline.org.nz/species/waipara-penguin
Bice's penguin,Sphenisciformes,Spheniscidae,Kuminanu biceae,Extinct,Endemic,http://nzbirdsonline.org.nz/species/bices-penguin
Huxley's penguin,Sphenisciformes,Spheniscidae,Palaeeudyptes antarcticus,Extinct,Endemic,http://nzbirdsonline.org.nz/species/huxleys-penguin
Marples' penguin,Sphenisciformes,Spheniscidae,Palaeeudyptes marplesi,Extinct,Endemic,http://nzbirdsonline.org.nz/species/marples-penguin
New Zealand giant penguin,Sphenisciformes,Spheniscidae,Pachydyptes ponderosus,Extinct,Endemic,http://nzbirdsonline.org.nz/species/new-zealand-giant-penguin
Simpson's penguin,Sphenisciformes,Spheniscidae,Platydyptes marplesi,Extinct,Endemic,http://nzbirdsonline.org.nz/species/simpsons-penguin
Wide-flippered penguin,Sphenisciformes,Spheniscidae,Platydyptes novaezealandiae,Extinct,Endemic,http://nzbirdsonline.org.nz/species/wide-flippered-penguin
Amies' penguin,Sphenisciformes,Spheniscidae,Platydyptes amiesi,Extinct,Endemic,http://nzbirdsonline.org.nz/species/amies-penguin
Lowe's penguin,Sphenisciformes,Spheniscidae,Archaeospheniscus lowei,Extinct,Endemic,http://nzbirdsonline.org.nz/species/lowes-penguin
Lopdells' penguin,Sphenisciformes,Spheniscidae,Archaeospheniscus lopdellorum,Extinct,Endemic,http://nzbirdsonline.org.nz/species/lopdells-penguin
Duntroon penguin,Sphenisciformes,Spheniscidae,Duntroonornis parvus,Extinct,Endemic,http://nzbirdsonline.org.nz/species/duntroon-penguin
Lopdells' penguin,Sphenisciformes,Spheniscidae,Archaeospheniscus lopdellorum,Extinct,Endemic,http://nzbirdsonline.org.nz/species/lopdells-penguin
Oliver's penguin,Sphenisciformes,Spheniscidae,Korora oliveri,Extinct,Endemic,http://nzbirdsonline.org.nz/species/olivers-penguin
Harris' penguin,Sphenisciformes,Spheniscidae,Marplesornis novaezealandiae,Extinct,Endemic,http://nzbirdsonline.org.nz/species/harris-penguin
Ridgen's penguin,Sphenisciformes,Spheniscidae,Aptenodytes ridgeni,Extinct,Endemic,http://nzbirdsonline.org.nz/species/ridgens-penguin
Tyree's penguin,Sphenisciformes,Spheniscidae,Pygoscelis tyreei,Extinct,Endemic,http://nzbirdsonline.org.nz/species/tyrees-penguin
Moisley's penguin,Sphenisciformes,Spheniscidae,Tereingaornis moisleyi,Extinct,Endemic,http://nzbirdsonline.org.nz/species/moisleys-penguin
Love's Paleocene seabird,Unknown,Incertae sedis,Australornis lovei,Extinct,Endemic,http://nzbirdsonline.org.nz/species/loves-paleocene-seabird
Alastair's albatross,Procellariiformes,Diomedeidae,Aldiomedes angustirostris,Extinct,Endemic,http://nzbirdsonline.org.nz/species/alastairs-albatross
Miocene diving petrel,Procellariiformes,Pelecanoididae,Pelecanoides miokuaka,Extinct,Endemic,http://nzbirdsonline.org.nz/species/miocene-diving-petrel
Miocene false-toothed pelican,Pelecaniformes,Pelagornithidae,Pelagornis miocaenus,Extinct,Native,http://nzbirdsonline.org.nz/species/miocene-false-toothed-pelican
Stirton's false-toothed pelican,Pelecaniformes,Pelagornithidae,Neodontornis stirtoni,Extinct,Endemic,http://nzbirdsonline.org.nz/species/stirtons-false-toothed-pelican
Expand Down
1 change: 0 additions & 1 deletion nzbirdsonline_index.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -90,7 +90,6 @@ def parse_result_page(self, page, soup):
# extract data from the results page
name = HTMLParser().unescape(result.find('h3', 'search-result-title').find('a')\
.contents[0]).encode('ascii', 'replace')
name = name.replace("Stirton?s", "Stirton's") # TODO - make more robust
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this line doesn't seem necessary now...


url = self.base_url + result.find('h3', 'search-result-title').find('a')\
.attrs[0][1].encode('ascii', 'replace')
Expand Down