2017-05-09 ~ What's New & What's Broken

[theo-armour]

@prediqtiv/peeps

URLs from company names: Woot! Woot!

Tracking down the URLs for the 500 constituents of the SP500 is kind of doable as a one off project. But when you consider keeping the data up to date given the changes in the SP500 and adding symbols from all over the world etc, a manual effort is untenable.

Enter Clearbit

• Company Autocomplete is a free API that lets you auto-complete company names and retrieve logo and domain information.

With a bit of luck we might have a demo working this week. Once it's going, this should help with gathering data from multiple third party web sources.

Get Tick Data

The Google Apps Script to gather SP500 tick data is currently broken and we went over the daily rate limit. Fingers crossed things are fixed by tomorrow

Update: It looks like some data did get uploaded - but it may be data identical to the day before's data.

LinkedIn Data

We have tried very hard to access LinkedIn data by crawling their HTML pages. Unfortunately LinkedIn have erected all the common methods for disabling crawling. The good news is that the LinkedIn API is quite open and accessible. We hope to add new jobs data to the symbols and whatever in the near future. The effort to gather the 500 LinkedIn resources should be made easier with the data gathered from Clearbit.