Incorrect annotations

[ggdhines-zz]

Was talking with Cam earlier today about this and he said this was a known issue but I'm not sure if this is the same issue or different from what Caitlin reported. Anyways, as of the 24th there are just over 2000 classifications which have messed up annotations attributes when I looked at them in MongoDB. I have some examples below - they either have an empty key for "animals present" or have a bunch of penguins markings instead of "yes", "no" or "cant_tell". They all seem to be happening with Mozilla 5.0. As of the 24th we are still getting new classifications with this problem.

Greg
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 00:12:32 GMT', u'started_at': u'Wed, 24 Sep 2014 00:12:17 GMT'}, {u'user_agent': u'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 00:17:14 GMT', u'started_at': u'Wed, 24 Sep 2014 00:17:10 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 00:40:31 GMT', u'started_at': u'Wed, 24 Sep 2014 00:39:54 GMT'}, {u'user_agent': u'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.122 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 00:45:07 GMT', u'started_at': u'Wed, 24 Sep 2014 00:44:37 GMT'}, {u'user_agent': u'Mozilla/5.0 (X11; Linux i686; rv:31.0) Gecko/20100101 Firefox/31.0'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 01:02:10 GMT', u'started_at': u'Wed, 24 Sep 2014 01:01:52 GMT'}, {u'user_agent': u'Mozilla/5.0 (X11; Linux i686; rv:31.0) Gecko/20100101 Firefox/31.0'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 01:22:51 GMT', u'started_at': u'Wed, 24 Sep 2014 01:22:48 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 01:49:39 GMT', u'started_at': u'Wed, 24 Sep 2014 01:49:36 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.11 (KHTML, like Gecko) Chrome/23.0.1271.95 Safari/537.11'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 01:51:46 GMT', u'started_at': u'Wed, 24 Sep 2014 01:51:42 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 01:52:39 GMT', u'started_at': u'Wed, 24 Sep 2014 01:45:15 GMT'}, {u'user_agent': u'Mozilla/5.0 (Linux; Android 4.2.2; S510 Build/JDQ39) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.117 Mobile Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 01:53:13 GMT', u'started_at': u'Wed, 24 Sep 2014 01:51:14 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; OfficeLiveConnector.1.5; OfficeLivePatch.1.3; rv:11.0) like Gecko'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 01:56:42 GMT', u'started_at': u'Wed, 24 Sep 2014 01:56:36 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 02:34:00 GMT', u'started_at': u'Wed, 24 Sep 2014 02:33:56 GMT'}, {u'user_agent': u'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.125 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 02:38:43 GMT', u'started_at': u'Wed, 24 Sep 2014 02:38:38 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:32.0) Gecko/20100101 Firefox/32.0'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 02:40:25 GMT', u'started_at': u'Wed, 24 Sep 2014 02:40:19 GMT'}, {u'user_agent': u'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_5) AppleWebKit/537.78.2 (KHTML, like Gecko) Version/6.1.6 Safari/537.78.2'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 02:43:34 GMT', u'started_at': u'Wed, 24 Sep 2014 02:42:08 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 02:45:07 GMT', u'started_at': u'Wed, 24 Sep 2014 02:44:46 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:32.0) Gecko/20100101 Firefox/32.0'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 03:03:22 GMT', u'started_at': u'Wed, 24 Sep 2014 03:03:09 GMT'}, {u'user_agent': u'Mozilla/5.0 (iPad; CPU OS 7_1_2 like Mac OS X) AppleWebKit/537.51.2 (KHTML, like Gecko) Version/7.0 Mobile/11D257 Safari/9537.53'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 03:04:23 GMT', u'started_at': u'Wed, 24 Sep 2014 03:04:13 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 03:04:43 GMT', u'started_at': u'Wed, 24 Sep 2014 03:04:36 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 03:13:36 GMT', u'started_at': u'Wed, 24 Sep 2014 03:13:31 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 03:43:11 GMT', u'started_at': u'Wed, 24 Sep 2014 03:43:03 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 03:44:13 GMT', u'started_at': u'Wed, 24 Sep 2014 03:41:25 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 03:59:29 GMT', u'started_at': u'Wed, 24 Sep 2014 03:59:24 GMT'}, {u'user_agent': u'Mozilla/5.0 (iPad; CPU OS 7_0_6 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11B651 Safari/9537.53'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 04:00:02 GMT', u'started_at': u'Wed, 24 Sep 2014 03:59:59 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 04:01:20 GMT', u'started_at': u'Wed, 24 Sep 2014 04:01:15 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 04:30:33 GMT', u'started_at': u'Wed, 24 Sep 2014 04:30:22 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 04:37:30 GMT', u'started_at': u'Wed, 24 Sep 2014 04:37:25 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 04:50:23 GMT', u'started_at': u'Wed, 24 Sep 2014 04:50:18 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {u'workflow': u'untitled_workflow'}]
[{u'value': u'', u'key': u'animalsPresent'}, {u'finished_at': u'Wed, 24 Sep 2014 04:57:23 GMT', u'started_at': u'Wed, 24 Sep 2014 04:57:19 GMT'}, {u'user_agent': u'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36'}, {