-
Notifications
You must be signed in to change notification settings - Fork 1
/
ace2005.out
1821 lines (1821 loc) · 155 KB
/
ace2005.out
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
discarding /home/sp1184/anaconda3/bin from PATH
prepending /home/sp1184/anaconda3/envs/py36/bin to PATH
2019-10-12 00:35:04,872 Reading data from data/autoslim/ace2005
2019-10-12 00:35:04,873 Train: data/autoslim/ace2005/ace2005.train
2019-10-12 00:35:04,873 Dev: data/autoslim/ace2005/ace2005.dev
2019-10-12 00:35:04,873 Test: data/autoslim/ace2005/ace2005.test
Corpus: 7214 train + 954 dev + 1054 test sentences
[b'<unk>', b'O', b'S-GPE', b'S-ORG', b'S-FAC', b'S-PER', b'S-LOC', b'S-WEA', b'S-VEH', b'<START>', b'<STOP>']
2019-10-12 00:35:18,195 ----------------------------------------------------------------------------------------------------
2019-10-12 00:35:18,196 Model: "SequenceTagger(
(embeddings): StackedEmbeddings(
(list_embedding_0): WordEmbeddings('glove')
(list_embedding_1): FlairEmbeddings(
(lm): LanguageModel(
(drop): Dropout(p=0.05, inplace=False)
(encoder): Embedding(300, 100)
(rnn): LSTM(100, 2048)
(decoder): Linear(in_features=2048, out_features=300, bias=True)
)
)
(list_embedding_2): FlairEmbeddings(
(lm): LanguageModel(
(drop): Dropout(p=0.05, inplace=False)
(encoder): Embedding(300, 100)
(rnn): LSTM(100, 2048)
(decoder): Linear(in_features=2048, out_features=300, bias=True)
)
)
)
(word_dropout): WordDropout(p=0.05)
(locked_dropout): LockedDropout(p=0.5)
(embedding2nn): Linear(in_features=4196, out_features=4196, bias=True)
(rnn): LSTM(4196, 256, bidirectional=True)
(linear): Linear(in_features=512, out_features=11, bias=True)
)"
2019-10-12 00:35:18,196 ----------------------------------------------------------------------------------------------------
2019-10-12 00:35:18,196 Corpus: "Corpus: 7214 train + 954 dev + 1054 test sentences"
2019-10-12 00:35:18,196 ----------------------------------------------------------------------------------------------------
2019-10-12 00:35:18,196 Parameters:
2019-10-12 00:35:18,196 - learning_rate: "0.1"
2019-10-12 00:35:18,196 - mini_batch_size: "32"
2019-10-12 00:35:18,196 - patience: "5"
2019-10-12 00:35:18,196 - anneal_factor: "0.5"
2019-10-12 00:35:18,196 - max_epochs: "300"
2019-10-12 00:35:18,196 - shuffle: "True"
2019-10-12 00:35:18,197 - train_with_dev: "False"
2019-10-12 00:35:18,197 ----------------------------------------------------------------------------------------------------
2019-10-12 00:35:18,197 Model training base path: "results/ace2005"
2019-10-12 00:35:18,197 ----------------------------------------------------------------------------------------------------
2019-10-12 00:35:18,197 Device: cuda:0
2019-10-12 00:35:18,197 ----------------------------------------------------------------------------------------------------
2019-10-12 00:35:18,197 Embeddings storage mode: gpu
2019-10-12 00:35:18,205 ----------------------------------------------------------------------------------------------------
2019-10-12 00:35:19,787 epoch 1 - iter 0/226 - loss 49.04561615 - samples/sec: 445.49
2019-10-12 00:35:43,005 epoch 1 - iter 22/226 - loss 17.56425489 - samples/sec: 31.38
2019-10-12 00:36:06,634 epoch 1 - iter 44/226 - loss 15.13681497 - samples/sec: 30.85
2019-10-12 00:36:32,583 epoch 1 - iter 66/226 - loss 13.41144138 - samples/sec: 28.02
2019-10-12 00:36:56,209 epoch 1 - iter 88/226 - loss 12.23461388 - samples/sec: 30.81
2019-10-12 00:37:18,879 epoch 1 - iter 110/226 - loss 11.23343993 - samples/sec: 32.13
2019-10-12 00:37:44,895 epoch 1 - iter 132/226 - loss 10.50783293 - samples/sec: 27.86
2019-10-12 00:38:09,052 epoch 1 - iter 154/226 - loss 9.91104902 - samples/sec: 30.10
2019-10-12 00:38:33,777 epoch 1 - iter 176/226 - loss 9.46010864 - samples/sec: 29.45
2019-10-12 00:38:57,246 epoch 1 - iter 198/226 - loss 9.07602521 - samples/sec: 31.06
2019-10-12 00:39:20,415 epoch 1 - iter 220/226 - loss 8.76470975 - samples/sec: 31.43
2019-10-12 00:39:25,565 ----------------------------------------------------------------------------------------------------
2019-10-12 00:39:25,565 EPOCH 1 done: loss 8.6747 - lr 0.1000
2019-10-12 00:40:00,105 DEV : loss 4.029515743255615 - score 0.7491
2019-10-12 00:40:00,115 BAD EPOCHS (no improvement): 0
2019-10-12 00:40:07,930 ----------------------------------------------------------------------------------------------------
2019-10-12 00:40:08,269 epoch 2 - iter 0/226 - loss 5.02615356 - samples/sec: 2088.65
2019-10-12 00:40:15,648 epoch 2 - iter 22/226 - loss 5.61528074 - samples/sec: 106.89
2019-10-12 00:40:22,527 epoch 2 - iter 44/226 - loss 5.64774128 - samples/sec: 115.98
2019-10-12 00:40:29,561 epoch 2 - iter 66/226 - loss 5.63954665 - samples/sec: 112.21
2019-10-12 00:40:37,936 epoch 2 - iter 88/226 - loss 5.50962907 - samples/sec: 118.42
2019-10-12 00:40:44,663 epoch 2 - iter 110/226 - loss 5.42705407 - samples/sec: 118.23
2019-10-12 00:40:51,199 epoch 2 - iter 132/226 - loss 5.33254311 - samples/sec: 121.94
2019-10-12 00:40:58,024 epoch 2 - iter 154/226 - loss 5.29290070 - samples/sec: 116.57
2019-10-12 00:41:04,899 epoch 2 - iter 176/226 - loss 5.19297208 - samples/sec: 115.29
2019-10-12 00:41:11,785 epoch 2 - iter 198/226 - loss 5.20541016 - samples/sec: 114.85
2019-10-12 00:41:18,798 epoch 2 - iter 220/226 - loss 5.14895140 - samples/sec: 113.91
2019-10-12 00:41:20,767 ----------------------------------------------------------------------------------------------------
2019-10-12 00:41:20,767 EPOCH 2 done: loss 5.1421 - lr 0.1000
2019-10-12 00:41:31,465 DEV : loss 3.419296979904175 - score 0.7622
2019-10-12 00:41:31,474 BAD EPOCHS (no improvement): 0
2019-10-12 00:41:39,213 ----------------------------------------------------------------------------------------------------
2019-10-12 00:41:39,446 epoch 3 - iter 0/226 - loss 4.60615587 - samples/sec: 3038.71
2019-10-12 00:41:46,064 epoch 3 - iter 22/226 - loss 4.58392655 - samples/sec: 120.96
2019-10-12 00:41:52,969 epoch 3 - iter 44/226 - loss 4.55656638 - samples/sec: 115.50
2019-10-12 00:41:59,420 epoch 3 - iter 66/226 - loss 4.58709956 - samples/sec: 123.94
2019-10-12 00:42:06,526 epoch 3 - iter 88/226 - loss 4.68034438 - samples/sec: 114.24
2019-10-12 00:42:13,431 epoch 3 - iter 110/226 - loss 4.67004709 - samples/sec: 117.08
2019-10-12 00:42:20,779 epoch 3 - iter 132/226 - loss 4.63715092 - samples/sec: 106.83
2019-10-12 00:42:27,521 epoch 3 - iter 154/226 - loss 4.59013250 - samples/sec: 117.79
2019-10-12 00:42:33,994 epoch 3 - iter 176/226 - loss 4.53493079 - samples/sec: 123.40
2019-10-12 00:42:43,381 epoch 3 - iter 198/226 - loss 4.52201351 - samples/sec: 106.58
2019-10-12 00:42:50,025 epoch 3 - iter 220/226 - loss 4.52247434 - samples/sec: 119.38
2019-10-12 00:42:52,108 ----------------------------------------------------------------------------------------------------
2019-10-12 00:42:52,108 EPOCH 3 done: loss 4.5134 - lr 0.1000
2019-10-12 00:43:02,804 DEV : loss 3.240468740463257 - score 0.7907
2019-10-12 00:43:02,815 BAD EPOCHS (no improvement): 0
2019-10-12 00:43:10,495 ----------------------------------------------------------------------------------------------------
2019-10-12 00:43:10,792 epoch 4 - iter 0/226 - loss 3.91882420 - samples/sec: 2380.86
2019-10-12 00:43:17,932 epoch 4 - iter 22/226 - loss 4.42204088 - samples/sec: 113.29
2019-10-12 00:43:24,669 epoch 4 - iter 44/226 - loss 4.33164624 - samples/sec: 119.29
2019-10-12 00:43:31,778 epoch 4 - iter 66/226 - loss 4.29842261 - samples/sec: 112.54
2019-10-12 00:43:38,589 epoch 4 - iter 88/226 - loss 4.25835316 - samples/sec: 117.49
2019-10-12 00:43:45,255 epoch 4 - iter 110/226 - loss 4.15777272 - samples/sec: 120.05
2019-10-12 00:43:51,927 epoch 4 - iter 132/226 - loss 4.18477554 - samples/sec: 119.85
2019-10-12 00:43:58,663 epoch 4 - iter 154/226 - loss 4.15462437 - samples/sec: 118.70
2019-10-12 00:44:05,400 epoch 4 - iter 176/226 - loss 4.15131728 - samples/sec: 118.89
2019-10-12 00:44:12,210 epoch 4 - iter 198/226 - loss 4.15918982 - samples/sec: 117.84
2019-10-12 00:44:19,584 epoch 4 - iter 220/226 - loss 4.13612354 - samples/sec: 109.57
2019-10-12 00:44:21,809 ----------------------------------------------------------------------------------------------------
2019-10-12 00:44:21,809 EPOCH 4 done: loss 4.1262 - lr 0.1000
2019-10-12 00:44:32,855 DEV : loss 3.0057919025421143 - score 0.8021
2019-10-12 00:44:32,866 BAD EPOCHS (no improvement): 0
2019-10-12 00:44:42,928 ----------------------------------------------------------------------------------------------------
2019-10-12 00:44:43,233 epoch 5 - iter 0/226 - loss 4.99452972 - samples/sec: 2313.01
2019-10-12 00:44:50,408 epoch 5 - iter 22/226 - loss 4.23235905 - samples/sec: 111.05
2019-10-12 00:44:57,275 epoch 5 - iter 44/226 - loss 3.99038612 - samples/sec: 118.25
2019-10-12 00:45:04,062 epoch 5 - iter 66/226 - loss 3.94220089 - samples/sec: 118.80
2019-10-12 00:45:11,031 epoch 5 - iter 88/226 - loss 3.86093491 - samples/sec: 114.90
2019-10-12 00:45:17,749 epoch 5 - iter 110/226 - loss 3.83223245 - samples/sec: 119.41
2019-10-12 00:45:24,605 epoch 5 - iter 132/226 - loss 3.83447851 - samples/sec: 116.48
2019-10-12 00:45:31,555 epoch 5 - iter 154/226 - loss 3.83655512 - samples/sec: 114.46
2019-10-12 00:45:38,144 epoch 5 - iter 176/226 - loss 3.84262901 - samples/sec: 122.26
2019-10-12 00:45:45,058 epoch 5 - iter 198/226 - loss 3.86112664 - samples/sec: 115.38
2019-10-12 00:45:52,145 epoch 5 - iter 220/226 - loss 3.89248657 - samples/sec: 112.90
2019-10-12 00:45:54,142 ----------------------------------------------------------------------------------------------------
2019-10-12 00:45:54,142 EPOCH 5 done: loss 3.8930 - lr 0.1000
2019-10-12 00:46:04,812 DEV : loss 2.9933974742889404 - score 0.8084
2019-10-12 00:46:04,823 BAD EPOCHS (no improvement): 0
2019-10-12 00:46:13,140 ----------------------------------------------------------------------------------------------------
2019-10-12 00:46:13,401 epoch 6 - iter 0/226 - loss 3.98458815 - samples/sec: 2714.43
2019-10-12 00:46:20,122 epoch 6 - iter 22/226 - loss 3.44635585 - samples/sec: 119.27
2019-10-12 00:46:27,085 epoch 6 - iter 44/226 - loss 3.69254919 - samples/sec: 116.23
2019-10-12 00:46:34,077 epoch 6 - iter 66/226 - loss 3.75188932 - samples/sec: 114.60
2019-10-12 00:46:40,830 epoch 6 - iter 88/226 - loss 3.78264221 - samples/sec: 117.55
2019-10-12 00:46:50,796 epoch 6 - iter 110/226 - loss 3.78109707 - samples/sec: 115.00
2019-10-12 00:46:57,686 epoch 6 - iter 132/226 - loss 3.80862089 - samples/sec: 116.80
2019-10-12 00:47:05,027 epoch 6 - iter 154/226 - loss 3.79332014 - samples/sec: 108.64
2019-10-12 00:47:11,524 epoch 6 - iter 176/226 - loss 3.73047226 - samples/sec: 124.08
2019-10-12 00:47:18,376 epoch 6 - iter 198/226 - loss 3.72464448 - samples/sec: 118.71
2019-10-12 00:47:25,209 epoch 6 - iter 220/226 - loss 3.73963031 - samples/sec: 117.22
2019-10-12 00:47:27,264 ----------------------------------------------------------------------------------------------------
2019-10-12 00:47:27,265 EPOCH 6 done: loss 3.7242 - lr 0.1000
2019-10-12 00:47:38,452 DEV : loss 2.835984468460083 - score 0.8003
2019-10-12 00:47:38,462 BAD EPOCHS (no improvement): 1
2019-10-12 00:47:38,468 ----------------------------------------------------------------------------------------------------
2019-10-12 00:47:38,954 epoch 7 - iter 0/226 - loss 3.13788486 - samples/sec: 1449.83
2019-10-12 00:47:46,291 epoch 7 - iter 22/226 - loss 3.83942534 - samples/sec: 106.68
2019-10-12 00:47:52,924 epoch 7 - iter 44/226 - loss 3.69816787 - samples/sec: 119.55
2019-10-12 00:47:59,521 epoch 7 - iter 66/226 - loss 3.57671938 - samples/sec: 120.30
2019-10-12 00:48:06,342 epoch 7 - iter 88/226 - loss 3.60758728 - samples/sec: 116.15
2019-10-12 00:48:12,572 epoch 7 - iter 110/226 - loss 3.58240756 - samples/sec: 128.03
2019-10-12 00:48:19,407 epoch 7 - iter 132/226 - loss 3.60441335 - samples/sec: 116.06
2019-10-12 00:48:26,257 epoch 7 - iter 154/226 - loss 3.59777912 - samples/sec: 115.56
2019-10-12 00:48:33,321 epoch 7 - iter 176/226 - loss 3.55587996 - samples/sec: 112.75
2019-10-12 00:48:40,317 epoch 7 - iter 198/226 - loss 3.57063090 - samples/sec: 112.98
2019-10-12 00:48:49,733 epoch 7 - iter 220/226 - loss 3.58059935 - samples/sec: 122.06
2019-10-12 00:48:51,840 ----------------------------------------------------------------------------------------------------
2019-10-12 00:48:51,840 EPOCH 7 done: loss 3.5776 - lr 0.1000
2019-10-12 00:49:02,647 DEV : loss 2.6919867992401123 - score 0.8206
2019-10-12 00:49:02,658 BAD EPOCHS (no improvement): 0
2019-10-12 00:49:10,377 ----------------------------------------------------------------------------------------------------
2019-10-12 00:49:10,597 epoch 8 - iter 0/226 - loss 2.68801880 - samples/sec: 3215.44
2019-10-12 00:49:17,447 epoch 8 - iter 22/226 - loss 3.44733261 - samples/sec: 115.30
2019-10-12 00:49:24,309 epoch 8 - iter 44/226 - loss 3.53376217 - samples/sec: 115.97
2019-10-12 00:49:30,858 epoch 8 - iter 66/226 - loss 3.54010834 - samples/sec: 121.59
2019-10-12 00:49:38,025 epoch 8 - iter 88/226 - loss 3.52241575 - samples/sec: 110.16
2019-10-12 00:49:44,875 epoch 8 - iter 110/226 - loss 3.46903388 - samples/sec: 115.18
2019-10-12 00:49:51,757 epoch 8 - iter 132/226 - loss 3.49139245 - samples/sec: 115.20
2019-10-12 00:49:58,435 epoch 8 - iter 154/226 - loss 3.47338350 - samples/sec: 120.00
2019-10-12 00:50:05,189 epoch 8 - iter 176/226 - loss 3.49619171 - samples/sec: 117.31
2019-10-12 00:50:11,705 epoch 8 - iter 198/226 - loss 3.48572957 - samples/sec: 121.39
2019-10-12 00:50:18,276 epoch 8 - iter 220/226 - loss 3.46927056 - samples/sec: 121.54
2019-10-12 00:50:20,155 ----------------------------------------------------------------------------------------------------
2019-10-12 00:50:20,155 EPOCH 8 done: loss 3.4595 - lr 0.1000
2019-10-12 00:50:32,018 DEV : loss 2.6872482299804688 - score 0.8216
2019-10-12 00:50:32,029 BAD EPOCHS (no improvement): 0
2019-10-12 00:50:39,615 ----------------------------------------------------------------------------------------------------
2019-10-12 00:50:39,907 epoch 9 - iter 0/226 - loss 4.20371151 - samples/sec: 2427.20
2019-10-12 00:50:46,914 epoch 9 - iter 22/226 - loss 3.40448184 - samples/sec: 112.06
2019-10-12 00:50:53,870 epoch 9 - iter 44/226 - loss 3.40738442 - samples/sec: 113.64
2019-10-12 00:51:00,121 epoch 9 - iter 66/226 - loss 3.33418549 - samples/sec: 128.00
2019-10-12 00:51:06,871 epoch 9 - iter 88/226 - loss 3.37473534 - samples/sec: 117.19
2019-10-12 00:51:13,733 epoch 9 - iter 110/226 - loss 3.34063857 - samples/sec: 115.09
2019-10-12 00:51:20,534 epoch 9 - iter 132/226 - loss 3.35426289 - samples/sec: 116.12
2019-10-12 00:51:27,221 epoch 9 - iter 154/226 - loss 3.37339067 - samples/sec: 118.23
2019-10-12 00:51:33,766 epoch 9 - iter 176/226 - loss 3.34957359 - samples/sec: 121.21
2019-10-12 00:51:40,552 epoch 9 - iter 198/226 - loss 3.37747193 - samples/sec: 117.91
2019-10-12 00:51:47,314 epoch 9 - iter 220/226 - loss 3.35696631 - samples/sec: 118.00
2019-10-12 00:51:49,217 ----------------------------------------------------------------------------------------------------
2019-10-12 00:51:49,217 EPOCH 9 done: loss 3.3518 - lr 0.1000
2019-10-12 00:52:00,002 DEV : loss 2.648479461669922 - score 0.8188
2019-10-12 00:52:00,014 BAD EPOCHS (no improvement): 1
2019-10-12 00:52:00,019 ----------------------------------------------------------------------------------------------------
2019-10-12 00:52:00,343 epoch 10 - iter 0/226 - loss 3.42629480 - samples/sec: 2180.25
2019-10-12 00:52:07,538 epoch 10 - iter 22/226 - loss 3.40348231 - samples/sec: 110.04
2019-10-12 00:52:14,340 epoch 10 - iter 44/226 - loss 3.31200333 - samples/sec: 116.90
2019-10-12 00:52:20,788 epoch 10 - iter 66/226 - loss 3.28414179 - samples/sec: 124.32
2019-10-12 00:52:27,386 epoch 10 - iter 88/226 - loss 3.26280862 - samples/sec: 123.42
2019-10-12 00:52:34,332 epoch 10 - iter 110/226 - loss 3.27539268 - samples/sec: 117.35
2019-10-12 00:52:41,065 epoch 10 - iter 132/226 - loss 3.27192883 - samples/sec: 118.70
2019-10-12 00:52:48,325 epoch 10 - iter 154/226 - loss 3.28457731 - samples/sec: 118.90
2019-10-12 00:52:55,203 epoch 10 - iter 176/226 - loss 3.28516480 - samples/sec: 116.10
2019-10-12 00:53:01,825 epoch 10 - iter 198/226 - loss 3.27757411 - samples/sec: 120.66
2019-10-12 00:53:08,262 epoch 10 - iter 220/226 - loss 3.27205587 - samples/sec: 125.06
2019-10-12 00:53:11,789 ----------------------------------------------------------------------------------------------------
2019-10-12 00:53:11,790 EPOCH 10 done: loss 3.2742 - lr 0.1000
2019-10-12 00:53:22,187 DEV : loss 2.694042682647705 - score 0.8144
2019-10-12 00:53:22,198 BAD EPOCHS (no improvement): 2
2019-10-12 00:53:22,205 ----------------------------------------------------------------------------------------------------
2019-10-12 00:53:22,472 epoch 11 - iter 0/226 - loss 2.39809847 - samples/sec: 2640.64
2019-10-12 00:53:29,235 epoch 11 - iter 22/226 - loss 3.04862572 - samples/sec: 118.36
2019-10-12 00:53:36,196 epoch 11 - iter 44/226 - loss 3.30647074 - samples/sec: 114.14
2019-10-12 00:53:42,977 epoch 11 - iter 66/226 - loss 3.21809274 - samples/sec: 120.76
2019-10-12 00:53:49,584 epoch 11 - iter 88/226 - loss 3.22430782 - samples/sec: 121.49
2019-10-12 00:53:55,897 epoch 11 - iter 110/226 - loss 3.17645160 - samples/sec: 127.89
2019-10-12 00:54:02,972 epoch 11 - iter 132/226 - loss 3.18705076 - samples/sec: 112.86
2019-10-12 00:54:10,046 epoch 11 - iter 154/226 - loss 3.21099823 - samples/sec: 112.38
2019-10-12 00:54:16,863 epoch 11 - iter 176/226 - loss 3.22075453 - samples/sec: 117.65
2019-10-12 00:54:23,620 epoch 11 - iter 198/226 - loss 3.22147222 - samples/sec: 119.24
2019-10-12 00:54:30,380 epoch 11 - iter 220/226 - loss 3.22657056 - samples/sec: 121.27
2019-10-12 00:54:32,423 ----------------------------------------------------------------------------------------------------
2019-10-12 00:54:32,423 EPOCH 11 done: loss 3.2316 - lr 0.1000
2019-10-12 00:54:43,165 DEV : loss 2.559607744216919 - score 0.8271
2019-10-12 00:54:43,176 BAD EPOCHS (no improvement): 0
2019-10-12 00:54:52,103 ----------------------------------------------------------------------------------------------------
2019-10-12 00:54:52,381 epoch 12 - iter 0/226 - loss 2.47202659 - samples/sec: 2543.98
2019-10-12 00:54:59,695 epoch 12 - iter 22/226 - loss 3.22100505 - samples/sec: 111.11
2019-10-12 00:55:06,447 epoch 12 - iter 44/226 - loss 3.24009155 - samples/sec: 118.91
2019-10-12 00:55:12,987 epoch 12 - iter 66/226 - loss 3.21055772 - samples/sec: 122.68
2019-10-12 00:55:19,748 epoch 12 - iter 88/226 - loss 3.17629605 - samples/sec: 118.03
2019-10-12 00:55:26,486 epoch 12 - iter 110/226 - loss 3.15918313 - samples/sec: 118.90
2019-10-12 00:55:33,390 epoch 12 - iter 132/226 - loss 3.14973162 - samples/sec: 115.79
2019-10-12 00:55:39,817 epoch 12 - iter 154/226 - loss 3.16828377 - samples/sec: 124.92
2019-10-12 00:55:46,702 epoch 12 - iter 176/226 - loss 3.18426082 - samples/sec: 116.11
2019-10-12 00:55:53,540 epoch 12 - iter 198/226 - loss 3.15362474 - samples/sec: 117.57
2019-10-12 00:56:00,101 epoch 12 - iter 220/226 - loss 3.12206372 - samples/sec: 123.21
2019-10-12 00:56:02,157 ----------------------------------------------------------------------------------------------------
2019-10-12 00:56:02,157 EPOCH 12 done: loss 3.1077 - lr 0.1000
2019-10-12 00:56:12,510 DEV : loss 2.5899596214294434 - score 0.8244
2019-10-12 00:56:12,521 BAD EPOCHS (no improvement): 1
2019-10-12 00:56:12,525 ----------------------------------------------------------------------------------------------------
2019-10-12 00:56:12,780 epoch 13 - iter 0/226 - loss 1.46535325 - samples/sec: 2770.23
2019-10-12 00:56:19,652 epoch 13 - iter 22/226 - loss 2.93982396 - samples/sec: 117.27
2019-10-12 00:56:26,434 epoch 13 - iter 44/226 - loss 2.94801587 - samples/sec: 119.10
2019-10-12 00:56:33,026 epoch 13 - iter 66/226 - loss 2.97692911 - samples/sec: 124.90
2019-10-12 00:56:39,842 epoch 13 - iter 88/226 - loss 3.02554712 - samples/sec: 117.63
2019-10-12 00:56:46,642 epoch 13 - iter 110/226 - loss 3.03366399 - samples/sec: 118.11
2019-10-12 00:56:53,431 epoch 13 - iter 132/226 - loss 3.05252094 - samples/sec: 119.85
2019-10-12 00:57:00,314 epoch 13 - iter 154/226 - loss 3.06086846 - samples/sec: 115.97
2019-10-12 00:57:07,132 epoch 13 - iter 176/226 - loss 3.05307079 - samples/sec: 117.66
2019-10-12 00:57:13,894 epoch 13 - iter 198/226 - loss 3.06292232 - samples/sec: 118.63
2019-10-12 00:57:20,371 epoch 13 - iter 220/226 - loss 3.08663152 - samples/sec: 124.51
2019-10-12 00:57:22,408 ----------------------------------------------------------------------------------------------------
2019-10-12 00:57:22,409 EPOCH 13 done: loss 3.0817 - lr 0.1000
2019-10-12 00:57:33,165 DEV : loss 2.5565474033355713 - score 0.8224
2019-10-12 00:57:33,175 BAD EPOCHS (no improvement): 2
2019-10-12 00:57:33,180 ----------------------------------------------------------------------------------------------------
2019-10-12 00:57:33,470 epoch 14 - iter 0/226 - loss 3.53604293 - samples/sec: 2437.35
2019-10-12 00:57:40,879 epoch 14 - iter 22/226 - loss 3.16882982 - samples/sec: 107.60
2019-10-12 00:57:47,388 epoch 14 - iter 44/226 - loss 3.09333948 - samples/sec: 124.68
2019-10-12 00:57:54,313 epoch 14 - iter 66/226 - loss 3.04251856 - samples/sec: 115.69
2019-10-12 00:58:01,091 epoch 14 - iter 88/226 - loss 2.97206716 - samples/sec: 117.52
2019-10-12 00:58:08,236 epoch 14 - iter 110/226 - loss 2.93769658 - samples/sec: 124.29
2019-10-12 00:58:14,782 epoch 14 - iter 132/226 - loss 2.93260654 - samples/sec: 123.00
2019-10-12 00:58:21,454 epoch 14 - iter 154/226 - loss 2.95845715 - samples/sec: 119.75
2019-10-12 00:58:27,939 epoch 14 - iter 176/226 - loss 2.94728464 - samples/sec: 124.14
2019-10-12 00:58:34,637 epoch 14 - iter 198/226 - loss 2.95962488 - samples/sec: 120.13
2019-10-12 00:58:41,473 epoch 14 - iter 220/226 - loss 2.98576549 - samples/sec: 117.84
2019-10-12 00:58:43,662 ----------------------------------------------------------------------------------------------------
2019-10-12 00:58:43,662 EPOCH 14 done: loss 2.9932 - lr 0.1000
2019-10-12 00:58:54,462 DEV : loss 2.6059157848358154 - score 0.8261
2019-10-12 00:58:54,473 BAD EPOCHS (no improvement): 3
2019-10-12 00:58:54,479 ----------------------------------------------------------------------------------------------------
2019-10-12 00:58:54,755 epoch 15 - iter 0/226 - loss 2.22170830 - samples/sec: 2554.68
2019-10-12 00:59:01,921 epoch 15 - iter 22/226 - loss 2.84821962 - samples/sec: 110.60
2019-10-12 00:59:08,840 epoch 15 - iter 44/226 - loss 2.91036415 - samples/sec: 116.69
2019-10-12 00:59:15,363 epoch 15 - iter 66/226 - loss 2.94079289 - samples/sec: 123.17
2019-10-12 00:59:21,965 epoch 15 - iter 88/226 - loss 2.93672896 - samples/sec: 121.76
2019-10-12 00:59:28,422 epoch 15 - iter 110/226 - loss 2.90160830 - samples/sec: 125.36
2019-10-12 00:59:35,294 epoch 15 - iter 132/226 - loss 2.92606959 - samples/sec: 116.33
2019-10-12 00:59:42,271 epoch 15 - iter 154/226 - loss 2.90688283 - samples/sec: 121.45
2019-10-12 00:59:49,089 epoch 15 - iter 176/226 - loss 2.90234175 - samples/sec: 119.22
2019-10-12 00:59:55,976 epoch 15 - iter 198/226 - loss 2.92086913 - samples/sec: 114.66
2019-10-12 01:00:02,749 epoch 15 - iter 220/226 - loss 2.91233791 - samples/sec: 119.60
2019-10-12 01:00:04,847 ----------------------------------------------------------------------------------------------------
2019-10-12 01:00:04,847 EPOCH 15 done: loss 2.9131 - lr 0.1000
2019-10-12 01:00:15,156 DEV : loss 2.4906063079833984 - score 0.8306
2019-10-12 01:00:15,165 BAD EPOCHS (no improvement): 0
2019-10-12 01:00:22,876 ----------------------------------------------------------------------------------------------------
2019-10-12 01:00:23,087 epoch 16 - iter 0/226 - loss 2.06644154 - samples/sec: 3356.87
2019-10-12 01:00:31,029 epoch 16 - iter 22/226 - loss 2.95128233 - samples/sec: 111.43
2019-10-12 01:00:38,697 epoch 16 - iter 44/226 - loss 2.80174561 - samples/sec: 121.43
2019-10-12 01:00:45,379 epoch 16 - iter 66/226 - loss 2.86791118 - samples/sec: 119.43
2019-10-12 01:00:51,952 epoch 16 - iter 88/226 - loss 2.83942215 - samples/sec: 120.94
2019-10-12 01:00:58,743 epoch 16 - iter 110/226 - loss 2.88990356 - samples/sec: 119.99
2019-10-12 01:01:05,702 epoch 16 - iter 132/226 - loss 2.89456252 - samples/sec: 114.90
2019-10-12 01:01:12,328 epoch 16 - iter 154/226 - loss 2.90373368 - samples/sec: 120.71
2019-10-12 01:01:19,236 epoch 16 - iter 176/226 - loss 2.91035071 - samples/sec: 119.98
2019-10-12 01:01:26,300 epoch 16 - iter 198/226 - loss 2.90201584 - samples/sec: 112.31
2019-10-12 01:01:32,857 epoch 16 - iter 220/226 - loss 2.88543121 - samples/sec: 123.46
2019-10-12 01:01:35,078 ----------------------------------------------------------------------------------------------------
2019-10-12 01:01:35,078 EPOCH 16 done: loss 2.8951 - lr 0.1000
2019-10-12 01:01:45,458 DEV : loss 2.5633363723754883 - score 0.8299
2019-10-12 01:01:45,467 BAD EPOCHS (no improvement): 1
2019-10-12 01:01:45,472 ----------------------------------------------------------------------------------------------------
2019-10-12 01:01:45,669 epoch 17 - iter 0/226 - loss 2.01083994 - samples/sec: 3596.65
2019-10-12 01:01:52,597 epoch 17 - iter 22/226 - loss 2.88716465 - samples/sec: 114.47
2019-10-12 01:01:59,361 epoch 17 - iter 44/226 - loss 2.90024223 - samples/sec: 118.95
2019-10-12 01:02:06,485 epoch 17 - iter 66/226 - loss 2.90540253 - samples/sec: 112.76
2019-10-12 01:02:13,056 epoch 17 - iter 88/226 - loss 2.85031149 - samples/sec: 121.43
2019-10-12 01:02:19,752 epoch 17 - iter 110/226 - loss 2.84070295 - samples/sec: 120.04
2019-10-12 01:02:26,302 epoch 17 - iter 132/226 - loss 2.84804220 - samples/sec: 122.48
2019-10-12 01:02:33,224 epoch 17 - iter 154/226 - loss 2.85969067 - samples/sec: 115.00
2019-10-12 01:02:39,651 epoch 17 - iter 176/226 - loss 2.86381194 - samples/sec: 124.59
2019-10-12 01:02:46,297 epoch 17 - iter 198/226 - loss 2.86783553 - samples/sec: 121.44
2019-10-12 01:02:52,857 epoch 17 - iter 220/226 - loss 2.83968159 - samples/sec: 121.88
2019-10-12 01:02:54,870 ----------------------------------------------------------------------------------------------------
2019-10-12 01:02:54,870 EPOCH 17 done: loss 2.8298 - lr 0.1000
2019-10-12 01:03:05,592 DEV : loss 2.4439399242401123 - score 0.8306
2019-10-12 01:03:05,603 BAD EPOCHS (no improvement): 2
2019-10-12 01:03:13,591 ----------------------------------------------------------------------------------------------------
2019-10-12 01:03:13,955 epoch 18 - iter 0/226 - loss 2.50859833 - samples/sec: 1938.84
2019-10-12 01:03:20,789 epoch 18 - iter 22/226 - loss 2.57694612 - samples/sec: 116.62
2019-10-12 01:03:27,535 epoch 18 - iter 44/226 - loss 2.64911949 - samples/sec: 119.47
2019-10-12 01:03:34,452 epoch 18 - iter 66/226 - loss 2.69000964 - samples/sec: 115.07
2019-10-12 01:03:40,915 epoch 18 - iter 88/226 - loss 2.76953810 - samples/sec: 123.45
2019-10-12 01:03:47,739 epoch 18 - iter 110/226 - loss 2.75162592 - samples/sec: 116.28
2019-10-12 01:03:57,517 epoch 18 - iter 132/226 - loss 2.73219785 - samples/sec: 124.18
2019-10-12 01:04:04,399 epoch 18 - iter 154/226 - loss 2.75817474 - samples/sec: 115.31
2019-10-12 01:04:11,106 epoch 18 - iter 176/226 - loss 2.77368725 - samples/sec: 119.60
2019-10-12 01:04:17,907 epoch 18 - iter 198/226 - loss 2.76402937 - samples/sec: 121.58
2019-10-12 01:04:24,854 epoch 18 - iter 220/226 - loss 2.77830023 - samples/sec: 115.57
2019-10-12 01:04:26,951 ----------------------------------------------------------------------------------------------------
2019-10-12 01:04:26,952 EPOCH 18 done: loss 2.7814 - lr 0.1000
2019-10-12 01:04:37,371 DEV : loss 2.432483434677124 - score 0.8265
2019-10-12 01:04:37,380 BAD EPOCHS (no improvement): 3
2019-10-12 01:04:37,386 ----------------------------------------------------------------------------------------------------
2019-10-12 01:04:37,667 epoch 19 - iter 0/226 - loss 2.90415955 - samples/sec: 2513.26
2019-10-12 01:04:44,842 epoch 19 - iter 22/226 - loss 2.74249075 - samples/sec: 112.26
2019-10-12 01:04:51,735 epoch 19 - iter 44/226 - loss 2.69478901 - samples/sec: 115.62
2019-10-12 01:04:58,226 epoch 19 - iter 66/226 - loss 2.76088660 - samples/sec: 124.66
2019-10-12 01:05:04,854 epoch 19 - iter 88/226 - loss 2.77606627 - samples/sec: 121.87
2019-10-12 01:05:11,576 epoch 19 - iter 110/226 - loss 2.78701835 - samples/sec: 120.37
2019-10-12 01:05:18,708 epoch 19 - iter 132/226 - loss 2.79292397 - samples/sec: 115.55
2019-10-12 01:05:25,392 epoch 19 - iter 154/226 - loss 2.78948056 - samples/sec: 120.76
2019-10-12 01:05:32,621 epoch 19 - iter 176/226 - loss 2.79851885 - samples/sec: 119.53
2019-10-12 01:05:39,445 epoch 19 - iter 198/226 - loss 2.79099033 - samples/sec: 117.75
2019-10-12 01:05:45,734 epoch 19 - iter 220/226 - loss 2.77600057 - samples/sec: 129.93
2019-10-12 01:05:47,927 ----------------------------------------------------------------------------------------------------
2019-10-12 01:05:47,928 EPOCH 19 done: loss 2.7669 - lr 0.1000
2019-10-12 01:05:58,218 DEV : loss 2.435128927230835 - score 0.8348
2019-10-12 01:05:58,227 BAD EPOCHS (no improvement): 0
2019-10-12 01:06:06,660 ----------------------------------------------------------------------------------------------------
2019-10-12 01:06:06,924 epoch 20 - iter 0/226 - loss 2.32879400 - samples/sec: 2682.25
2019-10-12 01:06:13,434 epoch 20 - iter 22/226 - loss 2.59333401 - samples/sec: 123.66
2019-10-12 01:06:20,140 epoch 20 - iter 44/226 - loss 2.72668713 - samples/sec: 119.57
2019-10-12 01:06:26,845 epoch 20 - iter 66/226 - loss 2.71876863 - samples/sec: 119.19
2019-10-12 01:06:33,439 epoch 20 - iter 88/226 - loss 2.68306487 - samples/sec: 121.50
2019-10-12 01:06:40,253 epoch 20 - iter 110/226 - loss 2.69635123 - samples/sec: 117.56
2019-10-12 01:06:46,914 epoch 20 - iter 132/226 - loss 2.70836812 - samples/sec: 124.80
2019-10-12 01:06:53,935 epoch 20 - iter 154/226 - loss 2.71900760 - samples/sec: 113.47
2019-10-12 01:07:00,378 epoch 20 - iter 176/226 - loss 2.69085115 - samples/sec: 125.65
2019-10-12 01:07:07,153 epoch 20 - iter 198/226 - loss 2.70299201 - samples/sec: 118.52
2019-10-12 01:07:14,210 epoch 20 - iter 220/226 - loss 2.72176704 - samples/sec: 115.11
2019-10-12 01:07:16,266 ----------------------------------------------------------------------------------------------------
2019-10-12 01:07:16,266 EPOCH 20 done: loss 2.7292 - lr 0.1000
2019-10-12 01:07:26,943 DEV : loss 2.3757760524749756 - score 0.8348
2019-10-12 01:07:26,954 BAD EPOCHS (no improvement): 1
2019-10-12 01:07:34,629 ----------------------------------------------------------------------------------------------------
2019-10-12 01:07:35,000 epoch 21 - iter 0/226 - loss 2.75036097 - samples/sec: 1903.75
2019-10-12 01:07:41,667 epoch 21 - iter 22/226 - loss 2.60926222 - samples/sec: 120.74
2019-10-12 01:07:48,599 epoch 21 - iter 44/226 - loss 2.61494880 - samples/sec: 116.49
2019-10-12 01:07:55,207 epoch 21 - iter 66/226 - loss 2.65557837 - samples/sec: 122.14
2019-10-12 01:08:02,278 epoch 21 - iter 88/226 - loss 2.65961719 - samples/sec: 113.18
2019-10-12 01:08:09,185 epoch 21 - iter 110/226 - loss 2.64086210 - samples/sec: 116.22
2019-10-12 01:08:16,582 epoch 21 - iter 132/226 - loss 2.64498082 - samples/sec: 114.42
2019-10-12 01:08:23,104 epoch 21 - iter 154/226 - loss 2.63384445 - samples/sec: 123.44
2019-10-12 01:08:29,710 epoch 21 - iter 176/226 - loss 2.65378237 - samples/sec: 120.60
2019-10-12 01:08:36,690 epoch 21 - iter 198/226 - loss 2.66624754 - samples/sec: 113.85
2019-10-12 01:08:43,049 epoch 21 - iter 220/226 - loss 2.65811336 - samples/sec: 126.00
2019-10-12 01:08:44,969 ----------------------------------------------------------------------------------------------------
2019-10-12 01:08:44,970 EPOCH 21 done: loss 2.6476 - lr 0.1000
2019-10-12 01:08:55,742 DEV : loss 2.426262378692627 - score 0.8316
2019-10-12 01:08:55,751 BAD EPOCHS (no improvement): 2
2019-10-12 01:08:55,756 ----------------------------------------------------------------------------------------------------
2019-10-12 01:08:56,181 epoch 22 - iter 0/226 - loss 2.88303423 - samples/sec: 1660.25
2019-10-12 01:09:02,718 epoch 22 - iter 22/226 - loss 2.44724247 - samples/sec: 121.89
2019-10-12 01:09:09,537 epoch 22 - iter 44/226 - loss 2.57831214 - samples/sec: 116.97
2019-10-12 01:09:16,124 epoch 22 - iter 66/226 - loss 2.58866031 - samples/sec: 121.15
2019-10-12 01:09:23,119 epoch 22 - iter 88/226 - loss 2.60745518 - samples/sec: 113.44
2019-10-12 01:09:29,935 epoch 22 - iter 110/226 - loss 2.66018237 - samples/sec: 116.38
2019-10-12 01:09:36,248 epoch 22 - iter 132/226 - loss 2.64857213 - samples/sec: 126.80
2019-10-12 01:09:42,972 epoch 22 - iter 154/226 - loss 2.61763165 - samples/sec: 118.50
2019-10-12 01:09:50,024 epoch 22 - iter 176/226 - loss 2.61722866 - samples/sec: 114.64
2019-10-12 01:09:56,573 epoch 22 - iter 198/226 - loss 2.61673076 - samples/sec: 121.59
2019-10-12 01:10:03,295 epoch 22 - iter 220/226 - loss 2.61753149 - samples/sec: 118.32
2019-10-12 01:10:05,386 ----------------------------------------------------------------------------------------------------
2019-10-12 01:10:05,387 EPOCH 22 done: loss 2.6221 - lr 0.1000
2019-10-12 01:10:16,205 DEV : loss 2.457718849182129 - score 0.8336
2019-10-12 01:10:16,216 BAD EPOCHS (no improvement): 3
2019-10-12 01:10:16,221 ----------------------------------------------------------------------------------------------------
2019-10-12 01:10:16,520 epoch 23 - iter 0/226 - loss 3.17846298 - samples/sec: 2363.73
2019-10-12 01:10:23,420 epoch 23 - iter 22/226 - loss 2.67019509 - samples/sec: 115.05
2019-10-12 01:10:29,894 epoch 23 - iter 44/226 - loss 2.54440129 - samples/sec: 124.17
2019-10-12 01:10:36,398 epoch 23 - iter 66/226 - loss 2.51890563 - samples/sec: 123.56
2019-10-12 01:10:42,747 epoch 23 - iter 88/226 - loss 2.54658370 - samples/sec: 125.79
2019-10-12 01:10:49,409 epoch 23 - iter 110/226 - loss 2.57009860 - samples/sec: 119.89
2019-10-12 01:10:56,306 epoch 23 - iter 132/226 - loss 2.56116034 - samples/sec: 114.88
2019-10-12 01:11:03,238 epoch 23 - iter 154/226 - loss 2.61546893 - samples/sec: 113.97
2019-10-12 01:11:09,847 epoch 23 - iter 176/226 - loss 2.61501826 - samples/sec: 120.60
2019-10-12 01:11:16,714 epoch 23 - iter 198/226 - loss 2.62642132 - samples/sec: 116.01
2019-10-12 01:11:23,362 epoch 23 - iter 220/226 - loss 2.62534970 - samples/sec: 119.76
2019-10-12 01:11:25,405 ----------------------------------------------------------------------------------------------------
2019-10-12 01:11:25,405 EPOCH 23 done: loss 2.6248 - lr 0.1000
2019-10-12 01:11:36,210 DEV : loss 2.4377522468566895 - score 0.8341
2019-10-12 01:11:36,219 BAD EPOCHS (no improvement): 4
2019-10-12 01:11:36,224 ----------------------------------------------------------------------------------------------------
2019-10-12 01:11:36,495 epoch 24 - iter 0/226 - loss 2.48141289 - samples/sec: 2597.83
2019-10-12 01:11:43,284 epoch 24 - iter 22/226 - loss 2.55145335 - samples/sec: 116.85
2019-10-12 01:11:49,999 epoch 24 - iter 44/226 - loss 2.50857141 - samples/sec: 118.05
2019-10-12 01:11:56,624 epoch 24 - iter 66/226 - loss 2.55294769 - samples/sec: 120.42
2019-10-12 01:12:02,962 epoch 24 - iter 88/226 - loss 2.55727531 - samples/sec: 126.39
2019-10-12 01:12:09,788 epoch 24 - iter 110/226 - loss 2.53932889 - samples/sec: 115.97
2019-10-12 01:12:16,575 epoch 24 - iter 132/226 - loss 2.52200895 - samples/sec: 116.74
2019-10-12 01:12:23,722 epoch 24 - iter 154/226 - loss 2.56328439 - samples/sec: 110.88
2019-10-12 01:12:30,444 epoch 24 - iter 176/226 - loss 2.54692490 - samples/sec: 120.41
2019-10-12 01:12:36,860 epoch 24 - iter 198/226 - loss 2.56893775 - samples/sec: 124.29
2019-10-12 01:12:43,922 epoch 24 - iter 220/226 - loss 2.57879555 - samples/sec: 111.55
2019-10-12 01:12:45,845 ----------------------------------------------------------------------------------------------------
2019-10-12 01:12:45,846 EPOCH 24 done: loss 2.5648 - lr 0.1000
2019-10-12 01:12:56,201 DEV : loss 2.404229164123535 - score 0.8385
2019-10-12 01:12:56,212 BAD EPOCHS (no improvement): 0
2019-10-12 01:13:03,895 ----------------------------------------------------------------------------------------------------
2019-10-12 01:13:04,150 epoch 25 - iter 0/226 - loss 2.59453273 - samples/sec: 2771.11
2019-10-12 01:13:11,058 epoch 25 - iter 22/226 - loss 2.61501825 - samples/sec: 116.94
2019-10-12 01:13:17,625 epoch 25 - iter 44/226 - loss 2.50215530 - samples/sec: 123.41
2019-10-12 01:13:24,522 epoch 25 - iter 66/226 - loss 2.48805674 - samples/sec: 115.31
2019-10-12 01:13:31,342 epoch 25 - iter 88/226 - loss 2.48082427 - samples/sec: 116.71
2019-10-12 01:13:37,806 epoch 25 - iter 110/226 - loss 2.51967269 - samples/sec: 123.20
2019-10-12 01:13:44,366 epoch 25 - iter 132/226 - loss 2.51855167 - samples/sec: 121.30
2019-10-12 01:13:51,683 epoch 25 - iter 154/226 - loss 2.49574500 - samples/sec: 116.58
2019-10-12 01:13:58,268 epoch 25 - iter 176/226 - loss 2.49730763 - samples/sec: 121.04
2019-10-12 01:14:05,168 epoch 25 - iter 198/226 - loss 2.49292728 - samples/sec: 115.74
2019-10-12 01:14:11,834 epoch 25 - iter 220/226 - loss 2.51095973 - samples/sec: 118.85
2019-10-12 01:14:13,853 ----------------------------------------------------------------------------------------------------
2019-10-12 01:14:13,854 EPOCH 25 done: loss 2.5225 - lr 0.1000
2019-10-12 01:14:24,615 DEV : loss 2.4079477787017822 - score 0.839
2019-10-12 01:14:24,626 BAD EPOCHS (no improvement): 0
2019-10-12 01:14:32,343 ----------------------------------------------------------------------------------------------------
2019-10-12 01:14:32,636 epoch 26 - iter 0/226 - loss 3.02240992 - samples/sec: 2416.71
2019-10-12 01:14:39,429 epoch 26 - iter 22/226 - loss 2.40830967 - samples/sec: 116.78
2019-10-12 01:14:45,949 epoch 26 - iter 44/226 - loss 2.35508773 - samples/sec: 122.75
2019-10-12 01:14:52,750 epoch 26 - iter 66/226 - loss 2.37089885 - samples/sec: 116.37
2019-10-12 01:15:00,095 epoch 26 - iter 88/226 - loss 2.42399257 - samples/sec: 114.88
2019-10-12 01:15:06,468 epoch 26 - iter 110/226 - loss 2.43473873 - samples/sec: 125.49
2019-10-12 01:15:13,083 epoch 26 - iter 132/226 - loss 2.43833061 - samples/sec: 120.09
2019-10-12 01:15:19,947 epoch 26 - iter 154/226 - loss 2.44085052 - samples/sec: 115.74
2019-10-12 01:15:26,653 epoch 26 - iter 176/226 - loss 2.45012439 - samples/sec: 119.80
2019-10-12 01:15:33,241 epoch 26 - iter 198/226 - loss 2.46563531 - samples/sec: 121.69
2019-10-12 01:15:39,823 epoch 26 - iter 220/226 - loss 2.45910201 - samples/sec: 121.49
2019-10-12 01:15:42,102 ----------------------------------------------------------------------------------------------------
2019-10-12 01:15:42,102 EPOCH 26 done: loss 2.4651 - lr 0.1000
2019-10-12 01:15:53,088 DEV : loss 2.442545175552368 - score 0.8381
2019-10-12 01:15:53,098 BAD EPOCHS (no improvement): 1
2019-10-12 01:15:53,102 ----------------------------------------------------------------------------------------------------
2019-10-12 01:15:53,483 epoch 27 - iter 0/226 - loss 2.75426078 - samples/sec: 1851.35
2019-10-12 01:16:00,341 epoch 27 - iter 22/226 - loss 2.57223837 - samples/sec: 115.29
2019-10-12 01:16:06,940 epoch 27 - iter 44/226 - loss 2.46991707 - samples/sec: 120.60
2019-10-12 01:16:13,817 epoch 27 - iter 66/226 - loss 2.48584401 - samples/sec: 115.33
2019-10-12 01:16:20,466 epoch 27 - iter 88/226 - loss 2.47653465 - samples/sec: 119.35
2019-10-12 01:16:27,151 epoch 27 - iter 110/226 - loss 2.46433306 - samples/sec: 119.10
2019-10-12 01:16:33,656 epoch 27 - iter 132/226 - loss 2.47002143 - samples/sec: 123.79
2019-10-12 01:16:40,475 epoch 27 - iter 154/226 - loss 2.46432193 - samples/sec: 116.55
2019-10-12 01:16:47,144 epoch 27 - iter 176/226 - loss 2.48386835 - samples/sec: 119.78
2019-10-12 01:16:53,582 epoch 27 - iter 198/226 - loss 2.47881273 - samples/sec: 124.38
2019-10-12 01:17:00,389 epoch 27 - iter 220/226 - loss 2.46967706 - samples/sec: 116.65
2019-10-12 01:17:02,324 ----------------------------------------------------------------------------------------------------
2019-10-12 01:17:02,325 EPOCH 27 done: loss 2.4649 - lr 0.1000
2019-10-12 01:17:13,055 DEV : loss 2.3835291862487793 - score 0.8394
2019-10-12 01:17:13,066 BAD EPOCHS (no improvement): 0
2019-10-12 01:17:20,694 ----------------------------------------------------------------------------------------------------
2019-10-12 01:17:20,958 epoch 28 - iter 0/226 - loss 2.68788505 - samples/sec: 2672.61
2019-10-12 01:17:27,689 epoch 28 - iter 22/226 - loss 2.58194762 - samples/sec: 118.23
2019-10-12 01:17:34,678 epoch 28 - iter 44/226 - loss 2.50697819 - samples/sec: 115.17
2019-10-12 01:17:41,388 epoch 28 - iter 66/226 - loss 2.52925525 - samples/sec: 120.51
2019-10-12 01:17:48,230 epoch 28 - iter 88/226 - loss 2.49911685 - samples/sec: 116.24
2019-10-12 01:17:54,988 epoch 28 - iter 110/226 - loss 2.47806379 - samples/sec: 117.61
2019-10-12 01:18:01,730 epoch 28 - iter 132/226 - loss 2.44580612 - samples/sec: 119.61
2019-10-12 01:18:08,239 epoch 28 - iter 154/226 - loss 2.43786960 - samples/sec: 123.72
2019-10-12 01:18:14,617 epoch 28 - iter 176/226 - loss 2.42228784 - samples/sec: 126.19
2019-10-12 01:18:21,366 epoch 28 - iter 198/226 - loss 2.43973025 - samples/sec: 118.44
2019-10-12 01:18:28,142 epoch 28 - iter 220/226 - loss 2.46211326 - samples/sec: 117.72
2019-10-12 01:18:30,183 ----------------------------------------------------------------------------------------------------
2019-10-12 01:18:30,183 EPOCH 28 done: loss 2.4663 - lr 0.1000
2019-10-12 01:18:41,152 DEV : loss 2.4228804111480713 - score 0.84
2019-10-12 01:18:41,162 BAD EPOCHS (no improvement): 0
2019-10-12 01:18:48,909 ----------------------------------------------------------------------------------------------------
2019-10-12 01:18:49,182 epoch 29 - iter 0/226 - loss 3.34027600 - samples/sec: 2585.96
2019-10-12 01:18:56,120 epoch 29 - iter 22/226 - loss 2.36020472 - samples/sec: 114.29
2019-10-12 01:19:02,672 epoch 29 - iter 44/226 - loss 2.23714635 - samples/sec: 122.50
2019-10-12 01:19:09,189 epoch 29 - iter 66/226 - loss 2.26352564 - samples/sec: 124.10
2019-10-12 01:19:15,817 epoch 29 - iter 88/226 - loss 2.31646149 - samples/sec: 120.20
2019-10-12 01:19:22,693 epoch 29 - iter 110/226 - loss 2.31808058 - samples/sec: 115.90
2019-10-12 01:19:29,617 epoch 29 - iter 132/226 - loss 2.30147525 - samples/sec: 115.15
2019-10-12 01:19:36,516 epoch 29 - iter 154/226 - loss 2.31840773 - samples/sec: 115.53
2019-10-12 01:19:43,024 epoch 29 - iter 176/226 - loss 2.31616608 - samples/sec: 123.10
2019-10-12 01:19:49,514 epoch 29 - iter 198/226 - loss 2.33046589 - samples/sec: 123.60
2019-10-12 01:19:56,384 epoch 29 - iter 220/226 - loss 2.33990168 - samples/sec: 116.79
2019-10-12 01:19:58,492 ----------------------------------------------------------------------------------------------------
2019-10-12 01:19:58,492 EPOCH 29 done: loss 2.3368 - lr 0.1000
2019-10-12 01:20:09,190 DEV : loss 2.503087043762207 - score 0.8392
2019-10-12 01:20:09,200 BAD EPOCHS (no improvement): 1
2019-10-12 01:20:09,205 ----------------------------------------------------------------------------------------------------
2019-10-12 01:20:09,465 epoch 30 - iter 0/226 - loss 2.20945454 - samples/sec: 2719.82
2019-10-12 01:20:16,427 epoch 30 - iter 22/226 - loss 2.20763599 - samples/sec: 114.54
2019-10-12 01:20:22,804 epoch 30 - iter 44/226 - loss 2.16640144 - samples/sec: 126.21
2019-10-12 01:20:29,513 epoch 30 - iter 66/226 - loss 2.20120665 - samples/sec: 119.19
2019-10-12 01:20:36,273 epoch 30 - iter 88/226 - loss 2.22849118 - samples/sec: 117.54
2019-10-12 01:20:42,846 epoch 30 - iter 110/226 - loss 2.26346855 - samples/sec: 121.33
2019-10-12 01:20:49,644 epoch 30 - iter 132/226 - loss 2.27574328 - samples/sec: 116.53
2019-10-12 01:20:56,221 epoch 30 - iter 154/226 - loss 2.30909508 - samples/sec: 121.67
2019-10-12 01:21:02,991 epoch 30 - iter 176/226 - loss 2.34126757 - samples/sec: 116.91
2019-10-12 01:21:09,297 epoch 30 - iter 198/226 - loss 2.36186664 - samples/sec: 126.80
2019-10-12 01:21:16,685 epoch 30 - iter 220/226 - loss 2.36595392 - samples/sec: 110.69
2019-10-12 01:21:18,548 ----------------------------------------------------------------------------------------------------
2019-10-12 01:21:18,549 EPOCH 30 done: loss 2.3774 - lr 0.1000
2019-10-12 01:21:29,454 DEV : loss 2.4200193881988525 - score 0.8385
2019-10-12 01:21:29,465 BAD EPOCHS (no improvement): 2
2019-10-12 01:21:29,470 ----------------------------------------------------------------------------------------------------
2019-10-12 01:21:29,856 epoch 31 - iter 0/226 - loss 2.82862473 - samples/sec: 1827.67
2019-10-12 01:21:36,895 epoch 31 - iter 22/226 - loss 2.26671139 - samples/sec: 111.93
2019-10-12 01:21:43,531 epoch 31 - iter 44/226 - loss 2.23623608 - samples/sec: 119.69
2019-10-12 01:21:50,371 epoch 31 - iter 66/226 - loss 2.22374395 - samples/sec: 115.37
2019-10-12 01:21:56,960 epoch 31 - iter 88/226 - loss 2.27751476 - samples/sec: 120.28
2019-10-12 01:22:03,611 epoch 31 - iter 110/226 - loss 2.32546917 - samples/sec: 119.89
2019-10-12 01:22:10,407 epoch 31 - iter 132/226 - loss 2.31609315 - samples/sec: 119.97
2019-10-12 01:22:16,902 epoch 31 - iter 154/226 - loss 2.32566142 - samples/sec: 122.45
2019-10-12 01:22:23,526 epoch 31 - iter 176/226 - loss 2.32588560 - samples/sec: 120.10
2019-10-12 01:22:30,265 epoch 31 - iter 198/226 - loss 2.31125312 - samples/sec: 118.10
2019-10-12 01:22:37,176 epoch 31 - iter 220/226 - loss 2.34742507 - samples/sec: 115.00
2019-10-12 01:22:39,120 ----------------------------------------------------------------------------------------------------
2019-10-12 01:22:39,121 EPOCH 31 done: loss 2.3425 - lr 0.1000
2019-10-12 01:22:49,869 DEV : loss 2.410860776901245 - score 0.8395
2019-10-12 01:22:49,878 BAD EPOCHS (no improvement): 3
2019-10-12 01:22:49,883 ----------------------------------------------------------------------------------------------------
2019-10-12 01:22:50,176 epoch 32 - iter 0/226 - loss 1.64436626 - samples/sec: 2408.73
2019-10-12 01:22:56,986 epoch 32 - iter 22/226 - loss 2.41270625 - samples/sec: 115.99
2019-10-12 01:23:03,809 epoch 32 - iter 44/226 - loss 2.26376552 - samples/sec: 115.27
2019-10-12 01:23:10,476 epoch 32 - iter 66/226 - loss 2.31043732 - samples/sec: 118.86
2019-10-12 01:23:16,890 epoch 32 - iter 88/226 - loss 2.30087285 - samples/sec: 124.35
2019-10-12 01:23:23,057 epoch 32 - iter 110/226 - loss 2.32795978 - samples/sec: 129.69
2019-10-12 01:23:29,639 epoch 32 - iter 132/226 - loss 2.32512308 - samples/sec: 121.57
2019-10-12 01:23:36,756 epoch 32 - iter 154/226 - loss 2.33119638 - samples/sec: 112.23
2019-10-12 01:23:43,455 epoch 32 - iter 176/226 - loss 2.33073377 - samples/sec: 118.02
2019-10-12 01:23:50,046 epoch 32 - iter 198/226 - loss 2.35163881 - samples/sec: 120.29
2019-10-12 01:23:56,558 epoch 32 - iter 220/226 - loss 2.34012890 - samples/sec: 122.52
2019-10-12 01:23:58,471 ----------------------------------------------------------------------------------------------------
2019-10-12 01:23:58,472 EPOCH 32 done: loss 2.3350 - lr 0.1000
2019-10-12 01:24:09,278 DEV : loss 2.3831188678741455 - score 0.8416
2019-10-12 01:24:09,289 BAD EPOCHS (no improvement): 0
2019-10-12 01:24:16,829 ----------------------------------------------------------------------------------------------------
2019-10-12 01:24:17,071 epoch 33 - iter 0/226 - loss 1.99605227 - samples/sec: 2923.06
2019-10-12 01:24:24,109 epoch 33 - iter 22/226 - loss 2.21702855 - samples/sec: 111.77
2019-10-12 01:24:30,823 epoch 33 - iter 44/226 - loss 2.33248641 - samples/sec: 117.77
2019-10-12 01:24:37,509 epoch 33 - iter 66/226 - loss 2.29893482 - samples/sec: 118.00
2019-10-12 01:24:44,410 epoch 33 - iter 88/226 - loss 2.31749749 - samples/sec: 115.31
2019-10-12 01:24:50,690 epoch 33 - iter 110/226 - loss 2.33152574 - samples/sec: 128.70
2019-10-12 01:24:57,435 epoch 33 - iter 132/226 - loss 2.33137122 - samples/sec: 119.20
2019-10-12 01:25:04,180 epoch 33 - iter 154/226 - loss 2.33193913 - samples/sec: 119.65
2019-10-12 01:25:10,685 epoch 33 - iter 176/226 - loss 2.33264095 - samples/sec: 124.96
2019-10-12 01:25:17,835 epoch 33 - iter 198/226 - loss 2.33765189 - samples/sec: 113.13
2019-10-12 01:25:24,425 epoch 33 - iter 220/226 - loss 2.33039668 - samples/sec: 122.92
2019-10-12 01:25:26,513 ----------------------------------------------------------------------------------------------------
2019-10-12 01:25:26,513 EPOCH 33 done: loss 2.3256 - lr 0.1000
2019-10-12 01:25:37,336 DEV : loss 2.4200119972229004 - score 0.8389
2019-10-12 01:25:37,345 BAD EPOCHS (no improvement): 1
2019-10-12 01:25:37,353 ----------------------------------------------------------------------------------------------------
2019-10-12 01:25:37,654 epoch 34 - iter 0/226 - loss 2.26065350 - samples/sec: 2346.96
2019-10-12 01:25:44,966 epoch 34 - iter 22/226 - loss 2.23290955 - samples/sec: 108.89
2019-10-12 01:25:52,014 epoch 34 - iter 44/226 - loss 2.27568835 - samples/sec: 113.87
2019-10-12 01:25:58,680 epoch 34 - iter 66/226 - loss 2.24428664 - samples/sec: 121.44
2019-10-12 01:26:05,382 epoch 34 - iter 88/226 - loss 2.26858426 - samples/sec: 123.25
2019-10-12 01:26:11,985 epoch 34 - iter 110/226 - loss 2.25216808 - samples/sec: 122.34
2019-10-12 01:26:18,888 epoch 34 - iter 132/226 - loss 2.22964984 - samples/sec: 118.30
2019-10-12 01:26:25,249 epoch 34 - iter 154/226 - loss 2.23995722 - samples/sec: 127.71
2019-10-12 01:26:31,841 epoch 34 - iter 176/226 - loss 2.26407069 - samples/sec: 121.46
2019-10-12 01:26:38,742 epoch 34 - iter 198/226 - loss 2.27336042 - samples/sec: 115.64
2019-10-12 01:26:45,397 epoch 34 - iter 220/226 - loss 2.28136314 - samples/sec: 120.82
2019-10-12 01:26:47,415 ----------------------------------------------------------------------------------------------------
2019-10-12 01:26:47,416 EPOCH 34 done: loss 2.2770 - lr 0.1000
2019-10-12 01:26:58,100 DEV : loss 2.3699254989624023 - score 0.8428
2019-10-12 01:26:58,109 BAD EPOCHS (no improvement): 0
2019-10-12 01:27:05,788 ----------------------------------------------------------------------------------------------------
2019-10-12 01:27:06,079 epoch 35 - iter 0/226 - loss 1.41160607 - samples/sec: 2430.53
2019-10-12 01:27:13,149 epoch 35 - iter 22/226 - loss 2.35866067 - samples/sec: 113.46
2019-10-12 01:27:20,382 epoch 35 - iter 44/226 - loss 2.22517207 - samples/sec: 122.92
2019-10-12 01:27:27,264 epoch 35 - iter 66/226 - loss 2.24229052 - samples/sec: 116.48
2019-10-12 01:27:33,861 epoch 35 - iter 88/226 - loss 2.21454295 - samples/sec: 122.79
2019-10-12 01:27:40,395 epoch 35 - iter 110/226 - loss 2.17595233 - samples/sec: 123.73
2019-10-12 01:27:47,217 epoch 35 - iter 132/226 - loss 2.18119716 - samples/sec: 118.08
2019-10-12 01:27:54,181 epoch 35 - iter 154/226 - loss 2.20360320 - samples/sec: 115.68
2019-10-12 01:28:01,253 epoch 35 - iter 176/226 - loss 2.21882977 - samples/sec: 113.46
2019-10-12 01:28:08,129 epoch 35 - iter 198/226 - loss 2.23005834 - samples/sec: 116.46
2019-10-12 01:28:14,654 epoch 35 - iter 220/226 - loss 2.21926497 - samples/sec: 123.72
2019-10-12 01:28:16,663 ----------------------------------------------------------------------------------------------------
2019-10-12 01:28:16,663 EPOCH 35 done: loss 2.2219 - lr 0.1000
2019-10-12 01:28:27,109 DEV : loss 2.484956979751587 - score 0.8395
2019-10-12 01:28:27,118 BAD EPOCHS (no improvement): 1
2019-10-12 01:28:27,123 ----------------------------------------------------------------------------------------------------
2019-10-12 01:28:27,341 epoch 36 - iter 0/226 - loss 2.60055161 - samples/sec: 3244.76
2019-10-12 01:28:34,095 epoch 36 - iter 22/226 - loss 2.29447307 - samples/sec: 119.29
2019-10-12 01:28:40,485 epoch 36 - iter 44/226 - loss 2.19138195 - samples/sec: 126.87
2019-10-12 01:28:47,253 epoch 36 - iter 66/226 - loss 2.15377964 - samples/sec: 118.72
2019-10-12 01:28:53,925 epoch 36 - iter 88/226 - loss 2.21352654 - samples/sec: 120.27
2019-10-12 01:29:00,533 epoch 36 - iter 110/226 - loss 2.17474860 - samples/sec: 121.01
2019-10-12 01:29:07,635 epoch 36 - iter 132/226 - loss 2.17023129 - samples/sec: 111.22
2019-10-12 01:29:14,269 epoch 36 - iter 154/226 - loss 2.19160062 - samples/sec: 120.45
2019-10-12 01:29:21,102 epoch 36 - iter 176/226 - loss 2.20606551 - samples/sec: 117.66
2019-10-12 01:29:27,904 epoch 36 - iter 198/226 - loss 2.20040837 - samples/sec: 117.74
2019-10-12 01:29:34,569 epoch 36 - iter 220/226 - loss 2.20934418 - samples/sec: 120.10
2019-10-12 01:29:36,749 ----------------------------------------------------------------------------------------------------
2019-10-12 01:29:36,749 EPOCH 36 done: loss 2.2051 - lr 0.1000
2019-10-12 01:29:47,514 DEV : loss 2.424621105194092 - score 0.837
2019-10-12 01:29:47,525 BAD EPOCHS (no improvement): 2
2019-10-12 01:29:47,532 ----------------------------------------------------------------------------------------------------
2019-10-12 01:29:47,799 epoch 37 - iter 0/226 - loss 2.22305727 - samples/sec: 2646.80
2019-10-12 01:29:54,435 epoch 37 - iter 22/226 - loss 2.00189596 - samples/sec: 119.68
2019-10-12 01:30:01,154 epoch 37 - iter 44/226 - loss 2.09533476 - samples/sec: 118.07
2019-10-12 01:30:08,153 epoch 37 - iter 66/226 - loss 2.17402143 - samples/sec: 114.01
2019-10-12 01:30:15,148 epoch 37 - iter 88/226 - loss 2.18044382 - samples/sec: 115.21
2019-10-12 01:30:21,886 epoch 37 - iter 110/226 - loss 2.16354284 - samples/sec: 120.04
2019-10-12 01:30:28,611 epoch 37 - iter 132/226 - loss 2.20462086 - samples/sec: 118.81
2019-10-12 01:30:35,565 epoch 37 - iter 154/226 - loss 2.19827211 - samples/sec: 114.58
2019-10-12 01:30:42,036 epoch 37 - iter 176/226 - loss 2.18125341 - samples/sec: 123.97
2019-10-12 01:30:48,709 epoch 37 - iter 198/226 - loss 2.16703888 - samples/sec: 119.95
2019-10-12 01:30:55,608 epoch 37 - iter 220/226 - loss 2.17378321 - samples/sec: 115.05
2019-10-12 01:30:57,771 ----------------------------------------------------------------------------------------------------
2019-10-12 01:30:57,771 EPOCH 37 done: loss 2.1591 - lr 0.1000
2019-10-12 01:31:08,602 DEV : loss 2.40250301361084 - score 0.8449
2019-10-12 01:31:08,613 BAD EPOCHS (no improvement): 0
2019-10-12 01:31:16,632 ----------------------------------------------------------------------------------------------------
2019-10-12 01:31:16,943 epoch 38 - iter 0/226 - loss 2.21562529 - samples/sec: 2277.02
2019-10-12 01:31:24,050 epoch 38 - iter 22/226 - loss 2.23364371 - samples/sec: 111.16
2019-10-12 01:31:30,800 epoch 38 - iter 44/226 - loss 2.12348886 - samples/sec: 118.05
2019-10-12 01:31:37,225 epoch 38 - iter 66/226 - loss 2.13680241 - samples/sec: 125.04
2019-10-12 01:31:43,808 epoch 38 - iter 88/226 - loss 2.11398013 - samples/sec: 121.48
2019-10-12 01:31:50,706 epoch 38 - iter 110/226 - loss 2.15222626 - samples/sec: 114.97
2019-10-12 01:31:57,028 epoch 38 - iter 132/226 - loss 2.15979451 - samples/sec: 126.58
2019-10-12 01:32:03,407 epoch 38 - iter 154/226 - loss 2.16435809 - samples/sec: 127.24
2019-10-12 01:32:10,351 epoch 38 - iter 176/226 - loss 2.16738440 - samples/sec: 119.44
2019-10-12 01:32:17,439 epoch 38 - iter 198/226 - loss 2.20300734 - samples/sec: 111.88
2019-10-12 01:32:24,336 epoch 38 - iter 220/226 - loss 2.20564063 - samples/sec: 115.96
2019-10-12 01:32:26,394 ----------------------------------------------------------------------------------------------------
2019-10-12 01:32:26,394 EPOCH 38 done: loss 2.1971 - lr 0.1000
2019-10-12 01:32:37,932 DEV : loss 2.412688732147217 - score 0.8433
2019-10-12 01:32:37,942 BAD EPOCHS (no improvement): 1
2019-10-12 01:32:37,947 ----------------------------------------------------------------------------------------------------
2019-10-12 01:32:38,241 epoch 39 - iter 0/226 - loss 1.85363138 - samples/sec: 2396.63
2019-10-12 01:32:45,100 epoch 39 - iter 22/226 - loss 2.05848475 - samples/sec: 115.62
2019-10-12 01:32:51,604 epoch 39 - iter 44/226 - loss 2.02881044 - samples/sec: 122.74
2019-10-12 01:32:58,371 epoch 39 - iter 66/226 - loss 2.05890818 - samples/sec: 118.15
2019-10-12 01:33:05,289 epoch 39 - iter 88/226 - loss 2.12805077 - samples/sec: 116.62
2019-10-12 01:33:11,932 epoch 39 - iter 110/226 - loss 2.15107534 - samples/sec: 121.98
2019-10-12 01:33:18,775 epoch 39 - iter 132/226 - loss 2.14546309 - samples/sec: 117.51
2019-10-12 01:33:25,651 epoch 39 - iter 154/226 - loss 2.13690679 - samples/sec: 116.16
2019-10-12 01:33:32,213 epoch 39 - iter 176/226 - loss 2.12282253 - samples/sec: 122.60
2019-10-12 01:33:38,878 epoch 39 - iter 198/226 - loss 2.12877431 - samples/sec: 120.82
2019-10-12 01:33:45,587 epoch 39 - iter 220/226 - loss 2.11240193 - samples/sec: 119.65
2019-10-12 01:33:47,605 ----------------------------------------------------------------------------------------------------
2019-10-12 01:33:47,606 EPOCH 39 done: loss 2.1106 - lr 0.1000
2019-10-12 01:33:58,388 DEV : loss 2.4123117923736572 - score 0.8389
2019-10-12 01:33:58,397 BAD EPOCHS (no improvement): 2
2019-10-12 01:33:58,403 ----------------------------------------------------------------------------------------------------
2019-10-12 01:33:58,689 epoch 40 - iter 0/226 - loss 2.95458889 - samples/sec: 2472.13
2019-10-12 01:34:05,655 epoch 40 - iter 22/226 - loss 2.23504115 - samples/sec: 114.97
2019-10-12 01:34:12,349 epoch 40 - iter 44/226 - loss 2.21912601 - samples/sec: 120.50
2019-10-12 01:34:18,581 epoch 40 - iter 66/226 - loss 2.15154120 - samples/sec: 132.91
2019-10-12 01:34:25,642 epoch 40 - iter 88/226 - loss 2.18824071 - samples/sec: 113.80
2019-10-12 01:34:32,969 epoch 40 - iter 110/226 - loss 2.15049997 - samples/sec: 118.95
2019-10-12 01:34:40,023 epoch 40 - iter 132/226 - loss 2.13899610 - samples/sec: 112.72
2019-10-12 01:34:47,216 epoch 40 - iter 154/226 - loss 2.15499197 - samples/sec: 111.13
2019-10-12 01:34:54,134 epoch 40 - iter 176/226 - loss 2.16476698 - samples/sec: 115.25
2019-10-12 01:35:00,925 epoch 40 - iter 198/226 - loss 2.15512088 - samples/sec: 118.39
2019-10-12 01:35:07,236 epoch 40 - iter 220/226 - loss 2.13439682 - samples/sec: 127.40
2019-10-12 01:35:09,273 ----------------------------------------------------------------------------------------------------
2019-10-12 01:35:09,274 EPOCH 40 done: loss 2.1393 - lr 0.1000
2019-10-12 01:35:20,040 DEV : loss 2.437429428100586 - score 0.8434
2019-10-12 01:35:20,051 BAD EPOCHS (no improvement): 3
2019-10-12 01:35:20,056 ----------------------------------------------------------------------------------------------------
2019-10-12 01:35:20,387 epoch 41 - iter 0/226 - loss 2.69618940 - samples/sec: 2128.86
2019-10-12 01:35:27,594 epoch 41 - iter 22/226 - loss 2.06525045 - samples/sec: 109.80
2019-10-12 01:35:34,005 epoch 41 - iter 44/226 - loss 2.06752802 - samples/sec: 126.40
2019-10-12 01:35:41,129 epoch 41 - iter 66/226 - loss 2.09254815 - samples/sec: 110.84
2019-10-12 01:35:47,791 epoch 41 - iter 88/226 - loss 2.09517327 - samples/sec: 120.62
2019-10-12 01:35:54,430 epoch 41 - iter 110/226 - loss 2.08830000 - samples/sec: 120.61
2019-10-12 01:36:01,043 epoch 41 - iter 132/226 - loss 2.06285664 - samples/sec: 121.33
2019-10-12 01:36:07,802 epoch 41 - iter 154/226 - loss 2.10181910 - samples/sec: 121.45
2019-10-12 01:36:14,628 epoch 41 - iter 176/226 - loss 2.09463986 - samples/sec: 116.57
2019-10-12 01:36:21,111 epoch 41 - iter 198/226 - loss 2.10673249 - samples/sec: 123.05
2019-10-12 01:36:27,926 epoch 41 - iter 220/226 - loss 2.10680316 - samples/sec: 120.77
2019-10-12 01:36:30,019 ----------------------------------------------------------------------------------------------------
2019-10-12 01:36:30,019 EPOCH 41 done: loss 2.1044 - lr 0.1000
2019-10-12 01:36:40,836 DEV : loss 2.4646995067596436 - score 0.8393
2019-10-12 01:36:40,846 BAD EPOCHS (no improvement): 4
2019-10-12 01:36:40,850 ----------------------------------------------------------------------------------------------------
2019-10-12 01:36:41,107 epoch 42 - iter 0/226 - loss 1.31849551 - samples/sec: 2752.15
2019-10-12 01:36:48,250 epoch 42 - iter 22/226 - loss 1.90857418 - samples/sec: 111.91
2019-10-12 01:36:55,155 epoch 42 - iter 44/226 - loss 1.94398355 - samples/sec: 115.57
2019-10-12 01:37:01,561 epoch 42 - iter 66/226 - loss 1.94237951 - samples/sec: 126.26
2019-10-12 01:37:08,552 epoch 42 - iter 88/226 - loss 1.93137721 - samples/sec: 116.14
2019-10-12 01:37:15,171 epoch 42 - iter 110/226 - loss 1.96792761 - samples/sec: 120.83
2019-10-12 01:37:21,899 epoch 42 - iter 132/226 - loss 1.98915042 - samples/sec: 118.80
2019-10-12 01:37:28,553 epoch 42 - iter 154/226 - loss 2.00207013 - samples/sec: 120.48
2019-10-12 01:37:35,499 epoch 42 - iter 176/226 - loss 2.01552907 - samples/sec: 117.87
2019-10-12 01:37:42,310 epoch 42 - iter 198/226 - loss 2.02014164 - samples/sec: 117.11
2019-10-12 01:37:48,780 epoch 42 - iter 220/226 - loss 2.01109548 - samples/sec: 125.80
2019-10-12 01:37:51,011 ----------------------------------------------------------------------------------------------------
2019-10-12 01:37:51,012 EPOCH 42 done: loss 2.0173 - lr 0.1000
2019-10-12 01:38:01,326 DEV : loss 2.4571940898895264 - score 0.8436
2019-10-12 01:38:01,336 BAD EPOCHS (no improvement): 5
2019-10-12 01:38:01,342 ----------------------------------------------------------------------------------------------------
2019-10-12 01:38:01,628 epoch 43 - iter 0/226 - loss 1.48901594 - samples/sec: 2472.15
2019-10-12 01:38:08,623 epoch 43 - iter 22/226 - loss 1.96286902 - samples/sec: 115.33
2019-10-12 01:38:15,453 epoch 43 - iter 44/226 - loss 1.96215561 - samples/sec: 117.96
2019-10-12 01:38:22,230 epoch 43 - iter 66/226 - loss 1.97831992 - samples/sec: 118.33
2019-10-12 01:38:28,775 epoch 43 - iter 88/226 - loss 2.02380439 - samples/sec: 122.46
2019-10-12 01:38:35,266 epoch 43 - iter 110/226 - loss 2.02655223 - samples/sec: 123.77
2019-10-12 01:38:42,725 epoch 43 - iter 132/226 - loss 2.06036024 - samples/sec: 115.27
2019-10-12 01:38:50,050 epoch 43 - iter 154/226 - loss 2.03854690 - samples/sec: 120.21
2019-10-12 01:38:56,873 epoch 43 - iter 176/226 - loss 2.05793212 - samples/sec: 117.41
2019-10-12 01:39:03,455 epoch 43 - iter 198/226 - loss 2.06629770 - samples/sec: 122.93
2019-10-12 01:39:10,352 epoch 43 - iter 220/226 - loss 2.05445772 - samples/sec: 116.34
2019-10-12 01:39:12,485 ----------------------------------------------------------------------------------------------------
2019-10-12 01:39:12,485 EPOCH 43 done: loss 2.0528 - lr 0.1000
2019-10-12 01:39:23,221 DEV : loss 2.498574733734131 - score 0.8412
Epoch 42: reducing learning rate of group 0 to 5.0000e-02.
2019-10-12 01:39:23,232 BAD EPOCHS (no improvement): 6
2019-10-12 01:39:23,237 ----------------------------------------------------------------------------------------------------
2019-10-12 01:39:23,597 epoch 44 - iter 0/226 - loss 3.28412294 - samples/sec: 1963.35
2019-10-12 01:39:30,665 epoch 44 - iter 22/226 - loss 1.90813856 - samples/sec: 113.16
2019-10-12 01:39:37,538 epoch 44 - iter 44/226 - loss 2.00265295 - samples/sec: 116.52
2019-10-12 01:39:44,170 epoch 44 - iter 66/226 - loss 1.99962280 - samples/sec: 120.78
2019-10-12 01:39:50,652 epoch 44 - iter 88/226 - loss 1.93989477 - samples/sec: 124.10
2019-10-12 01:39:57,728 epoch 44 - iter 110/226 - loss 1.92802637 - samples/sec: 112.83
2019-10-12 01:40:04,523 epoch 44 - iter 132/226 - loss 1.92692499 - samples/sec: 120.96
2019-10-12 01:40:11,375 epoch 44 - iter 154/226 - loss 1.93920064 - samples/sec: 117.22
2019-10-12 01:40:17,990 epoch 44 - iter 176/226 - loss 1.92202373 - samples/sec: 122.53
2019-10-12 01:40:24,898 epoch 44 - iter 198/226 - loss 1.92541640 - samples/sec: 116.81
2019-10-12 01:40:31,557 epoch 44 - iter 220/226 - loss 1.92152017 - samples/sec: 120.52
2019-10-12 01:40:33,560 ----------------------------------------------------------------------------------------------------
2019-10-12 01:40:33,560 EPOCH 44 done: loss 1.9201 - lr 0.0500
2019-10-12 01:40:44,353 DEV : loss 2.425844669342041 - score 0.8452
2019-10-12 01:40:44,363 BAD EPOCHS (no improvement): 0
2019-10-12 01:40:53,279 ----------------------------------------------------------------------------------------------------
2019-10-12 01:40:53,631 epoch 45 - iter 0/226 - loss 2.11546683 - samples/sec: 2012.08
2019-10-12 01:41:00,503 epoch 45 - iter 22/226 - loss 1.79528666 - samples/sec: 116.38
2019-10-12 01:41:07,269 epoch 45 - iter 44/226 - loss 1.76122907 - samples/sec: 117.77
2019-10-12 01:41:13,852 epoch 45 - iter 66/226 - loss 1.82225991 - samples/sec: 121.35
2019-10-12 01:41:20,472 epoch 45 - iter 88/226 - loss 1.85199013 - samples/sec: 120.31
2019-10-12 01:41:27,066 epoch 45 - iter 110/226 - loss 1.85359192 - samples/sec: 121.02
2019-10-12 01:41:33,583 epoch 45 - iter 132/226 - loss 1.85048388 - samples/sec: 122.99
2019-10-12 01:41:40,269 epoch 45 - iter 154/226 - loss 1.83759179 - samples/sec: 121.42
2019-10-12 01:41:46,937 epoch 45 - iter 176/226 - loss 1.84688836 - samples/sec: 120.95
2019-10-12 01:41:53,541 epoch 45 - iter 198/226 - loss 1.84235778 - samples/sec: 120.75
2019-10-12 01:42:00,774 epoch 45 - iter 220/226 - loss 1.87359979 - samples/sec: 109.22
2019-10-12 01:42:02,844 ----------------------------------------------------------------------------------------------------
2019-10-12 01:42:02,844 EPOCH 45 done: loss 1.8658 - lr 0.0500
2019-10-12 01:42:13,745 DEV : loss 2.443815231323242 - score 0.8463
2019-10-12 01:42:13,754 BAD EPOCHS (no improvement): 0
2019-10-12 01:42:21,368 ----------------------------------------------------------------------------------------------------
2019-10-12 01:42:21,672 epoch 46 - iter 0/226 - loss 1.72852445 - samples/sec: 2327.22
2019-10-12 01:42:28,383 epoch 46 - iter 22/226 - loss 1.67633063 - samples/sec: 119.61
2019-10-12 01:42:34,928 epoch 46 - iter 44/226 - loss 1.82000683 - samples/sec: 122.00
2019-10-12 01:42:41,589 epoch 46 - iter 66/226 - loss 1.84920617 - samples/sec: 122.86
2019-10-12 01:42:48,381 epoch 46 - iter 88/226 - loss 1.87467118 - samples/sec: 120.23
2019-10-12 01:42:54,966 epoch 46 - iter 110/226 - loss 1.84579174 - samples/sec: 121.28
2019-10-12 01:43:01,505 epoch 46 - iter 132/226 - loss 1.84413271 - samples/sec: 124.49
2019-10-12 01:43:08,621 epoch 46 - iter 154/226 - loss 1.85959784 - samples/sec: 111.65
2019-10-12 01:43:15,316 epoch 46 - iter 176/226 - loss 1.87057499 - samples/sec: 119.14
2019-10-12 01:43:22,671 epoch 46 - iter 198/226 - loss 1.87135497 - samples/sec: 107.99
2019-10-12 01:43:29,382 epoch 46 - iter 220/226 - loss 1.88007783 - samples/sec: 119.43
2019-10-12 01:43:31,422 ----------------------------------------------------------------------------------------------------
2019-10-12 01:43:31,423 EPOCH 46 done: loss 1.8721 - lr 0.0500
2019-10-12 01:43:41,812 DEV : loss 2.4695041179656982 - score 0.8435
2019-10-12 01:43:41,821 BAD EPOCHS (no improvement): 1
2019-10-12 01:43:41,826 ----------------------------------------------------------------------------------------------------
2019-10-12 01:43:42,111 epoch 47 - iter 0/226 - loss 1.96282244 - samples/sec: 2478.07
2019-10-12 01:43:48,600 epoch 47 - iter 22/226 - loss 1.64309822 - samples/sec: 124.38
2019-10-12 01:43:55,114 epoch 47 - iter 44/226 - loss 1.69061184 - samples/sec: 122.59
2019-10-12 01:44:01,879 epoch 47 - iter 66/226 - loss 1.73976160 - samples/sec: 117.20
2019-10-12 01:44:08,946 epoch 47 - iter 88/226 - loss 1.76595908 - samples/sec: 112.75
2019-10-12 01:44:15,673 epoch 47 - iter 110/226 - loss 1.75397703 - samples/sec: 118.43
2019-10-12 01:44:22,285 epoch 47 - iter 132/226 - loss 1.75925963 - samples/sec: 120.03
2019-10-12 01:44:28,995 epoch 47 - iter 154/226 - loss 1.77261570 - samples/sec: 117.94
2019-10-12 01:44:35,810 epoch 47 - iter 176/226 - loss 1.79215588 - samples/sec: 117.42
2019-10-12 01:44:42,443 epoch 47 - iter 198/226 - loss 1.78789101 - samples/sec: 120.26
2019-10-12 01:44:48,919 epoch 47 - iter 220/226 - loss 1.78374396 - samples/sec: 125.01
2019-10-12 01:44:50,921 ----------------------------------------------------------------------------------------------------
2019-10-12 01:44:50,921 EPOCH 47 done: loss 1.7862 - lr 0.0500
2019-10-12 01:45:01,616 DEV : loss 2.481389284133911 - score 0.8475
2019-10-12 01:45:01,627 BAD EPOCHS (no improvement): 0
2019-10-12 01:45:09,245 ----------------------------------------------------------------------------------------------------
2019-10-12 01:45:09,572 epoch 48 - iter 0/226 - loss 1.82811475 - samples/sec: 2164.26
2019-10-12 01:45:16,280 epoch 48 - iter 22/226 - loss 1.60259802 - samples/sec: 119.55
2019-10-12 01:45:22,788 epoch 48 - iter 44/226 - loss 1.68362455 - samples/sec: 124.00
2019-10-12 01:45:29,966 epoch 48 - iter 66/226 - loss 1.68974345 - samples/sec: 119.13
2019-10-12 01:45:37,190 epoch 48 - iter 88/226 - loss 1.70720698 - samples/sec: 110.11
2019-10-12 01:45:43,933 epoch 48 - iter 110/226 - loss 1.74191952 - samples/sec: 118.48
2019-10-12 01:45:50,354 epoch 48 - iter 132/226 - loss 1.72947196 - samples/sec: 124.92
2019-10-12 01:45:57,032 epoch 48 - iter 154/226 - loss 1.74087714 - samples/sec: 119.74
2019-10-12 01:46:03,846 epoch 48 - iter 176/226 - loss 1.77710773 - samples/sec: 117.15
2019-10-12 01:46:10,582 epoch 48 - iter 198/226 - loss 1.78610119 - samples/sec: 119.17
2019-10-12 01:46:17,302 epoch 48 - iter 220/226 - loss 1.78078847 - samples/sec: 120.05
2019-10-12 01:46:19,208 ----------------------------------------------------------------------------------------------------
2019-10-12 01:46:19,208 EPOCH 48 done: loss 1.7743 - lr 0.0500
2019-10-12 01:46:30,001 DEV : loss 2.4780032634735107 - score 0.8477
2019-10-12 01:46:30,010 BAD EPOCHS (no improvement): 0
2019-10-12 01:46:37,750 ----------------------------------------------------------------------------------------------------
2019-10-12 01:46:38,038 epoch 49 - iter 0/226 - loss 2.54191113 - samples/sec: 2460.69
2019-10-12 01:46:45,209 epoch 49 - iter 22/226 - loss 1.72222174 - samples/sec: 111.59
2019-10-12 01:46:51,952 epoch 49 - iter 44/226 - loss 1.64729903 - samples/sec: 123.63
2019-10-12 01:46:58,835 epoch 49 - iter 66/226 - loss 1.69706398 - samples/sec: 125.34
2019-10-12 01:47:06,813 epoch 49 - iter 88/226 - loss 1.70804090 - samples/sec: 115.14
2019-10-12 01:47:13,476 epoch 49 - iter 110/226 - loss 1.71087290 - samples/sec: 120.86
2019-10-12 01:47:19,967 epoch 49 - iter 132/226 - loss 1.71420850 - samples/sec: 126.02
2019-10-12 01:47:26,664 epoch 49 - iter 154/226 - loss 1.71979927 - samples/sec: 119.94
2019-10-12 01:47:33,518 epoch 49 - iter 176/226 - loss 1.75242776 - samples/sec: 117.82
2019-10-12 01:47:40,983 epoch 49 - iter 198/226 - loss 1.76492260 - samples/sec: 109.44
2019-10-12 01:47:48,062 epoch 49 - iter 220/226 - loss 1.77438889 - samples/sec: 123.90
2019-10-12 01:47:50,267 ----------------------------------------------------------------------------------------------------
2019-10-12 01:47:50,267 EPOCH 49 done: loss 1.7690 - lr 0.0500
2019-10-12 01:48:00,705 DEV : loss 2.4914000034332275 - score 0.8436
2019-10-12 01:48:00,714 BAD EPOCHS (no improvement): 1
2019-10-12 01:48:00,719 ----------------------------------------------------------------------------------------------------
2019-10-12 01:48:00,976 epoch 50 - iter 0/226 - loss 2.42246437 - samples/sec: 2741.28
2019-10-12 01:48:07,836 epoch 50 - iter 22/226 - loss 1.78361735 - samples/sec: 116.75
2019-10-12 01:48:14,534 epoch 50 - iter 44/226 - loss 1.72805536 - samples/sec: 121.23
2019-10-12 01:48:21,521 epoch 50 - iter 66/226 - loss 1.68352621 - samples/sec: 114.36
2019-10-12 01:48:28,684 epoch 50 - iter 88/226 - loss 1.71665722 - samples/sec: 111.08
2019-10-12 01:48:35,266 epoch 50 - iter 110/226 - loss 1.71259258 - samples/sec: 123.33
2019-10-12 01:48:41,908 epoch 50 - iter 132/226 - loss 1.72683072 - samples/sec: 122.16
2019-10-12 01:48:48,669 epoch 50 - iter 154/226 - loss 1.70634041 - samples/sec: 119.92
2019-10-12 01:48:55,171 epoch 50 - iter 176/226 - loss 1.73371271 - samples/sec: 124.03
2019-10-12 01:49:02,171 epoch 50 - iter 198/226 - loss 1.74316640 - samples/sec: 113.73
2019-10-12 01:49:08,744 epoch 50 - iter 220/226 - loss 1.75158301 - samples/sec: 121.74
2019-10-12 01:49:10,945 ----------------------------------------------------------------------------------------------------
2019-10-12 01:49:10,946 EPOCH 50 done: loss 1.7570 - lr 0.0500
2019-10-12 01:49:21,300 DEV : loss 2.4838662147521973 - score 0.8399
2019-10-12 01:49:21,312 BAD EPOCHS (no improvement): 2
2019-10-12 01:49:21,319 ----------------------------------------------------------------------------------------------------
2019-10-12 01:49:21,589 epoch 51 - iter 0/226 - loss 1.78461051 - samples/sec: 2617.49
2019-10-12 01:49:28,166 epoch 51 - iter 22/226 - loss 1.61509868 - samples/sec: 121.60
2019-10-12 01:49:34,915 epoch 51 - iter 44/226 - loss 1.66147380 - samples/sec: 117.88
2019-10-12 01:49:41,373 epoch 51 - iter 66/226 - loss 1.67436504 - samples/sec: 126.36
2019-10-12 01:49:48,043 epoch 51 - iter 88/226 - loss 1.69289703 - samples/sec: 119.57
2019-10-12 01:49:54,810 epoch 51 - iter 110/226 - loss 1.69611080 - samples/sec: 117.39
2019-10-12 01:50:01,671 epoch 51 - iter 132/226 - loss 1.70441644 - samples/sec: 117.00
2019-10-12 01:50:08,784 epoch 51 - iter 154/226 - loss 1.69654043 - samples/sec: 112.34
2019-10-12 01:50:15,269 epoch 51 - iter 176/226 - loss 1.69034547 - samples/sec: 123.59
2019-10-12 01:50:21,814 epoch 51 - iter 198/226 - loss 1.68331789 - samples/sec: 121.77
2019-10-12 01:50:28,598 epoch 51 - iter 220/226 - loss 1.70668798 - samples/sec: 117.65
2019-10-12 01:50:30,557 ----------------------------------------------------------------------------------------------------
2019-10-12 01:50:30,557 EPOCH 51 done: loss 1.7035 - lr 0.0500
2019-10-12 01:50:41,204 DEV : loss 2.5203843116760254 - score 0.8418
2019-10-12 01:50:41,215 BAD EPOCHS (no improvement): 3
2019-10-12 01:50:41,219 ----------------------------------------------------------------------------------------------------
2019-10-12 01:50:41,500 epoch 52 - iter 0/226 - loss 1.94788837 - samples/sec: 2506.99
2019-10-12 01:50:48,520 epoch 52 - iter 22/226 - loss 1.66905637 - samples/sec: 114.30
2019-10-12 01:50:54,993 epoch 52 - iter 44/226 - loss 1.74684781 - samples/sec: 123.55
2019-10-12 01:51:01,619 epoch 52 - iter 66/226 - loss 1.81406933 - samples/sec: 120.36
2019-10-12 01:51:08,105 epoch 52 - iter 88/226 - loss 1.80382150 - samples/sec: 124.52
2019-10-12 01:51:14,475 epoch 52 - iter 110/226 - loss 1.75109226 - samples/sec: 126.31
2019-10-12 01:51:21,211 epoch 52 - iter 132/226 - loss 1.75009423 - samples/sec: 118.74
2019-10-12 01:51:28,227 epoch 52 - iter 154/226 - loss 1.75146006 - samples/sec: 112.76
2019-10-12 01:51:34,785 epoch 52 - iter 176/226 - loss 1.75117341 - samples/sec: 122.41
2019-10-12 01:51:41,658 epoch 52 - iter 198/226 - loss 1.74481023 - samples/sec: 115.32
2019-10-12 01:51:48,834 epoch 52 - iter 220/226 - loss 1.74983175 - samples/sec: 111.85
2019-10-12 01:51:50,786 ----------------------------------------------------------------------------------------------------
2019-10-12 01:51:50,787 EPOCH 52 done: loss 1.7446 - lr 0.0500
2019-10-12 01:52:01,695 DEV : loss 2.5459258556365967 - score 0.8414
2019-10-12 01:52:01,706 BAD EPOCHS (no improvement): 4
2019-10-12 01:52:01,711 ----------------------------------------------------------------------------------------------------
2019-10-12 01:52:02,020 epoch 53 - iter 0/226 - loss 1.22167170 - samples/sec: 2282.64
2019-10-12 01:52:08,898 epoch 53 - iter 22/226 - loss 1.65949268 - samples/sec: 116.30
2019-10-12 01:52:15,746 epoch 53 - iter 44/226 - loss 1.68329517 - samples/sec: 115.65
2019-10-12 01:52:22,763 epoch 53 - iter 66/226 - loss 1.69790767 - samples/sec: 111.96
2019-10-12 01:52:29,073 epoch 53 - iter 88/226 - loss 1.68639470 - samples/sec: 126.79
2019-10-12 01:52:35,468 epoch 53 - iter 110/226 - loss 1.68813644 - samples/sec: 124.83
2019-10-12 01:52:42,515 epoch 53 - iter 132/226 - loss 1.68938408 - samples/sec: 124.54
2019-10-12 01:52:49,165 epoch 53 - iter 154/226 - loss 1.69506237 - samples/sec: 120.09
2019-10-12 01:52:55,986 epoch 53 - iter 176/226 - loss 1.71485046 - samples/sec: 118.47
2019-10-12 01:53:02,627 epoch 53 - iter 198/226 - loss 1.70926923 - samples/sec: 119.58
2019-10-12 01:53:09,266 epoch 53 - iter 220/226 - loss 1.71000643 - samples/sec: 119.64
2019-10-12 01:53:11,181 ----------------------------------------------------------------------------------------------------
2019-10-12 01:53:11,181 EPOCH 53 done: loss 1.7075 - lr 0.0500
2019-10-12 01:53:21,896 DEV : loss 2.538449764251709 - score 0.8489
2019-10-12 01:53:21,907 BAD EPOCHS (no improvement): 0
2019-10-12 01:53:29,424 ----------------------------------------------------------------------------------------------------
2019-10-12 01:53:29,781 epoch 54 - iter 0/226 - loss 1.98077154 - samples/sec: 1977.81
2019-10-12 01:53:36,431 epoch 54 - iter 22/226 - loss 1.57970265 - samples/sec: 119.45
2019-10-12 01:53:43,428 epoch 54 - iter 44/226 - loss 1.70669785 - samples/sec: 113.05
2019-10-12 01:53:50,745 epoch 54 - iter 66/226 - loss 1.76653473 - samples/sec: 108.33
2019-10-12 01:53:57,260 epoch 54 - iter 88/226 - loss 1.72013005 - samples/sec: 122.17
2019-10-12 01:54:04,080 epoch 54 - iter 110/226 - loss 1.68878884 - samples/sec: 116.11
2019-10-12 01:54:10,826 epoch 54 - iter 132/226 - loss 1.68198639 - samples/sec: 117.03
2019-10-12 01:54:17,289 epoch 54 - iter 154/226 - loss 1.68252366 - samples/sec: 123.26
2019-10-12 01:54:23,859 epoch 54 - iter 176/226 - loss 1.68720056 - samples/sec: 121.47
2019-10-12 01:54:30,327 epoch 54 - iter 198/226 - loss 1.68708408 - samples/sec: 122.95
2019-10-12 01:54:36,479 epoch 54 - iter 220/226 - loss 1.68852039 - samples/sec: 130.06
2019-10-12 01:54:38,405 ----------------------------------------------------------------------------------------------------
2019-10-12 01:54:38,406 EPOCH 54 done: loss 1.6859 - lr 0.0500
2019-10-12 01:54:49,097 DEV : loss 2.5151426792144775 - score 0.8446
2019-10-12 01:54:49,108 BAD EPOCHS (no improvement): 1
2019-10-12 01:54:49,112 ----------------------------------------------------------------------------------------------------
2019-10-12 01:54:49,412 epoch 55 - iter 0/226 - loss 1.82159328 - samples/sec: 2354.24
2019-10-12 01:54:56,160 epoch 55 - iter 22/226 - loss 1.74465314 - samples/sec: 117.15
2019-10-12 01:55:02,976 epoch 55 - iter 44/226 - loss 1.67835045 - samples/sec: 115.66
2019-10-12 01:55:09,656 epoch 55 - iter 66/226 - loss 1.65007618 - samples/sec: 118.22
2019-10-12 01:55:16,001 epoch 55 - iter 88/226 - loss 1.68207259 - samples/sec: 125.51
2019-10-12 01:55:25,494 epoch 55 - iter 110/226 - loss 1.68590225 - samples/sec: 122.25
2019-10-12 01:55:32,761 epoch 55 - iter 132/226 - loss 1.68408137 - samples/sec: 108.09
2019-10-12 01:55:39,037 epoch 55 - iter 154/226 - loss 1.69937399 - samples/sec: 127.43
2019-10-12 01:55:45,541 epoch 55 - iter 176/226 - loss 1.70047821 - samples/sec: 122.14
2019-10-12 01:55:52,224 epoch 55 - iter 198/226 - loss 1.69951942 - samples/sec: 118.24
2019-10-12 01:55:58,629 epoch 55 - iter 220/226 - loss 1.70284662 - samples/sec: 124.18
2019-10-12 01:56:00,740 ----------------------------------------------------------------------------------------------------
2019-10-12 01:56:00,740 EPOCH 55 done: loss 1.7061 - lr 0.0500
2019-10-12 01:56:11,525 DEV : loss 2.5231926441192627 - score 0.8449
2019-10-12 01:56:11,534 BAD EPOCHS (no improvement): 2
2019-10-12 01:56:11,540 ----------------------------------------------------------------------------------------------------
2019-10-12 01:56:11,891 epoch 56 - iter 0/226 - loss 1.56889224 - samples/sec: 2011.80
2019-10-12 01:56:18,671 epoch 56 - iter 22/226 - loss 1.66012046 - samples/sec: 116.51
2019-10-12 01:56:25,180 epoch 56 - iter 44/226 - loss 1.60880589 - samples/sec: 122.28
2019-10-12 01:56:31,428 epoch 56 - iter 66/226 - loss 1.61610349 - samples/sec: 127.44
2019-10-12 01:56:37,837 epoch 56 - iter 88/226 - loss 1.65020852 - samples/sec: 124.72
2019-10-12 01:56:45,091 epoch 56 - iter 110/226 - loss 1.66594947 - samples/sec: 108.12
2019-10-12 01:56:51,823 epoch 56 - iter 132/226 - loss 1.65584904 - samples/sec: 117.65
2019-10-12 01:56:58,376 epoch 56 - iter 154/226 - loss 1.64843552 - samples/sec: 121.81
2019-10-12 01:57:05,595 epoch 56 - iter 176/226 - loss 1.64203344 - samples/sec: 116.06
2019-10-12 01:57:12,267 epoch 56 - iter 198/226 - loss 1.63176677 - samples/sec: 120.79
2019-10-12 01:57:19,088 epoch 56 - iter 220/226 - loss 1.63986358 - samples/sec: 117.23
2019-10-12 01:57:21,075 ----------------------------------------------------------------------------------------------------
2019-10-12 01:57:21,076 EPOCH 56 done: loss 1.6364 - lr 0.0500
2019-10-12 01:57:31,900 DEV : loss 2.574173927307129 - score 0.8457
2019-10-12 01:57:31,909 BAD EPOCHS (no improvement): 3
2019-10-12 01:57:31,914 ----------------------------------------------------------------------------------------------------
2019-10-12 01:57:32,179 epoch 57 - iter 0/226 - loss 1.64855266 - samples/sec: 2663.77
2019-10-12 01:57:38,936 epoch 57 - iter 22/226 - loss 1.52413173 - samples/sec: 117.51
2019-10-12 01:57:45,444 epoch 57 - iter 44/226 - loss 1.54011998 - samples/sec: 122.74
2019-10-12 01:57:51,833 epoch 57 - iter 66/226 - loss 1.55617044 - samples/sec: 125.08
2019-10-12 01:57:58,677 epoch 57 - iter 88/226 - loss 1.57718783 - samples/sec: 115.83
2019-10-12 01:58:05,243 epoch 57 - iter 110/226 - loss 1.60818736 - samples/sec: 121.78
2019-10-12 01:58:12,184 epoch 57 - iter 132/226 - loss 1.60785161 - samples/sec: 114.18
2019-10-12 01:58:18,802 epoch 57 - iter 154/226 - loss 1.62707182 - samples/sec: 120.49
2019-10-12 01:58:25,356 epoch 57 - iter 176/226 - loss 1.63691257 - samples/sec: 123.40
2019-10-12 01:58:32,340 epoch 57 - iter 198/226 - loss 1.65206471 - samples/sec: 113.03
2019-10-12 01:58:38,852 epoch 57 - iter 220/226 - loss 1.63382705 - samples/sec: 122.21
2019-10-12 01:58:40,718 ----------------------------------------------------------------------------------------------------
2019-10-12 01:58:40,719 EPOCH 57 done: loss 1.6334 - lr 0.0500
2019-10-12 01:58:51,420 DEV : loss 2.574428081512451 - score 0.8441
2019-10-12 01:58:51,430 BAD EPOCHS (no improvement): 4
2019-10-12 01:58:51,438 ----------------------------------------------------------------------------------------------------
2019-10-12 01:58:51,853 epoch 58 - iter 0/226 - loss 2.43032503 - samples/sec: 1699.33
2019-10-12 01:58:58,609 epoch 58 - iter 22/226 - loss 1.62223162 - samples/sec: 118.44
2019-10-12 01:59:05,099 epoch 58 - iter 44/226 - loss 1.61801639 - samples/sec: 124.32
2019-10-12 01:59:11,316 epoch 58 - iter 66/226 - loss 1.61346332 - samples/sec: 129.05
2019-10-12 01:59:17,884 epoch 58 - iter 88/226 - loss 1.60053590 - samples/sec: 121.49
2019-10-12 01:59:24,515 epoch 58 - iter 110/226 - loss 1.58965123 - samples/sec: 119.63
2019-10-12 01:59:31,332 epoch 58 - iter 132/226 - loss 1.58395253 - samples/sec: 116.10
2019-10-12 01:59:38,041 epoch 58 - iter 154/226 - loss 1.57429096 - samples/sec: 118.73
2019-10-12 01:59:44,918 epoch 58 - iter 176/226 - loss 1.57799092 - samples/sec: 114.93
2019-10-12 01:59:51,589 epoch 58 - iter 198/226 - loss 1.58714920 - samples/sec: 119.05
2019-10-12 01:59:58,579 epoch 58 - iter 220/226 - loss 1.59530113 - samples/sec: 112.83
2019-10-12 02:00:00,507 ----------------------------------------------------------------------------------------------------
2019-10-12 02:00:00,508 EPOCH 58 done: loss 1.5950 - lr 0.0500
2019-10-12 02:00:11,280 DEV : loss 2.5544402599334717 - score 0.8419
2019-10-12 02:00:11,289 BAD EPOCHS (no improvement): 5
2019-10-12 02:00:11,294 ----------------------------------------------------------------------------------------------------
2019-10-12 02:00:11,627 epoch 59 - iter 0/226 - loss 1.02749884 - samples/sec: 2120.28
2019-10-12 02:00:18,412 epoch 59 - iter 22/226 - loss 1.61596539 - samples/sec: 117.39
2019-10-12 02:00:25,138 epoch 59 - iter 44/226 - loss 1.56642955 - samples/sec: 118.52
2019-10-12 02:00:32,062 epoch 59 - iter 66/226 - loss 1.55715707 - samples/sec: 114.30
2019-10-12 02:00:38,694 epoch 59 - iter 88/226 - loss 1.56508459 - samples/sec: 119.92
2019-10-12 02:00:45,067 epoch 59 - iter 110/226 - loss 1.58636344 - samples/sec: 126.12
2019-10-12 02:00:51,501 epoch 59 - iter 132/226 - loss 1.60641617 - samples/sec: 125.56
2019-10-12 02:00:58,114 epoch 59 - iter 154/226 - loss 1.60114059 - samples/sec: 121.79
2019-10-12 02:01:05,142 epoch 59 - iter 176/226 - loss 1.61399038 - samples/sec: 112.94
2019-10-12 02:01:11,881 epoch 59 - iter 198/226 - loss 1.60510869 - samples/sec: 118.64
2019-10-12 02:01:18,444 epoch 59 - iter 220/226 - loss 1.61462284 - samples/sec: 123.64
2019-10-12 02:01:20,514 ----------------------------------------------------------------------------------------------------
2019-10-12 02:01:20,516 EPOCH 59 done: loss 1.6078 - lr 0.0500
2019-10-12 02:01:31,390 DEV : loss 2.5544328689575195 - score 0.8394
Epoch 58: reducing learning rate of group 0 to 2.5000e-02.
2019-10-12 02:01:31,401 BAD EPOCHS (no improvement): 6
2019-10-12 02:01:31,407 ----------------------------------------------------------------------------------------------------
2019-10-12 02:01:31,700 epoch 60 - iter 0/226 - loss 1.61112428 - samples/sec: 2405.33