-
Notifications
You must be signed in to change notification settings - Fork 0
/
nohup.out
8045 lines (8019 loc) · 725 KB
/
nohup.out
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Creating csv
INFO:absl:force process is set to be true
INFO:absl:Processing the thchs30 subset train in /data/thchs30/data_thchs30
INFO:absl:Processing audio and transcript for train
INFO:absl:Successfully generated csv file examples/asr/thchs30/data/train.csv
INFO:absl:Finished processing thchs30 subset train
INFO:absl:force process is set to be true
INFO:absl:Processing the thchs30 subset dev in /data/thchs30/data_thchs30
INFO:absl:Processing audio and transcript for dev
INFO:absl:Successfully generated csv file examples/asr/thchs30/data/dev.csv
INFO:absl:Finished processing thchs30 subset dev
INFO:absl:force process is set to be true
INFO:absl:Processing the thchs30 subset test in /data/thchs30/data_thchs30
INFO:absl:Processing audio and transcript for test
INFO:absl:Successfully generated csv file examples/asr/thchs30/data/test.csv
INFO:absl:Finished processing thchs30 subset test
Prepare vocab
2667
Finished created vocab
Computing cmvn
INFO:absl:hparams: [('batch_size', 8), ('ckpt', 'examples/asr/thchs30/ckpts/mpc'), ('cls', 'main'), ('dataset_builder', 'speech_dataset'), ('decode_config', None), ('devset_config', {'data_csv': 'examples/asr/thchs30/data/dev.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'input_length_range': [10, 15000]}), ('model', 'mpc'), ('model_config', {'return_encoder_output': False, 'num_filters': 512, 'd_model': 512, 'num_heads': 8, 'num_encoder_layers': 12, 'dff': 1280, 'rate': 0.1, 'chunk_size': 1, 'keep_probability': 0.8}), ('num_classes', 40), ('num_data_threads', 1), ('num_epochs', 50), ('optimizer', 'warmup_adam'), ('optimizer_config', {'d_model': 512, 'warmup_steps': 2000, 'k': 0.3}), ('pretrained_model', None), ('solver_config', {'clip_norm': 100, 'log_interval': 10, 'enable_tf_function': True}), ('solver_gpu', [0]), ('sorta_epoch', 5), ('summary_dir', 'examples/asr/thchs30/ckpts/mpc/event'), ('testset_config', {'data_csv': 'examples/asr/thchs30/data/test.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'input_length_range': [10, 15000]}), ('trainset_config', {'data_csv': 'examples/asr/thchs30/data/train.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'input_length_range': [10, 15000]})]
INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_set.SpeechDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/train.csv'), ('input_length_range', [10, 15000])]
INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
INFO:absl:Loading data from examples/asr/thchs30/data/train.csv
INFO:absl:Loading data from examples/asr/thchs30/data/all.csv
Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
Fine-tuning
[1,1]<stderr>:INFO:absl:hparams: [('batch_size', 8), ('ckpt', 'examples/asr/thchs30/ckpts/mtl_transformer_ctc/'), ('cls', 'main'), ('dataset_builder', 'speech_recognition_dataset'), ('decode_config', {'beam_search': True, 'beam_size': 10, 'ctc_weight': 0.5, 'lm_weight': 0.7, 'lm_type': 'rnn', 'lm_path': 'examples/asr/thchs30/configs/rnnlm.json'}), ('devset_config', {'data_csv': 'examples/asr/thchs30/data/dev.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000]}), ('model', 'mtl_transformer_ctc'), ('model_config', {'model': 'speech_transformer', 'model_config': {'return_encoder_output': True, 'num_filters': 512, 'd_model': 512, 'num_heads': 8, 'num_encoder_layers': 4, 'num_decoder_layers': 2, 'dff': 1280, 'rate': 0.1, 'label_smoothing_rate': 0.0, 'schedual_sampling_rate': 0.9}, 'mtl_weight': 0.5}), ('num_classes', None), ('num_data_threads', 1), ('num_epochs', 5), ('optimizer', 'warmup_adam'), ('optimizer_config', {'d_model': 512, 'warmup_steps': 25000, 'k': 1.0, 'decay_steps': 100000000, 'decay_rate': 0.1}), ('pretrained_model', None), ('solver_config', {'clip_norm': 100, 'log_interval': 10, 'enable_tf_function': True}), ('solver_gpu', [1]), ('sorta_epoch', 1), ('summary_dir', 'examples/asr/thchs30/ckpts/mtl_transformer_ctc/event'), ('testset_config', {'data_csv': 'examples/asr/thchs30/data/test.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000]}), ('trainset_config', {'data_csv': 'examples/asr/thchs30/data/train.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000], 'speed_permutation': [0.9, 1.0, 1.1]})]
[1,0]<stderr>:INFO:absl:hparams: [('batch_size', 8), ('ckpt', 'examples/asr/thchs30/ckpts/mtl_transformer_ctc/'), ('cls', 'main'), ('dataset_builder', 'speech_recognition_dataset'), ('decode_config', {'beam_search': True, 'beam_size': 10, 'ctc_weight': 0.5, 'lm_weight': 0.7, 'lm_type': 'rnn', 'lm_path': 'examples/asr/thchs30/configs/rnnlm.json'}), ('devset_config', {'data_csv': 'examples/asr/thchs30/data/dev.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000]}), ('model', 'mtl_transformer_ctc'), ('model_config', {'model': 'speech_transformer', 'model_config': {'return_encoder_output': True, 'num_filters': 512, 'd_model': 512, 'num_heads': 8, 'num_encoder_layers': 4, 'num_decoder_layers': 2, 'dff': 1280, 'rate': 0.1, 'label_smoothing_rate': 0.0, 'schedual_sampling_rate': 0.9}, 'mtl_weight': 0.5}), ('num_classes', None), ('num_data_threads', 1), ('num_epochs', 5), ('optimizer', 'warmup_adam'), ('optimizer_config', {'d_model': 512, 'warmup_steps': 25000, 'k': 1.0, 'decay_steps': 100000000, 'decay_rate': 0.1}), ('pretrained_model', None), ('solver_config', {'clip_norm': 100, 'log_interval': 10, 'enable_tf_function': True}), ('solver_gpu', [1]), ('sorta_epoch', 1), ('summary_dir', 'examples/asr/thchs30/ckpts/mtl_transformer_ctc/event'), ('testset_config', {'data_csv': 'examples/asr/thchs30/data/test.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000]}), ('trainset_config', {'data_csv': 'examples/asr/thchs30/data/train.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000], 'speed_permutation': [0.9, 1.0, 1.1]})]
[1,1]<stderr>:2020-04-11 13:33:53.001849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1
[1,0]<stderr>:2020-04-11 13:33:53.001937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1
[1,1]<stderr>:2020-04-11 13:33:53.825203: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:53.825210: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:53.826362: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
[1,1]<stderr>:name: Tesla V100-PCIE-16GB major: 7 minor: 0 memoryClockRate(GHz): 1.38
[1,1]<stderr>:pciBusID: 0000:04:01.0
[1,0]<stderr>:2020-04-11 13:33:53.826388: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
[1,0]<stderr>:name: Tesla V100-PCIE-16GB major: 7 minor: 0 memoryClockRate(GHz): 1.38
[1,0]<stderr>:pciBusID: 0000:04:01.0
[1,1]<stderr>:2020-04-11 13:33:53.826454: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:53.826490: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:53.827510: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 1 with properties:
[1,1]<stderr>:name: Tesla V100-PCIE-16GB major: 7 minor: 0 memoryClockRate(GHz): 1.38
[1,1]<stderr>:pciBusID: 0000:04:02.0
[1,0]<stderr>:2020-04-11 13:33:53.827561: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 1 with properties:
[1,0]<stderr>:name: Tesla V100-PCIE-16GB major: 7 minor: 0 memoryClockRate(GHz): 1.38
[1,0]<stderr>:pciBusID: 0000:04:02.0
[1,1]<stderr>:2020-04-11 13:33:53.827843: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.0
[1,0]<stderr>:2020-04-11 13:33:53.827923: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.0
[1,1]<stderr>:2020-04-11 13:33:53.829343: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10.0
[1,0]<stderr>:2020-04-11 13:33:53.829556: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10.0
[1,1]<stderr>:2020-04-11 13:33:53.830748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10.0
[1,0]<stderr>:2020-04-11 13:33:53.831019: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10.0
[1,1]<stderr>:2020-04-11 13:33:53.831079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10.0
[1,0]<stderr>:2020-04-11 13:33:53.831376: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10.0
[1,1]<stderr>:2020-04-11 13:33:53.832812: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10.0
[1,0]<stderr>:2020-04-11 13:33:53.833170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10.0
[1,1]<stderr>:2020-04-11 13:33:53.834089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10.0
[1,0]<stderr>:2020-04-11 13:33:53.834518: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10.0
[1,1]<stderr>:2020-04-11 13:33:53.838685: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7
[1,1]<stderr>:2020-04-11 13:33:53.838838: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:53.839327: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:53.839414: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7
[1,0]<stderr>:2020-04-11 13:33:53.839575: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:53.840226: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:53.840466: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:53.841237: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:53.841442: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:53.842173: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0, 1
[1,0]<stderr>:2020-04-11 13:33:53.842331: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:53.842778: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0, 1
[1,1]<stderr>:INFO:absl:hparams: [('batch_size', 8), ('ckpt', 'examples/asr/thchs30/ckpts/mtl_transformer_ctc/'), ('cls', 'main'), ('dataset_builder', 'speech_recognition_dataset'), ('decode_config', {'beam_search': True, 'beam_size': 10, 'ctc_weight': 0.5, 'lm_weight': 0.7, 'lm_type': 'rnn', 'lm_path': 'examples/asr/thchs30/configs/rnnlm.json'}), ('devset_config', {'data_csv': 'examples/asr/thchs30/data/dev.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000]}), ('model', 'mtl_transformer_ctc'), ('model_config', {'model': 'speech_transformer', 'model_config': {'return_encoder_output': True, 'num_filters': 512, 'd_model': 512, 'num_heads': 8, 'num_encoder_layers': 4, 'num_decoder_layers': 2, 'dff': 1280, 'rate': 0.1, 'label_smoothing_rate': 0.0, 'schedual_sampling_rate': 0.9}, 'mtl_weight': 0.5}), ('num_classes', None), ('num_data_threads', 1), ('num_epochs', 5), ('optimizer', 'warmup_adam'), ('optimizer_config', {'d_model': 512, 'warmup_steps': 25000, 'k': 1.0, 'decay_steps': 100000000, 'decay_rate': 0.1}), ('pretrained_model', None), ('solver_config', {'clip_norm': 100, 'log_interval': 10, 'enable_tf_function': True}), ('solver_gpu', [1]), ('sorta_epoch', 1), ('summary_dir', 'examples/asr/thchs30/ckpts/mtl_transformer_ctc/event'), ('testset_config', {'data_csv': 'examples/asr/thchs30/data/test.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000]}), ('trainset_config', {'data_csv': 'examples/asr/thchs30/data/train.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000], 'speed_permutation': [0.9, 1.0, 1.1]})]
[1,1]<stderr>:INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_recognition.SpeechRecognitionDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/train.csv'), ('input_length_range', [10, 15000]), ('output_length_range', [1, 10000]), ('remove_unk', True), ('speed_permutation', [0.9, 1.0, 1.1]), ('text_config', {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'})]
[1,1]<stdout>:Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
[1,0]<stderr>:INFO:absl:hparams: [('batch_size', 8), ('ckpt', 'examples/asr/thchs30/ckpts/mtl_transformer_ctc/'), ('cls', 'main'), ('dataset_builder', 'speech_recognition_dataset'), ('decode_config', {'beam_search': True, 'beam_size': 10, 'ctc_weight': 0.5, 'lm_weight': 0.7, 'lm_type': 'rnn', 'lm_path': 'examples/asr/thchs30/configs/rnnlm.json'}), ('devset_config', {'data_csv': 'examples/asr/thchs30/data/dev.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000]}), ('model', 'mtl_transformer_ctc'), ('model_config', {'model': 'speech_transformer', 'model_config': {'return_encoder_output': True, 'num_filters': 512, 'd_model': 512, 'num_heads': 8, 'num_encoder_layers': 4, 'num_decoder_layers': 2, 'dff': 1280, 'rate': 0.1, 'label_smoothing_rate': 0.0, 'schedual_sampling_rate': 0.9}, 'mtl_weight': 0.5}), ('num_classes', None), ('num_data_threads', 1), ('num_epochs', 5), ('optimizer', 'warmup_adam'), ('optimizer_config', {'d_model': 512, 'warmup_steps': 25000, 'k': 1.0, 'decay_steps': 100000000, 'decay_rate': 0.1}), ('pretrained_model', None), ('solver_config', {'clip_norm': 100, 'log_interval': 10, 'enable_tf_function': True}), ('solver_gpu', [1]), ('sorta_epoch', 1), ('summary_dir', 'examples/asr/thchs30/ckpts/mtl_transformer_ctc/event'), ('testset_config', {'data_csv': 'examples/asr/thchs30/data/test.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000]}), ('trainset_config', {'data_csv': 'examples/asr/thchs30/data/train.csv', 'audio_config': {'type': 'Fbank', 'filterbank_channel_count': 40}, 'cmvn_file': 'examples/asr/thchs30/data/cmvn', 'text_config': {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'}, 'input_length_range': [10, 15000], 'speed_permutation': [0.9, 1.0, 1.1]})]
[1,0]<stderr>:INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_recognition.SpeechRecognitionDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/train.csv'), ('input_length_range', [10, 15000]), ('output_length_range', [1, 10000]), ('remove_unk', True), ('speed_permutation', [0.9, 1.0, 1.1]), ('text_config', {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'})]
[1,0]<stdout>:Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
[1,1]<stderr>:INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
[1,0]<stderr>:INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
[1,1]<stderr>:INFO:absl:Loading data from examples/asr/thchs30/data/train.csv
[1,0]<stderr>:INFO:absl:Loading data from examples/asr/thchs30/data/train.csv
[1,1]<stderr>:INFO:absl:perform speed permutation
[1,0]<stderr>:INFO:absl:perform speed permutation
[1,1]<stdout>:before filter by unk:30000
[1,0]<stdout>:before filter by unk:30000
[1,1]<stdout>:after filter by unk:30000
[1,1]<stdout>:afiter filter by input length:29938
[1,0]<stdout>:after filter by unk:30000
[1,1]<stdout>:after filter by output length:29938
[1,1]<stderr>:2020-04-11 13:33:54.245090: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 AVX512F FMA
[1,1]<stderr>:2020-04-11 13:33:54.253184: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2294605000 Hz
[1,0]<stdout>:afiter filter by input length:29938
[1,1]<stderr>:2020-04-11 13:33:54.254058: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x55dd31024360 executing computations on platform Host. Devices:
[1,1]<stderr>:2020-04-11 13:33:54.254086: I tensorflow/compiler/xla/service/service.cc:175] StreamExecutor device (0): Host, Default Version
[1,0]<stdout>:after filter by output length:29938
[1,0]<stderr>:2020-04-11 13:33:54.272447: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 AVX512F FMA
[1,0]<stderr>:2020-04-11 13:33:54.280571: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2294605000 Hz
[1,0]<stderr>:2020-04-11 13:33:54.281457: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x55a11798d360 executing computations on platform Host. Devices:
[1,0]<stderr>:2020-04-11 13:33:54.281485: I tensorflow/compiler/xla/service/service.cc:175] StreamExecutor device (0): Host, Default Version
[1,1]<stderr>:2020-04-11 13:33:54.481296: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:54.482032: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x55dd310674d0 executing computations on platform CUDA. Devices:
[1,1]<stderr>:2020-04-11 13:33:54.482073: I tensorflow/compiler/xla/service/service.cc:175] StreamExecutor device (0): Tesla V100-PCIE-16GB, Compute Capability 7.0
[1,1]<stderr>:2020-04-11 13:33:54.482349: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:54.482800: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
[1,1]<stderr>:name: Tesla V100-PCIE-16GB major: 7 minor: 0 memoryClockRate(GHz): 1.38
[1,1]<stderr>:pciBusID: 0000:04:02.0
[1,1]<stderr>:2020-04-11 13:33:54.482875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.0
[1,1]<stderr>:2020-04-11 13:33:54.482894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10.0
[1,1]<stderr>:2020-04-11 13:33:54.482905: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10.0
[1,1]<stderr>:2020-04-11 13:33:54.482920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10.0
[1,1]<stderr>:2020-04-11 13:33:54.482931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10.0
[1,1]<stderr>:2020-04-11 13:33:54.482943: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10.0
[1,1]<stderr>:2020-04-11 13:33:54.482954: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7
[1,1]<stderr>:2020-04-11 13:33:54.483000: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:54.483466: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:54.483867: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 1
[1,1]<stderr>:2020-04-11 13:33:54.483988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.0
[1,1]<stderr>:2020-04-11 13:33:54.485594: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1159] Device interconnect StreamExecutor with strength 1 edge matrix:
[1,1]<stderr>:2020-04-11 13:33:54.485617: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1165] 1
[1,1]<stderr>:2020-04-11 13:33:54.485623: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 1: N
[1,1]<stderr>:2020-04-11 13:33:54.485907: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:54.486347: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,1]<stderr>:2020-04-11 13:33:54.486783: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14926 MB memory) -> physical GPU (device: 1, name: Tesla V100-PCIE-16GB, pci bus id: 0000:04:02.0, compute capability: 7.0)
[1,0]<stderr>:2020-04-11 13:33:54.514181: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:54.514912: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x55a1179d04d0 executing computations on platform CUDA. Devices:
[1,0]<stderr>:2020-04-11 13:33:54.514944: I tensorflow/compiler/xla/service/service.cc:175] StreamExecutor device (0): Tesla V100-PCIE-16GB, Compute Capability 7.0
[1,0]<stderr>:2020-04-11 13:33:54.515218: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:54.515930: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
[1,0]<stderr>:name: Tesla V100-PCIE-16GB major: 7 minor: 0 memoryClockRate(GHz): 1.38
[1,0]<stderr>:pciBusID: 0000:04:01.0
[1,0]<stderr>:2020-04-11 13:33:54.516004: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.0
[1,0]<stderr>:2020-04-11 13:33:54.516023: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10.0
[1,0]<stderr>:2020-04-11 13:33:54.516035: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10.0
[1,0]<stderr>:2020-04-11 13:33:54.516048: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10.0
[1,0]<stderr>:2020-04-11 13:33:54.516059: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10.0
[1,0]<stderr>:2020-04-11 13:33:54.516071: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10.0
[1,0]<stderr>:2020-04-11 13:33:54.516083: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7
[1,0]<stderr>:2020-04-11 13:33:54.516142: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:54.516636: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:54.517078: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0
[1,0]<stderr>:2020-04-11 13:33:54.517146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.0
[1,0]<stderr>:2020-04-11 13:33:54.518842: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1159] Device interconnect StreamExecutor with strength 1 edge matrix:
[1,0]<stderr>:2020-04-11 13:33:54.518864: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1165] 0
[1,0]<stderr>:2020-04-11 13:33:54.518871: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 0: N
[1,0]<stderr>:2020-04-11 13:33:54.519177: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:54.519648: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1006] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
[1,0]<stderr>:2020-04-11 13:33:54.520100: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14926 MB memory) -> physical GPU (device: 0, name: Tesla V100-PCIE-16GB, pci bus id: 0000:04:01.0, compute capability: 7.0)
[1,1]<stdout>:Model: "x_net"
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:Layer (type) Output Shape Param #
[1,1]<stdout>:=================================================================
[1,1]<stdout>:input_1 (InputLayer) [(None, None, 40, 1)] 0
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:conv2d (Conv2D) (None, None, 20, 512) 4608
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:batch_normalization (BatchNo (None, None, 20, 512) 2048
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:tf_op_layer_Relu6 (TensorFlo [(None, None, 20, 512)] 0
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:conv2d_1 (Conv2D) (None, None, 10, 512) 2359296
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:batch_normalization_1 (Batch (None, None, 10, 512) 2048
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:tf_op_layer_Relu6_1 (TensorF [(None, None, 10, 512)] 0
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:reshape (Reshape) (None, None, 5120) 0
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:dense (Dense) (None, None, 512) 2621952
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:positional_encoding (Positio (None, None, 512) 0
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:dropout (Dropout) (None, None, 512) 0
[1,1]<stdout>:=================================================================
[1,1]<stdout>:Total params: 4,989,952
[1,1]<stdout>:Trainable params: 4,987,904
[1,1]<stdout>:Non-trainable params: 2,048
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:None
[1,1]<stdout>:Model: "y_net"
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:Layer (type) Output Shape Param #
[1,1]<stdout>:=================================================================
[1,1]<stdout>:input_2 (InputLayer) [(None, None)] 0
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:embedding (Embedding) (None, None, 512) 1366016
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:positional_encoding_1 (Posit (None, None, 512) 0
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:dropout_1 (Dropout) (None, None, 512) 0
[1,1]<stdout>:=================================================================
[1,1]<stdout>:Total params: 1,366,016
[1,1]<stdout>:Trainable params: 1,366,016
[1,1]<stdout>:Non-trainable params: 0
[1,1]<stdout>:_________________________________________________________________
[1,1]<stdout>:None
[1,0]<stdout>:Model: "x_net"
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:Layer (type) Output Shape Param #
[1,0]<stdout>:=================================================================
[1,0]<stdout>:input_1 (InputLayer) [(None, None, 40, 1)] 0
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:conv2d (Conv2D) (None, None, 20, 512) 4608
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:batch_normalization (BatchNo (None, None, 20, 512) 2048
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:tf_op_layer_Relu6 (TensorFlo [(None, None, 20, 512)] 0
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:conv2d_1 (Conv2D) (None, None, 10, 512) 2359296
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:batch_normalization_1 (Batch (None, None, 10, 512) 2048
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:tf_op_layer_Relu6_1 (TensorF [(None, None, 10, 512)] 0
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:reshape (Reshape) (None, None, 5120) 0
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:dense (Dense) (None, None, 512) 2621952
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:positional_encoding (Positio (None, None, 512) 0
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:dropout (Dropout) (None, None, 512) 0
[1,0]<stdout>:=================================================================
[1,0]<stdout>:Total params: 4,989,952
[1,0]<stdout>:Trainable params: 4,987,904
[1,0]<stdout>:Non-trainable params: 2,048
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:None
[1,0]<stdout>:Model: "y_net"
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:Layer (type) Output Shape Param #
[1,0]<stdout>:=================================================================
[1,0]<stdout>:input_2 (InputLayer) [(None, None)] 0
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:embedding (Embedding) (None, None, 512) 1366016
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:positional_encoding_1 (Posit (None, None, 512) 0
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:dropout_1 (Dropout) (None, None, 512) 0
[1,0]<stdout>:=================================================================
[1,0]<stdout>:Total params: 1,366,016
[1,0]<stdout>:Trainable params: 1,366,016
[1,0]<stdout>:Non-trainable params: 0
[1,0]<stdout>:_________________________________________________________________
[1,0]<stdout>:None
[1,1]<stderr>:INFO:absl:trying to restore from : examples/asr/thchs30/ckpts/mtl_transformer_ctc/
[1,0]<stderr>:INFO:absl:trying to restore from : examples/asr/thchs30/ckpts/mtl_transformer_ctc/
[1,1]<stderr>:2020-04-11 13:33:56.898830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7
[1,0]<stderr>:2020-04-11 13:33:57.008113: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7
[1,1]<stderr>:2020-04-11 13:33:58.500720: W tensorflow/stream_executor/cuda/redzone_allocator.cc:312] Not found: ./bin/ptxas not found
[1,1]<stderr>:Relying on driver to perform ptx compilation. This message will be only logged once.
[1,0]<stderr>:2020-04-11 13:33:58.642987: W tensorflow/stream_executor/cuda/redzone_allocator.cc:312] Not found: ./bin/ptxas not found
[1,0]<stderr>:Relying on driver to perform ptx compilation. This message will be only logged once.
[1,1]<stderr>:2020-04-11 13:33:58.706447: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10.0
[1,0]<stderr>:2020-04-11 13:33:58.850155: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10.0
[1,1]<stderr>:WARNING:tensorflow:From /work20/luoxiaojie/anaconda3/envs/athena/lib/python3.7/site-packages/tensorflow_core/python/ops/ctc_ops.py:1154: alias_inplace_add (from tensorflow.python.ops.inplace_ops) is deprecated and will be removed in a future version.
[1,1]<stderr>:Instructions for updating:
[1,1]<stderr>:Prefer tf.tensor_scatter_nd_add, which offers the same functionality with well-defined read-write semantics.
[1,1]<stderr>:WARNING:tensorflow:From /work20/luoxiaojie/anaconda3/envs/athena/lib/python3.7/site-packages/tensorflow_core/python/ops/ctc_ops.py:1154: alias_inplace_add (from tensorflow.python.ops.inplace_ops) is deprecated and will be removed in a future version.
[1,1]<stderr>:Instructions for updating:
[1,1]<stderr>:Prefer tf.tensor_scatter_nd_add, which offers the same functionality with well-defined read-write semantics.
[1,1]<stderr>:WARNING:tensorflow:From /work20/luoxiaojie/anaconda3/envs/athena/lib/python3.7/site-packages/tensorflow_core/python/ops/ctc_ops.py:1137: alias_inplace_update (from tensorflow.python.ops.inplace_ops) is deprecated and will be removed in a future version.
[1,1]<stderr>:Instructions for updating:
[1,1]<stderr>:Prefer tf.tensor_scatter_nd_update, which offers the same functionality with well-defined read-write semantics.
[1,1]<stderr>:WARNING:tensorflow:From /work20/luoxiaojie/anaconda3/envs/athena/lib/python3.7/site-packages/tensorflow_core/python/ops/ctc_ops.py:1137: alias_inplace_update (from tensorflow.python.ops.inplace_ops) is deprecated and will be removed in a future version.
[1,1]<stderr>:Instructions for updating:
[1,1]<stderr>:Prefer tf.tensor_scatter_nd_update, which offers the same functionality with well-defined read-write semantics.
[1,0]<stderr>:WARNING:tensorflow:From /work20/luoxiaojie/anaconda3/envs/athena/lib/python3.7/site-packages/tensorflow_core/python/ops/ctc_ops.py:1154: alias_inplace_add (from tensorflow.python.ops.inplace_ops) is deprecated and will be removed in a future version.
[1,0]<stderr>:Instructions for updating:
[1,0]<stderr>:Prefer tf.tensor_scatter_nd_add, which offers the same functionality with well-defined read-write semantics.
[1,0]<stderr>:WARNING:tensorflow:From /work20/luoxiaojie/anaconda3/envs/athena/lib/python3.7/site-packages/tensorflow_core/python/ops/ctc_ops.py:1154: alias_inplace_add (from tensorflow.python.ops.inplace_ops) is deprecated and will be removed in a future version.
[1,0]<stderr>:Instructions for updating:
[1,0]<stderr>:Prefer tf.tensor_scatter_nd_add, which offers the same functionality with well-defined read-write semantics.
[1,0]<stderr>:WARNING:tensorflow:From /work20/luoxiaojie/anaconda3/envs/athena/lib/python3.7/site-packages/tensorflow_core/python/ops/ctc_ops.py:1137: alias_inplace_update (from tensorflow.python.ops.inplace_ops) is deprecated and will be removed in a future version.
[1,0]<stderr>:Instructions for updating:
[1,0]<stderr>:Prefer tf.tensor_scatter_nd_update, which offers the same functionality with well-defined read-write semantics.
[1,0]<stderr>:WARNING:tensorflow:From /work20/luoxiaojie/anaconda3/envs/athena/lib/python3.7/site-packages/tensorflow_core/python/ops/ctc_ops.py:1137: alias_inplace_update (from tensorflow.python.ops.inplace_ops) is deprecated and will be removed in a future version.
[1,0]<stderr>:Instructions for updating:
[1,0]<stderr>:Prefer tf.tensor_scatter_nd_update, which offers the same functionality with well-defined read-write semantics.
[1,1]<stderr>:INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_recognition.SpeechRecognitionDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/train.csv'), ('input_length_range', [10, 15000]), ('output_length_range', [1, 10000]), ('remove_unk', True), ('speed_permutation', [0.9, 1.0, 1.1]), ('text_config', {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'})]
[1,1]<stdout>:Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
[1,1]<stderr>:INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
[1,1]<stderr>:INFO:absl:Loading data from examples/asr/thchs30/data/train.csv
[1,1]<stderr>:INFO:absl:perform speed permutation
[1,1]<stdout>:before filter by unk:30000
[1,0]<stderr>:INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_recognition.SpeechRecognitionDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/train.csv'), ('input_length_range', [10, 15000]), ('output_length_range', [1, 10000]), ('remove_unk', True), ('speed_permutation', [0.9, 1.0, 1.1]), ('text_config', {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'})]
[1,0]<stdout>:Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
[1,0]<stderr>:INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
[1,0]<stderr>:INFO:absl:Loading data from examples/asr/thchs30/data/train.csv
[1,0]<stderr>:INFO:absl:perform speed permutation
[1,1]<stdout>:after filter by unk:30000
[1,1]<stdout>:afiter filter by input length:29938
[1,0]<stdout>:before filter by unk:30000
[1,1]<stdout>:after filter by output length:29938
[1,1]<stderr>:INFO:absl:Creates the sub-dataset which is the 1 part of 2
[1,1]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,0]<stdout>:after filter by unk:30000
[1,0]<stdout>:afiter filter by input length:29938
[1,0]<stdout>:after filter by output length:29938
[1,0]<stderr>:INFO:absl:Creates the sub-dataset which is the 0 part of 2
[1,0]<stderr>:INFO:absl:>>>>> start training in epoch 0
[1,0]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,1]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,1]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:INFO:absl:global_steps: 1 learning_rate: 1.1180e-08 loss: 490.6797 Accuracy: -0.1257 CTCAccuracy: -2.6467
[1,0]<stderr>:INFO:absl:global_steps: 11 learning_rate: 1.2298e-07 loss: 595.8782 Accuracy: -0.2329 CTCAccuracy: -4.3389 sec/iter: 0.5028
[1,0]<stderr>:INFO:absl:global_steps: 21 learning_rate: 2.3479e-07 loss: 630.7087 Accuracy: -0.2386 CTCAccuracy: -4.3845 sec/iter: 0.5142
[1,0]<stderr>:INFO:absl:global_steps: 31 learning_rate: 3.4659e-07 loss: 638.8725 Accuracy: -0.2290 CTCAccuracy: -4.3640 sec/iter: 0.4797
[1,0]<stderr>:INFO:absl:global_steps: 41 learning_rate: 4.5839e-07 loss: 658.1179 Accuracy: -0.2050 CTCAccuracy: -4.3898 sec/iter: 0.4868
[1,0]<stderr>:INFO:absl:global_steps: 51 learning_rate: 5.7020e-07 loss: 660.4971 Accuracy: -0.2180 CTCAccuracy: -4.2364 sec/iter: 0.4962
[1,0]<stderr>:INFO:absl:global_steps: 61 learning_rate: 6.8200e-07 loss: 651.3573 Accuracy: -0.2216 CTCAccuracy: -4.3592 sec/iter: 0.4591
[1,0]<stderr>:INFO:absl:global_steps: 71 learning_rate: 7.9380e-07 loss: 657.2463 Accuracy: -0.1685 CTCAccuracy: -4.2055 sec/iter: 0.5021
[1,0]<stderr>:INFO:absl:global_steps: 81 learning_rate: 9.0561e-07 loss: 632.5983 Accuracy: -0.2386 CTCAccuracy: -3.9271 sec/iter: 0.4743
[1,0]<stderr>:INFO:absl:global_steps: 91 learning_rate: 1.0174e-06 loss: 618.0977 Accuracy: -0.1982 CTCAccuracy: -3.0179 sec/iter: 0.4774
[1,0]<stderr>:INFO:absl:global_steps: 101 learning_rate: 1.1292e-06 loss: 598.3400 Accuracy: -0.2003 CTCAccuracy: -1.5036 sec/iter: 0.4794
[1,0]<stderr>:INFO:absl:global_steps: 111 learning_rate: 1.2410e-06 loss: 584.4299 Accuracy: -0.1900 CTCAccuracy: -0.0937 sec/iter: 0.4544
[1,0]<stderr>:INFO:absl:global_steps: 121 learning_rate: 1.3528e-06 loss: 561.0858 Accuracy: -0.1727 CTCAccuracy: 0.0009 sec/iter: 0.4655
[1,0]<stderr>:INFO:absl:global_steps: 131 learning_rate: 1.4646e-06 loss: 519.8975 Accuracy: -0.1511 CTCAccuracy: 0.0004 sec/iter: 0.4555
[1,0]<stderr>:INFO:absl:global_steps: 141 learning_rate: 1.5764e-06 loss: 492.4509 Accuracy: -0.1687 CTCAccuracy: 0.0000 sec/iter: 0.4419
[1,0]<stderr>:INFO:absl:global_steps: 151 learning_rate: 1.6882e-06 loss: 441.9607 Accuracy: -0.1815 CTCAccuracy: 0.0000 sec/iter: 0.4397
[1,0]<stderr>:INFO:absl:global_steps: 161 learning_rate: 1.8000e-06 loss: 395.7858 Accuracy: -0.1433 CTCAccuracy: 0.0000 sec/iter: 0.4881
[1,0]<stderr>:INFO:absl:global_steps: 171 learning_rate: 1.9118e-06 loss: 371.4866 Accuracy: -0.1160 CTCAccuracy: 0.0000 sec/iter: 0.4272
[1,0]<stderr>:INFO:absl:global_steps: 181 learning_rate: 2.0236e-06 loss: 332.8647 Accuracy: -0.0928 CTCAccuracy: 0.0000 sec/iter: 0.4766
[1,0]<stderr>:INFO:absl:global_steps: 191 learning_rate: 2.1354e-06 loss: 297.8533 Accuracy: -0.0441 CTCAccuracy: 0.0000 sec/iter: 0.4572
[1,0]<stderr>:INFO:absl:global_steps: 201 learning_rate: 2.2472e-06 loss: 252.7966 Accuracy: -0.0212 CTCAccuracy: 0.0000 sec/iter: 0.4745
[1,0]<stderr>:INFO:absl:global_steps: 211 learning_rate: 2.3591e-06 loss: 271.0056 Accuracy: 0.0025 CTCAccuracy: 0.0000 sec/iter: 0.4812
[1,0]<stderr>:INFO:absl:global_steps: 221 learning_rate: 2.4709e-06 loss: 258.8541 Accuracy: 0.0055 CTCAccuracy: 0.0000 sec/iter: 0.4553
[1,0]<stderr>:INFO:absl:global_steps: 231 learning_rate: 2.5827e-06 loss: 262.2883 Accuracy: 0.0021 CTCAccuracy: 0.0000 sec/iter: 0.4593
[1,0]<stderr>:INFO:absl:global_steps: 241 learning_rate: 2.6945e-06 loss: 231.9718 Accuracy: 0.0029 CTCAccuracy: 0.0000 sec/iter: 0.4678
[1,0]<stderr>:INFO:absl:global_steps: 251 learning_rate: 2.8063e-06 loss: 233.8736 Accuracy: 0.0032 CTCAccuracy: 0.0000 sec/iter: 0.4354
[1,0]<stderr>:INFO:absl:global_steps: 261 learning_rate: 2.9181e-06 loss: 228.1080 Accuracy: 0.0045 CTCAccuracy: 0.0000 sec/iter: 0.4853
[1,0]<stderr>:INFO:absl:global_steps: 271 learning_rate: 3.0299e-06 loss: 250.2985 Accuracy: 0.0021 CTCAccuracy: 0.0000 sec/iter: 0.4858
[1,0]<stderr>:INFO:absl:global_steps: 281 learning_rate: 3.1417e-06 loss: 250.2015 Accuracy: 0.0020 CTCAccuracy: 0.0000 sec/iter: 0.4449
[1,0]<stderr>:INFO:absl:global_steps: 291 learning_rate: 3.2535e-06 loss: 250.6580 Accuracy: 0.0033 CTCAccuracy: 0.0000 sec/iter: 0.4934
[1,0]<stderr>:INFO:absl:global_steps: 301 learning_rate: 3.3653e-06 loss: 243.2105 Accuracy: 0.0016 CTCAccuracy: 0.0000 sec/iter: 0.4406
[1,0]<stderr>:INFO:absl:global_steps: 311 learning_rate: 3.4771e-06 loss: 246.0518 Accuracy: 0.0033 CTCAccuracy: 0.0000 sec/iter: 0.4717
[1,0]<stderr>:INFO:absl:global_steps: 321 learning_rate: 3.5889e-06 loss: 242.8849 Accuracy: 0.0008 CTCAccuracy: 0.0000 sec/iter: 0.4503
[1,0]<stderr>:INFO:absl:global_steps: 331 learning_rate: 3.7007e-06 loss: 259.9458 Accuracy: 0.0025 CTCAccuracy: 0.0000 sec/iter: 0.4819
[1,0]<stderr>:INFO:absl:global_steps: 341 learning_rate: 3.8125e-06 loss: 227.0759 Accuracy: 0.0036 CTCAccuracy: 0.0000 sec/iter: 0.4566
[1,0]<stderr>:INFO:absl:global_steps: 351 learning_rate: 3.9243e-06 loss: 217.0035 Accuracy: 0.0029 CTCAccuracy: 0.0000 sec/iter: 0.4781
[1,0]<stderr>:INFO:absl:global_steps: 361 learning_rate: 4.0361e-06 loss: 249.4820 Accuracy: 0.0020 CTCAccuracy: 0.0000 sec/iter: 0.4526
[1,0]<stderr>:INFO:absl:global_steps: 371 learning_rate: 4.1479e-06 loss: 240.8152 Accuracy: 0.0041 CTCAccuracy: 0.0000 sec/iter: 0.4836
[1,0]<stderr>:INFO:absl:global_steps: 381 learning_rate: 4.2597e-06 loss: 231.1934 Accuracy: 0.0045 CTCAccuracy: 0.0000 sec/iter: 0.4794
[1,0]<stderr>:INFO:absl:global_steps: 391 learning_rate: 4.3715e-06 loss: 223.7789 Accuracy: 0.0045 CTCAccuracy: 0.0000 sec/iter: 0.4572
[1,0]<stderr>:INFO:absl:global_steps: 401 learning_rate: 4.4833e-06 loss: 230.8394 Accuracy: 0.0055 CTCAccuracy: 0.0000 sec/iter: 0.4846
[1,0]<stderr>:INFO:absl:global_steps: 411 learning_rate: 4.5951e-06 loss: 228.9979 Accuracy: 0.0100 CTCAccuracy: 0.0000 sec/iter: 0.4899
[1,0]<stderr>:INFO:absl:global_steps: 421 learning_rate: 4.7069e-06 loss: 246.9942 Accuracy: 0.0129 CTCAccuracy: 0.0000 sec/iter: 0.4618
[1,0]<stderr>:INFO:absl:global_steps: 431 learning_rate: 4.8187e-06 loss: 255.5003 Accuracy: 0.0128 CTCAccuracy: 0.0000 sec/iter: 0.4936
[1,0]<stderr>:INFO:absl:global_steps: 441 learning_rate: 4.9305e-06 loss: 236.4522 Accuracy: 0.0099 CTCAccuracy: 0.0000 sec/iter: 0.4619
[1,0]<stderr>:INFO:absl:global_steps: 451 learning_rate: 5.0423e-06 loss: 232.8975 Accuracy: 0.0158 CTCAccuracy: 0.0000 sec/iter: 0.4984
[1,0]<stderr>:INFO:absl:global_steps: 461 learning_rate: 5.1541e-06 loss: 245.2602 Accuracy: 0.0163 CTCAccuracy: 0.0000 sec/iter: 0.4423
[1,0]<stderr>:INFO:absl:global_steps: 471 learning_rate: 5.2659e-06 loss: 242.4409 Accuracy: 0.0169 CTCAccuracy: 0.0000 sec/iter: 0.5144
[1,0]<stderr>:INFO:absl:global_steps: 481 learning_rate: 5.3777e-06 loss: 219.3091 Accuracy: 0.0174 CTCAccuracy: 0.0000 sec/iter: 0.5015
[1,0]<stderr>:INFO:absl:global_steps: 491 learning_rate: 5.4895e-06 loss: 248.8687 Accuracy: 0.0172 CTCAccuracy: 0.0000 sec/iter: 0.4671
[1,0]<stderr>:INFO:absl:global_steps: 501 learning_rate: 5.6014e-06 loss: 217.8192 Accuracy: 0.0197 CTCAccuracy: 0.0000 sec/iter: 0.5253
[1,0]<stderr>:INFO:absl:global_steps: 511 learning_rate: 5.7132e-06 loss: 231.4157 Accuracy: 0.0184 CTCAccuracy: 0.0000 sec/iter: 0.4782
[1,0]<stderr>:INFO:absl:global_steps: 521 learning_rate: 5.8250e-06 loss: 205.0280 Accuracy: 0.0194 CTCAccuracy: 0.0000 sec/iter: 0.4395
[1,0]<stderr>:INFO:absl:global_steps: 531 learning_rate: 5.9368e-06 loss: 239.7010 Accuracy: 0.0179 CTCAccuracy: 0.0000 sec/iter: 0.5070
[1,0]<stderr>:INFO:absl:global_steps: 541 learning_rate: 6.0486e-06 loss: 236.4911 Accuracy: 0.0227 CTCAccuracy: 0.0000 sec/iter: 0.4801
[1,0]<stderr>:INFO:absl:global_steps: 551 learning_rate: 6.1604e-06 loss: 227.2326 Accuracy: 0.0208 CTCAccuracy: 0.0000 sec/iter: 0.5044
[1,0]<stderr>:INFO:absl:global_steps: 561 learning_rate: 6.2722e-06 loss: 237.4489 Accuracy: 0.0201 CTCAccuracy: 0.0000 sec/iter: 0.4786
[1,0]<stderr>:INFO:absl:global_steps: 571 learning_rate: 6.3840e-06 loss: 216.0550 Accuracy: 0.0229 CTCAccuracy: 0.0000 sec/iter: 0.5047
[1,0]<stderr>:INFO:absl:global_steps: 581 learning_rate: 6.4958e-06 loss: 234.2508 Accuracy: 0.0239 CTCAccuracy: 0.0000 sec/iter: 0.4822
[1,0]<stderr>:INFO:absl:global_steps: 591 learning_rate: 6.6076e-06 loss: 235.9646 Accuracy: 0.0275 CTCAccuracy: 0.0000 sec/iter: 0.4837
[1,0]<stderr>:INFO:absl:global_steps: 601 learning_rate: 6.7194e-06 loss: 229.2289 Accuracy: 0.0194 CTCAccuracy: 0.0000 sec/iter: 0.4767
[1,0]<stderr>:INFO:absl:global_steps: 611 learning_rate: 6.8312e-06 loss: 232.1783 Accuracy: 0.0235 CTCAccuracy: 0.0000 sec/iter: 0.4765
[1,0]<stderr>:INFO:absl:global_steps: 621 learning_rate: 6.9430e-06 loss: 234.8262 Accuracy: 0.0276 CTCAccuracy: 0.0000 sec/iter: 0.4800
[1,0]<stderr>:INFO:absl:global_steps: 631 learning_rate: 7.0548e-06 loss: 248.5632 Accuracy: 0.0246 CTCAccuracy: 0.0000 sec/iter: 0.5212
[1,0]<stderr>:INFO:absl:global_steps: 641 learning_rate: 7.1666e-06 loss: 231.2786 Accuracy: 0.0235 CTCAccuracy: 0.0000 sec/iter: 0.5075
[1,0]<stderr>:INFO:absl:global_steps: 651 learning_rate: 7.2784e-06 loss: 226.4317 Accuracy: 0.0279 CTCAccuracy: 0.0000 sec/iter: 0.4844
[1,0]<stderr>:INFO:absl:global_steps: 661 learning_rate: 7.3902e-06 loss: 230.0257 Accuracy: 0.0223 CTCAccuracy: 0.0000 sec/iter: 0.5193
[1,0]<stderr>:INFO:absl:global_steps: 671 learning_rate: 7.5020e-06 loss: 229.1916 Accuracy: 0.0291 CTCAccuracy: 0.0000 sec/iter: 0.4836
[1,0]<stderr>:INFO:absl:global_steps: 681 learning_rate: 7.6138e-06 loss: 242.6687 Accuracy: 0.0253 CTCAccuracy: 0.0000 sec/iter: 0.4852
[1,0]<stderr>:INFO:absl:global_steps: 691 learning_rate: 7.7256e-06 loss: 235.2162 Accuracy: 0.0250 CTCAccuracy: 0.0000 sec/iter: 0.4953
[1,0]<stderr>:INFO:absl:global_steps: 701 learning_rate: 7.8374e-06 loss: 222.4672 Accuracy: 0.0235 CTCAccuracy: 0.0000 sec/iter: 0.5196
[1,0]<stderr>:INFO:absl:global_steps: 711 learning_rate: 7.9492e-06 loss: 252.1208 Accuracy: 0.0224 CTCAccuracy: 0.0000 sec/iter: 0.4551
[1,0]<stderr>:INFO:absl:global_steps: 721 learning_rate: 8.0610e-06 loss: 240.2476 Accuracy: 0.0258 CTCAccuracy: 0.0000 sec/iter: 0.4970
[1,0]<stderr>:INFO:absl:global_steps: 731 learning_rate: 8.1728e-06 loss: 240.4703 Accuracy: 0.0238 CTCAccuracy: 0.0000 sec/iter: 0.5258
[1,0]<stderr>:INFO:absl:global_steps: 741 learning_rate: 8.2846e-06 loss: 238.9759 Accuracy: 0.0278 CTCAccuracy: 0.0000 sec/iter: 0.4581
[1,0]<stderr>:INFO:absl:global_steps: 751 learning_rate: 8.3964e-06 loss: 238.3183 Accuracy: 0.0265 CTCAccuracy: 0.0000 sec/iter: 0.5417
[1,0]<stderr>:INFO:absl:global_steps: 761 learning_rate: 8.5082e-06 loss: 234.8192 Accuracy: 0.0278 CTCAccuracy: 0.0000 sec/iter: 0.4903
[1,0]<stderr>:INFO:absl:global_steps: 771 learning_rate: 8.6200e-06 loss: 248.8189 Accuracy: 0.0205 CTCAccuracy: 0.0000 sec/iter: 0.4530
[1,0]<stderr>:INFO:absl:global_steps: 781 learning_rate: 8.7318e-06 loss: 232.2541 Accuracy: 0.0237 CTCAccuracy: 0.0000 sec/iter: 0.5368
[1,0]<stderr>:INFO:absl:global_steps: 791 learning_rate: 8.8436e-06 loss: 234.0222 Accuracy: 0.0225 CTCAccuracy: 0.0000 sec/iter: 0.4996
[1,0]<stderr>:INFO:absl:global_steps: 801 learning_rate: 8.9555e-06 loss: 246.6626 Accuracy: 0.0284 CTCAccuracy: 0.0000 sec/iter: 0.5020
[1,0]<stderr>:INFO:absl:global_steps: 811 learning_rate: 9.0673e-06 loss: 249.0392 Accuracy: 0.0272 CTCAccuracy: 0.0000 sec/iter: 0.5310
[1,0]<stderr>:INFO:absl:global_steps: 821 learning_rate: 9.1791e-06 loss: 231.8626 Accuracy: 0.0294 CTCAccuracy: 0.0000 sec/iter: 0.5038
[1,0]<stderr>:INFO:absl:global_steps: 831 learning_rate: 9.2909e-06 loss: 241.6360 Accuracy: 0.0235 CTCAccuracy: 0.0000 sec/iter: 0.4998
[1,0]<stderr>:INFO:absl:global_steps: 841 learning_rate: 9.4027e-06 loss: 243.9527 Accuracy: 0.0268 CTCAccuracy: 0.0000 sec/iter: 0.5259
[1,0]<stderr>:INFO:absl:global_steps: 851 learning_rate: 9.5145e-06 loss: 242.5909 Accuracy: 0.0285 CTCAccuracy: 0.0000 sec/iter: 0.5009
[1,0]<stderr>:INFO:absl:global_steps: 861 learning_rate: 9.6263e-06 loss: 227.2217 Accuracy: 0.0258 CTCAccuracy: 0.0000 sec/iter: 0.5047
[1,0]<stderr>:INFO:absl:global_steps: 871 learning_rate: 9.7381e-06 loss: 230.7001 Accuracy: 0.0217 CTCAccuracy: 0.0000 sec/iter: 0.5099
[1,0]<stderr>:INFO:absl:global_steps: 881 learning_rate: 9.8499e-06 loss: 224.3931 Accuracy: 0.0274 CTCAccuracy: 0.0000 sec/iter: 0.5053
[1,0]<stderr>:INFO:absl:global_steps: 891 learning_rate: 9.9617e-06 loss: 215.9747 Accuracy: 0.0286 CTCAccuracy: 0.0000 sec/iter: 0.5334
[1,0]<stderr>:INFO:absl:global_steps: 901 learning_rate: 1.0073e-05 loss: 223.8389 Accuracy: 0.0310 CTCAccuracy: 0.0000 sec/iter: 0.5121
[1,0]<stderr>:INFO:absl:global_steps: 911 learning_rate: 1.0185e-05 loss: 234.4042 Accuracy: 0.0314 CTCAccuracy: 0.0000 sec/iter: 0.5043
[1,0]<stderr>:INFO:absl:global_steps: 921 learning_rate: 1.0297e-05 loss: 231.7014 Accuracy: 0.0285 CTCAccuracy: 0.0000 sec/iter: 0.5115
[1,0]<stderr>:INFO:absl:global_steps: 931 learning_rate: 1.0409e-05 loss: 230.0727 Accuracy: 0.0275 CTCAccuracy: 0.0000 sec/iter: 0.5531
[1,0]<stderr>:INFO:absl:global_steps: 941 learning_rate: 1.0521e-05 loss: 233.3332 Accuracy: 0.0274 CTCAccuracy: 0.0000 sec/iter: 0.4855
[1,0]<stderr>:INFO:absl:global_steps: 951 learning_rate: 1.0633e-05 loss: 224.9446 Accuracy: 0.0297 CTCAccuracy: 0.0000 sec/iter: 0.5520
[1,0]<stderr>:INFO:absl:global_steps: 961 learning_rate: 1.0744e-05 loss: 228.6144 Accuracy: 0.0395 CTCAccuracy: 0.0000 sec/iter: 0.5207
[1,0]<stderr>:INFO:absl:global_steps: 971 learning_rate: 1.0856e-05 loss: 241.4582 Accuracy: 0.0309 CTCAccuracy: 0.0000 sec/iter: 0.4884
[1,0]<stderr>:INFO:absl:global_steps: 981 learning_rate: 1.0968e-05 loss: 216.3368 Accuracy: 0.0333 CTCAccuracy: 0.0000 sec/iter: 0.5590
[1,0]<stderr>:INFO:absl:global_steps: 991 learning_rate: 1.1080e-05 loss: 234.7842 Accuracy: 0.0337 CTCAccuracy: 0.0000 sec/iter: 0.5159
[1,0]<stderr>:INFO:absl:global_steps: 1001 learning_rate: 1.1192e-05 loss: 268.2618 Accuracy: 0.0326 CTCAccuracy: 0.0000 sec/iter: 0.4961
[1,0]<stderr>:INFO:absl:global_steps: 1011 learning_rate: 1.1303e-05 loss: 232.8636 Accuracy: 0.0306 CTCAccuracy: 0.0000 sec/iter: 0.5595
[1,0]<stderr>:INFO:absl:global_steps: 1021 learning_rate: 1.1415e-05 loss: 240.6422 Accuracy: 0.0312 CTCAccuracy: 0.0000 sec/iter: 0.5206
[1,0]<stderr>:INFO:absl:global_steps: 1031 learning_rate: 1.1527e-05 loss: 230.0335 Accuracy: 0.0294 CTCAccuracy: 0.0000 sec/iter: 0.5274
[1,0]<stderr>:INFO:absl:global_steps: 1041 learning_rate: 1.1639e-05 loss: 236.8524 Accuracy: 0.0383 CTCAccuracy: 0.0000 sec/iter: 0.5712
[1,0]<stderr>:INFO:absl:global_steps: 1051 learning_rate: 1.1751e-05 loss: 231.5230 Accuracy: 0.0351 CTCAccuracy: 0.0000 sec/iter: 0.4972
[1,0]<stderr>:INFO:absl:global_steps: 1061 learning_rate: 1.1862e-05 loss: 230.0038 Accuracy: 0.0301 CTCAccuracy: 0.0000 sec/iter: 0.5648
[1,0]<stderr>:INFO:absl:global_steps: 1071 learning_rate: 1.1974e-05 loss: 235.4146 Accuracy: 0.0291 CTCAccuracy: 0.0000 sec/iter: 0.5372
[1,0]<stderr>:INFO:absl:global_steps: 1081 learning_rate: 1.2086e-05 loss: 228.5569 Accuracy: 0.0309 CTCAccuracy: 0.0000 sec/iter: 0.4954
[1,0]<stderr>:INFO:absl:global_steps: 1091 learning_rate: 1.2198e-05 loss: 224.1660 Accuracy: 0.0363 CTCAccuracy: 0.0000 sec/iter: 0.5998
[1,0]<stderr>:INFO:absl:global_steps: 1101 learning_rate: 1.2310e-05 loss: 236.2757 Accuracy: 0.0331 CTCAccuracy: 0.0000 sec/iter: 0.5051
[1,0]<stderr>:INFO:absl:global_steps: 1111 learning_rate: 1.2421e-05 loss: 236.4797 Accuracy: 0.0301 CTCAccuracy: 0.0000 sec/iter: 0.5622
[1,0]<stderr>:INFO:absl:global_steps: 1121 learning_rate: 1.2533e-05 loss: 245.2983 Accuracy: 0.0354 CTCAccuracy: 0.0000 sec/iter: 0.5656
[1,0]<stderr>:INFO:absl:global_steps: 1131 learning_rate: 1.2645e-05 loss: 230.0583 Accuracy: 0.0352 CTCAccuracy: 0.0000 sec/iter: 0.5693
[1,0]<stderr>:INFO:absl:global_steps: 1141 learning_rate: 1.2757e-05 loss: 236.2606 Accuracy: 0.0260 CTCAccuracy: 0.0000 sec/iter: 0.5039
[1,0]<stderr>:INFO:absl:global_steps: 1151 learning_rate: 1.2869e-05 loss: 245.2229 Accuracy: 0.0245 CTCAccuracy: 0.0000 sec/iter: 0.5823
[1,0]<stderr>:INFO:absl:global_steps: 1161 learning_rate: 1.2980e-05 loss: 233.3398 Accuracy: 0.0274 CTCAccuracy: 0.0000 sec/iter: 0.5394
[1,0]<stderr>:INFO:absl:global_steps: 1171 learning_rate: 1.3092e-05 loss: 242.7553 Accuracy: 0.0243 CTCAccuracy: 0.0000 sec/iter: 0.5703
[1,0]<stderr>:INFO:absl:global_steps: 1181 learning_rate: 1.3204e-05 loss: 235.1504 Accuracy: 0.0312 CTCAccuracy: 0.0000 sec/iter: 0.6061
[1,0]<stderr>:INFO:absl:global_steps: 1191 learning_rate: 1.3316e-05 loss: 221.9061 Accuracy: 0.0326 CTCAccuracy: 0.0000 sec/iter: 0.5415
[1,0]<stderr>:INFO:absl:global_steps: 1201 learning_rate: 1.3428e-05 loss: 220.7072 Accuracy: 0.0327 CTCAccuracy: 0.0000 sec/iter: 0.5426
[1,0]<stderr>:INFO:absl:global_steps: 1211 learning_rate: 1.3539e-05 loss: 236.5180 Accuracy: 0.0275 CTCAccuracy: 0.0000 sec/iter: 0.5694
[1,0]<stderr>:INFO:absl:global_steps: 1221 learning_rate: 1.3651e-05 loss: 234.4883 Accuracy: 0.0267 CTCAccuracy: 0.0000 sec/iter: 0.5427
[1,0]<stderr>:INFO:absl:global_steps: 1231 learning_rate: 1.3763e-05 loss: 247.2308 Accuracy: 0.0324 CTCAccuracy: 0.0000 sec/iter: 0.5449
[1,0]<stderr>:INFO:absl:global_steps: 1241 learning_rate: 1.3875e-05 loss: 253.3877 Accuracy: 0.0353 CTCAccuracy: 0.0000 sec/iter: 0.5890
[1,0]<stderr>:INFO:absl:global_steps: 1251 learning_rate: 1.3987e-05 loss: 220.8293 Accuracy: 0.0337 CTCAccuracy: 0.0000 sec/iter: 0.5540
[1,0]<stderr>:INFO:absl:global_steps: 1261 learning_rate: 1.4098e-05 loss: 243.1808 Accuracy: 0.0347 CTCAccuracy: 0.0000 sec/iter: 0.5845
[1,0]<stderr>:INFO:absl:global_steps: 1271 learning_rate: 1.4210e-05 loss: 225.9874 Accuracy: 0.0327 CTCAccuracy: 0.0000 sec/iter: 0.5983
[1,0]<stderr>:INFO:absl:global_steps: 1281 learning_rate: 1.4322e-05 loss: 234.5820 Accuracy: 0.0329 CTCAccuracy: 0.0000 sec/iter: 0.5592
[1,0]<stderr>:INFO:absl:global_steps: 1291 learning_rate: 1.4434e-05 loss: 241.7748 Accuracy: 0.0373 CTCAccuracy: 0.0000 sec/iter: 0.5632
[1,0]<stderr>:INFO:absl:global_steps: 1301 learning_rate: 1.4546e-05 loss: 223.7199 Accuracy: 0.0246 CTCAccuracy: 0.0000 sec/iter: 0.5938
[1,0]<stderr>:INFO:absl:global_steps: 1311 learning_rate: 1.4657e-05 loss: 255.2383 Accuracy: 0.0249 CTCAccuracy: 0.0000 sec/iter: 0.5572
[1,0]<stderr>:INFO:absl:global_steps: 1321 learning_rate: 1.4769e-05 loss: 254.4894 Accuracy: 0.0287 CTCAccuracy: 0.0000 sec/iter: 0.6376
[1,0]<stderr>:INFO:absl:global_steps: 1331 learning_rate: 1.4881e-05 loss: 236.5377 Accuracy: 0.0249 CTCAccuracy: 0.0000 sec/iter: 0.5524
[1,0]<stderr>:INFO:absl:global_steps: 1341 learning_rate: 1.4993e-05 loss: 237.8082 Accuracy: 0.0373 CTCAccuracy: 0.0000 sec/iter: 0.5912
[1,0]<stderr>:INFO:absl:global_steps: 1351 learning_rate: 1.5105e-05 loss: 229.2131 Accuracy: 0.0322 CTCAccuracy: 0.0000 sec/iter: 0.5549
[1,0]<stderr>:INFO:absl:global_steps: 1361 learning_rate: 1.5216e-05 loss: 226.1879 Accuracy: 0.0264 CTCAccuracy: 0.0000 sec/iter: 0.6164
[1,0]<stderr>:INFO:absl:global_steps: 1371 learning_rate: 1.5328e-05 loss: 255.3978 Accuracy: 0.0282 CTCAccuracy: 0.0000 sec/iter: 0.5688
[1,0]<stderr>:INFO:absl:global_steps: 1381 learning_rate: 1.5440e-05 loss: 238.6316 Accuracy: 0.0225 CTCAccuracy: 0.0000 sec/iter: 0.5550
[1,0]<stderr>:INFO:absl:global_steps: 1391 learning_rate: 1.5552e-05 loss: 234.9055 Accuracy: 0.0355 CTCAccuracy: 0.0000 sec/iter: 0.6004
[1,0]<stderr>:INFO:absl:global_steps: 1401 learning_rate: 1.5664e-05 loss: 225.1973 Accuracy: 0.0296 CTCAccuracy: 0.0000 sec/iter: 0.5521
[1,0]<stderr>:INFO:absl:global_steps: 1411 learning_rate: 1.5775e-05 loss: 242.2635 Accuracy: 0.0376 CTCAccuracy: 0.0000 sec/iter: 0.6277
[1,0]<stderr>:INFO:absl:global_steps: 1421 learning_rate: 1.5887e-05 loss: 247.1067 Accuracy: 0.0322 CTCAccuracy: 0.0000 sec/iter: 0.5928
[1,0]<stderr>:INFO:absl:global_steps: 1431 learning_rate: 1.5999e-05 loss: 235.6257 Accuracy: 0.0301 CTCAccuracy: 0.0000 sec/iter: 0.5526
[1,0]<stderr>:INFO:absl:global_steps: 1441 learning_rate: 1.6111e-05 loss: 226.3478 Accuracy: 0.0397 CTCAccuracy: 0.0000 sec/iter: 0.6159
[1,0]<stderr>:INFO:absl:global_steps: 1451 learning_rate: 1.6223e-05 loss: 244.9565 Accuracy: 0.0381 CTCAccuracy: 0.0000 sec/iter: 0.5714
[1,0]<stderr>:INFO:absl:global_steps: 1461 learning_rate: 1.6334e-05 loss: 228.0538 Accuracy: 0.0368 CTCAccuracy: 0.0000 sec/iter: 0.6204
[1,0]<stderr>:INFO:absl:global_steps: 1471 learning_rate: 1.6446e-05 loss: 243.5655 Accuracy: 0.0378 CTCAccuracy: 0.0000 sec/iter: 0.5795
[1,0]<stderr>:INFO:absl:global_steps: 1481 learning_rate: 1.6558e-05 loss: 256.4365 Accuracy: 0.0410 CTCAccuracy: 0.0000 sec/iter: 0.6521
[1,0]<stderr>:INFO:absl:global_steps: 1491 learning_rate: 1.6670e-05 loss: 268.3033 Accuracy: 0.0320 CTCAccuracy: 0.0000 sec/iter: 0.5726
[1,0]<stderr>:INFO:absl:global_steps: 1501 learning_rate: 1.6782e-05 loss: 243.0678 Accuracy: 0.0439 CTCAccuracy: 0.0000 sec/iter: 0.6240
[1,0]<stderr>:INFO:absl:global_steps: 1511 learning_rate: 1.6893e-05 loss: 232.9296 Accuracy: 0.0390 CTCAccuracy: 0.0000 sec/iter: 0.6054
[1,0]<stderr>:INFO:absl:global_steps: 1521 learning_rate: 1.7005e-05 loss: 243.7434 Accuracy: 0.0395 CTCAccuracy: 0.0000 sec/iter: 0.6951
[1,0]<stderr>:INFO:absl:global_steps: 1531 learning_rate: 1.7117e-05 loss: 231.4138 Accuracy: 0.0372 CTCAccuracy: 0.0000 sec/iter: 0.6041
[1,0]<stderr>:INFO:absl:global_steps: 1541 learning_rate: 1.7229e-05 loss: 234.5755 Accuracy: 0.0496 CTCAccuracy: 0.0000 sec/iter: 0.6251
[1,0]<stderr>:INFO:absl:global_steps: 1551 learning_rate: 1.7341e-05 loss: 248.8730 Accuracy: 0.0409 CTCAccuracy: 0.0000 sec/iter: 0.6580
[1,0]<stderr>:INFO:absl:global_steps: 1561 learning_rate: 1.7453e-05 loss: 237.1079 Accuracy: 0.0335 CTCAccuracy: 0.0000 sec/iter: 0.5819
[1,0]<stderr>:INFO:absl:global_steps: 1571 learning_rate: 1.7564e-05 loss: 251.9233 Accuracy: 0.0462 CTCAccuracy: 0.0000 sec/iter: 0.6349
[1,0]<stderr>:INFO:absl:global_steps: 1581 learning_rate: 1.7676e-05 loss: 256.6668 Accuracy: 0.0393 CTCAccuracy: 0.0000 sec/iter: 0.6254
[1,0]<stderr>:INFO:absl:global_steps: 1591 learning_rate: 1.7788e-05 loss: 251.3112 Accuracy: 0.0437 CTCAccuracy: 0.0000 sec/iter: 0.6800
[1,0]<stderr>:INFO:absl:global_steps: 1601 learning_rate: 1.7900e-05 loss: 241.2487 Accuracy: 0.0427 CTCAccuracy: 0.0000 sec/iter: 0.6096
[1,0]<stderr>:INFO:absl:global_steps: 1611 learning_rate: 1.8012e-05 loss: 233.5768 Accuracy: 0.0404 CTCAccuracy: 0.0000 sec/iter: 0.6431
[1,0]<stderr>:INFO:absl:global_steps: 1621 learning_rate: 1.8123e-05 loss: 235.9293 Accuracy: 0.0439 CTCAccuracy: 0.0000 sec/iter: 0.6889
[1,0]<stderr>:INFO:absl:global_steps: 1631 learning_rate: 1.8235e-05 loss: 237.0631 Accuracy: 0.0434 CTCAccuracy: 0.0000 sec/iter: 0.6866
[1,0]<stderr>:INFO:absl:global_steps: 1641 learning_rate: 1.8347e-05 loss: 245.6124 Accuracy: 0.0419 CTCAccuracy: 0.0000 sec/iter: 0.6424
[1,0]<stderr>:INFO:absl:global_steps: 1651 learning_rate: 1.8459e-05 loss: 235.4527 Accuracy: 0.0449 CTCAccuracy: 0.0000 sec/iter: 0.6889
[1,0]<stderr>:INFO:absl:global_steps: 1661 learning_rate: 1.8571e-05 loss: 252.5938 Accuracy: 0.0556 CTCAccuracy: 0.0000 sec/iter: 0.6867
[1,0]<stderr>:INFO:absl:global_steps: 1671 learning_rate: 1.8682e-05 loss: 239.6106 Accuracy: 0.0407 CTCAccuracy: 0.0000 sec/iter: 0.6893
[1,0]<stderr>:INFO:absl:global_steps: 1681 learning_rate: 1.8794e-05 loss: 239.4834 Accuracy: 0.0465 CTCAccuracy: 0.0000 sec/iter: 0.6564
[1,0]<stderr>:INFO:absl:global_steps: 1691 learning_rate: 1.8906e-05 loss: 238.8901 Accuracy: 0.0504 CTCAccuracy: 0.0000 sec/iter: 0.6975
[1,0]<stderr>:INFO:absl:global_steps: 1701 learning_rate: 1.9018e-05 loss: 233.8695 Accuracy: 0.0518 CTCAccuracy: 0.0000 sec/iter: 0.7393
[1,0]<stderr>:INFO:absl:global_steps: 1711 learning_rate: 1.9130e-05 loss: 234.0083 Accuracy: 0.0430 CTCAccuracy: 0.0000 sec/iter: 0.7022
[1,0]<stderr>:INFO:absl:global_steps: 1721 learning_rate: 1.9241e-05 loss: 242.1010 Accuracy: 0.0457 CTCAccuracy: 0.0000 sec/iter: 0.7448
[1,0]<stderr>:INFO:absl:global_steps: 1731 learning_rate: 1.9353e-05 loss: 228.6959 Accuracy: 0.0386 CTCAccuracy: 0.0000 sec/iter: 0.7147
[1,0]<stderr>:INFO:absl:global_steps: 1741 learning_rate: 1.9465e-05 loss: 234.0560 Accuracy: 0.0478 CTCAccuracy: 0.0000 sec/iter: 0.7112
[1,0]<stderr>:INFO:absl:global_steps: 1751 learning_rate: 1.9577e-05 loss: 252.6327 Accuracy: 0.0582 CTCAccuracy: 0.0000 sec/iter: 0.8293
[1,0]<stderr>:INFO:absl:global_steps: 1761 learning_rate: 1.9689e-05 loss: 243.9297 Accuracy: 0.0575 CTCAccuracy: 0.0000 sec/iter: 0.8199
[1,0]<stderr>:INFO:absl:global_steps: 1771 learning_rate: 1.9800e-05 loss: 248.4568 Accuracy: 0.0543 CTCAccuracy: 0.0000 sec/iter: 0.8269
[1,0]<stderr>:INFO:absl:global_steps: 1781 learning_rate: 1.9912e-05 loss: 262.8458 Accuracy: 0.0655 CTCAccuracy: 0.0000 sec/iter: 0.8590
[1,0]<stderr>:INFO:absl:global_steps: 1791 learning_rate: 2.0024e-05 loss: 243.6844 Accuracy: 0.0527 CTCAccuracy: 0.0000 sec/iter: 0.7873
[1,0]<stderr>:INFO:absl:global_steps: 1801 learning_rate: 2.0136e-05 loss: 240.0034 Accuracy: 0.0657 CTCAccuracy: 0.0000 sec/iter: 0.8941
[1,0]<stderr>:INFO:absl:global_steps: 1811 learning_rate: 2.0248e-05 loss: 250.5758 Accuracy: 0.0626 CTCAccuracy: 0.0000 sec/iter: 0.8443
[1,0]<stderr>:INFO:absl:global_steps: 1821 learning_rate: 2.0359e-05 loss: 230.8384 Accuracy: 0.0601 CTCAccuracy: 0.0000 sec/iter: 0.8987
[1,0]<stderr>:INFO:absl:global_steps: 1831 learning_rate: 2.0471e-05 loss: 261.6784 Accuracy: 0.0739 CTCAccuracy: 0.0000 sec/iter: 0.9826
[1,0]<stderr>:INFO:absl:global_steps: 1841 learning_rate: 2.0583e-05 loss: 258.0678 Accuracy: 0.0626 CTCAccuracy: 0.0000 sec/iter: 1.0701
[1,0]<stderr>:INFO:absl:global_steps: 1851 learning_rate: 2.0695e-05 loss: 261.2863 Accuracy: 0.0684 CTCAccuracy: 0.0000 sec/iter: 1.0816
[1,0]<stderr>:INFO:absl:global_steps: 1861 learning_rate: 2.0807e-05 loss: 248.6553 Accuracy: 0.0807 CTCAccuracy: 0.0000 sec/iter: 1.1461
[1,0]<stderr>:INFO:absl:global_steps: 1871 learning_rate: 2.0918e-05 loss: 257.8753 Accuracy: 0.0702 CTCAccuracy: 0.0000 sec/iter: 1.2104
[1,1]<stderr>:INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_recognition.SpeechRecognitionDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/dev.csv'), ('input_length_range', [10, 15000]), ('output_length_range', [1, 10000]), ('remove_unk', True), ('speed_permutation', [1.0]), ('text_config', {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'})]
[1,1]<stdout>:Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
[1,1]<stderr>:INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
[1,1]<stderr>:INFO:absl:Loading data from examples/asr/thchs30/data/dev.csv
[1,1]<stdout>:before filter by unk:893
[1,1]<stdout>:after filter by unk:893
[1,1]<stdout>:afiter filter by input length:893
[1,0]<stderr>:INFO:absl:>>>>> start evaluate in epoch 0
[1,0]<stderr>:INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_recognition.SpeechRecognitionDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/dev.csv'), ('input_length_range', [10, 15000]), ('output_length_range', [1, 10000]), ('remove_unk', True), ('speed_permutation', [1.0]), ('text_config', {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'})]
[1,1]<stdout>:after filter by output length:893
[1,0]<stdout>:Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
[1,0]<stderr>:INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
[1,0]<stderr>:INFO:absl:Loading data from examples/asr/thchs30/data/dev.csv
[1,0]<stdout>:before filter by unk:893
[1,1]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,0]<stdout>:after filter by unk:893
[1,0]<stdout>:afiter filter by input length:893
[1,0]<stdout>:after filter by output length:893
[1,0]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,0]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,1]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:INFO:absl:loss: 160.1014 Accuracy: -0.1638 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 198.9714 Accuracy: -0.1302 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 213.4318 Accuracy: -0.0762 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 216.4754 Accuracy: -0.0441 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 215.9704 Accuracy: -0.0250 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 222.9266 Accuracy: -0.0114 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 229.1015 Accuracy: -0.0025 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 223.2651 Accuracy: 0.0047 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 237.7361 Accuracy: 0.0091 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 240.0748 Accuracy: 0.0139 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 230.7661 Accuracy: 0.0211 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:loss: 229.0808 Accuracy: 0.0249 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:epoch: 0 loss: 222.1231 Accuracy: 0.0249 CTCAccuracy: 0.0000
[1,0]<stderr>:INFO:absl:saving model in :examples/asr/thchs30/ckpts/mtl_transformer_ctc/ckpt
[1,1]<stderr>:INFO:absl:perform batch_wise_shuffle with batch_size 8
[1,1]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,0]<stderr>:INFO:absl:>>>>> start training in epoch 1
[1,0]<stderr>:INFO:absl:perform batch_wise_shuffle with batch_size 8
[1,0]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,1]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:INFO:absl:global_steps: 1872 learning_rate: 2.0930e-05 loss: 220.9477 Accuracy: 0.0338 CTCAccuracy: 0.0000 sec/iter: 66.0952
[1,0]<stderr>:INFO:absl:global_steps: 1882 learning_rate: 2.1041e-05 loss: 224.8923 Accuracy: 0.0384 CTCAccuracy: 0.0000 sec/iter: 0.5141
[1,0]<stderr>:INFO:absl:global_steps: 1892 learning_rate: 2.1153e-05 loss: 230.2927 Accuracy: 0.0521 CTCAccuracy: 0.0000 sec/iter: 0.5373
[1,0]<stderr>:INFO:absl:global_steps: 1902 learning_rate: 2.1265e-05 loss: 203.6085 Accuracy: 0.0652 CTCAccuracy: 0.0000 sec/iter: 0.6719
[1,0]<stderr>:INFO:absl:global_steps: 1912 learning_rate: 2.1377e-05 loss: 219.1134 Accuracy: 0.0603 CTCAccuracy: 0.0000 sec/iter: 0.5006
[1,0]<stderr>:INFO:absl:global_steps: 1922 learning_rate: 2.1489e-05 loss: 213.7806 Accuracy: 0.0634 CTCAccuracy: 0.0000 sec/iter: 0.5229
[1,0]<stderr>:INFO:absl:global_steps: 1932 learning_rate: 2.1600e-05 loss: 212.1633 Accuracy: 0.0524 CTCAccuracy: 0.0000 sec/iter: 0.4872
[1,0]<stderr>:INFO:absl:global_steps: 1942 learning_rate: 2.1712e-05 loss: 218.6107 Accuracy: 0.0624 CTCAccuracy: 0.0000 sec/iter: 0.5124
[1,0]<stderr>:INFO:absl:global_steps: 1952 learning_rate: 2.1824e-05 loss: 236.7016 Accuracy: 0.0557 CTCAccuracy: 0.0000 sec/iter: 0.5186
[1,0]<stderr>:INFO:absl:global_steps: 1962 learning_rate: 2.1936e-05 loss: 236.7017 Accuracy: 0.0702 CTCAccuracy: 0.0000 sec/iter: 0.5281
[1,0]<stderr>:INFO:absl:global_steps: 1972 learning_rate: 2.2048e-05 loss: 228.0292 Accuracy: 0.0616 CTCAccuracy: 0.0000 sec/iter: 0.5016
[1,0]<stderr>:INFO:absl:global_steps: 1982 learning_rate: 2.2159e-05 loss: 213.3540 Accuracy: 0.0705 CTCAccuracy: 0.0000 sec/iter: 0.5022
[1,0]<stderr>:INFO:absl:global_steps: 1992 learning_rate: 2.2271e-05 loss: 200.2540 Accuracy: 0.0694 CTCAccuracy: 0.0000 sec/iter: 0.5071
[1,0]<stderr>:INFO:absl:global_steps: 2002 learning_rate: 2.2383e-05 loss: 226.7614 Accuracy: 0.0724 CTCAccuracy: 0.0000 sec/iter: 0.4889
[1,0]<stderr>:INFO:absl:global_steps: 2012 learning_rate: 2.2495e-05 loss: 223.2401 Accuracy: 0.0649 CTCAccuracy: 0.0000 sec/iter: 0.5177
[1,0]<stderr>:INFO:absl:global_steps: 2022 learning_rate: 2.2607e-05 loss: 220.1055 Accuracy: 0.0726 CTCAccuracy: 0.0000 sec/iter: 0.5178
[1,0]<stderr>:INFO:absl:global_steps: 2032 learning_rate: 2.2718e-05 loss: 211.9235 Accuracy: 0.0633 CTCAccuracy: 0.0000 sec/iter: 0.5067
[1,0]<stderr>:INFO:absl:global_steps: 2042 learning_rate: 2.2830e-05 loss: 217.6621 Accuracy: 0.0699 CTCAccuracy: 0.0000 sec/iter: 0.4962
[1,0]<stderr>:INFO:absl:global_steps: 2052 learning_rate: 2.2942e-05 loss: 196.7554 Accuracy: 0.0660 CTCAccuracy: 0.0000 sec/iter: 0.4899
[1,0]<stderr>:INFO:absl:global_steps: 2062 learning_rate: 2.3054e-05 loss: 215.9901 Accuracy: 0.0698 CTCAccuracy: 0.0000 sec/iter: 0.5187
[1,0]<stderr>:INFO:absl:global_steps: 2072 learning_rate: 2.3166e-05 loss: 223.7035 Accuracy: 0.0812 CTCAccuracy: 0.0000 sec/iter: 0.5168
[1,0]<stderr>:INFO:absl:global_steps: 2082 learning_rate: 2.3277e-05 loss: 237.2592 Accuracy: 0.0725 CTCAccuracy: 0.0000 sec/iter: 0.5019
[1,0]<stderr>:INFO:absl:global_steps: 2092 learning_rate: 2.3389e-05 loss: 228.3770 Accuracy: 0.0858 CTCAccuracy: 0.0000 sec/iter: 0.5084
[1,0]<stderr>:INFO:absl:global_steps: 2102 learning_rate: 2.3501e-05 loss: 208.6603 Accuracy: 0.0685 CTCAccuracy: 0.0000 sec/iter: 0.5123
[1,0]<stderr>:INFO:absl:global_steps: 2112 learning_rate: 2.3613e-05 loss: 207.9108 Accuracy: 0.0871 CTCAccuracy: 0.0000 sec/iter: 0.5078
[1,0]<stderr>:INFO:absl:global_steps: 2122 learning_rate: 2.3725e-05 loss: 204.3659 Accuracy: 0.0747 CTCAccuracy: 0.0000 sec/iter: 0.5118
[1,0]<stderr>:INFO:absl:global_steps: 2132 learning_rate: 2.3836e-05 loss: 209.9311 Accuracy: 0.0849 CTCAccuracy: 0.0000 sec/iter: 0.5255
[1,0]<stderr>:INFO:absl:global_steps: 2142 learning_rate: 2.3948e-05 loss: 208.5077 Accuracy: 0.0993 CTCAccuracy: 0.0000 sec/iter: 0.5303
[1,0]<stderr>:INFO:absl:global_steps: 2152 learning_rate: 2.4060e-05 loss: 241.8005 Accuracy: 0.0922 CTCAccuracy: 0.0000 sec/iter: 0.5141
[1,0]<stderr>:INFO:absl:global_steps: 2162 learning_rate: 2.4172e-05 loss: 221.2752 Accuracy: 0.0775 CTCAccuracy: 0.0000 sec/iter: 0.5654
[1,0]<stderr>:INFO:absl:global_steps: 2172 learning_rate: 2.4284e-05 loss: 227.5979 Accuracy: 0.0952 CTCAccuracy: 0.0000 sec/iter: 0.5422
[1,0]<stderr>:INFO:absl:global_steps: 2182 learning_rate: 2.4396e-05 loss: 193.5612 Accuracy: 0.0802 CTCAccuracy: 0.0000 sec/iter: 0.4832
[1,0]<stderr>:INFO:absl:global_steps: 2192 learning_rate: 2.4507e-05 loss: 211.0316 Accuracy: 0.0849 CTCAccuracy: 0.0000 sec/iter: 0.5181
[1,0]<stderr>:INFO:absl:global_steps: 2202 learning_rate: 2.4619e-05 loss: 213.6798 Accuracy: 0.0803 CTCAccuracy: 0.0000 sec/iter: 0.5289
[1,0]<stderr>:INFO:absl:global_steps: 2212 learning_rate: 2.4731e-05 loss: 185.1448 Accuracy: 0.0859 CTCAccuracy: 0.0000 sec/iter: 0.5524
[1,0]<stderr>:INFO:absl:global_steps: 2222 learning_rate: 2.4843e-05 loss: 222.6764 Accuracy: 0.0950 CTCAccuracy: 0.0000 sec/iter: 0.4987
[1,0]<stderr>:INFO:absl:global_steps: 2232 learning_rate: 2.4955e-05 loss: 209.9887 Accuracy: 0.1090 CTCAccuracy: 0.0000 sec/iter: 0.5234
[1,0]<stderr>:INFO:absl:global_steps: 2242 learning_rate: 2.5066e-05 loss: 191.9495 Accuracy: 0.0805 CTCAccuracy: 0.0000 sec/iter: 0.4962
[1,0]<stderr>:INFO:absl:global_steps: 2252 learning_rate: 2.5178e-05 loss: 206.5573 Accuracy: 0.0892 CTCAccuracy: 0.0000 sec/iter: 0.5229
[1,0]<stderr>:INFO:absl:global_steps: 2262 learning_rate: 2.5290e-05 loss: 176.7463 Accuracy: 0.1058 CTCAccuracy: 0.0000 sec/iter: 0.5136
[1,0]<stderr>:INFO:absl:global_steps: 2272 learning_rate: 2.5402e-05 loss: 215.9726 Accuracy: 0.0888 CTCAccuracy: 0.0000 sec/iter: 0.5261
[1,0]<stderr>:INFO:absl:global_steps: 2282 learning_rate: 2.5514e-05 loss: 188.4945 Accuracy: 0.0963 CTCAccuracy: 0.0004 sec/iter: 0.4996
[1,0]<stderr>:INFO:absl:global_steps: 2292 learning_rate: 2.5625e-05 loss: 206.9203 Accuracy: 0.0994 CTCAccuracy: 0.0015 sec/iter: 0.5167
[1,0]<stderr>:INFO:absl:global_steps: 2302 learning_rate: 2.5737e-05 loss: 214.5447 Accuracy: 0.0927 CTCAccuracy: 0.0019 sec/iter: 0.4788
[1,0]<stderr>:INFO:absl:global_steps: 2312 learning_rate: 2.5849e-05 loss: 222.0219 Accuracy: 0.1047 CTCAccuracy: 0.0035 sec/iter: 0.5248
[1,0]<stderr>:INFO:absl:global_steps: 2322 learning_rate: 2.5961e-05 loss: 203.4364 Accuracy: 0.1017 CTCAccuracy: 0.0027 sec/iter: 0.5109
[1,0]<stderr>:INFO:absl:global_steps: 2332 learning_rate: 2.6073e-05 loss: 216.0083 Accuracy: 0.1043 CTCAccuracy: 0.0028 sec/iter: 0.5048
[1,0]<stderr>:INFO:absl:global_steps: 2342 learning_rate: 2.6184e-05 loss: 224.0633 Accuracy: 0.0981 CTCAccuracy: 0.0064 sec/iter: 0.5356
[1,0]<stderr>:INFO:absl:global_steps: 2352 learning_rate: 2.6296e-05 loss: 214.7505 Accuracy: 0.1192 CTCAccuracy: 0.0093 sec/iter: 0.5184
[1,0]<stderr>:INFO:absl:global_steps: 2362 learning_rate: 2.6408e-05 loss: 202.2407 Accuracy: 0.1132 CTCAccuracy: 0.0095 sec/iter: 0.5367
[1,0]<stderr>:INFO:absl:global_steps: 2372 learning_rate: 2.6520e-05 loss: 202.4236 Accuracy: 0.1157 CTCAccuracy: 0.0100 sec/iter: 0.5457
[1,0]<stderr>:INFO:absl:global_steps: 2382 learning_rate: 2.6632e-05 loss: 211.3483 Accuracy: 0.1035 CTCAccuracy: 0.0176 sec/iter: 0.5179
[1,0]<stderr>:INFO:absl:global_steps: 2392 learning_rate: 2.6743e-05 loss: 205.5777 Accuracy: 0.1053 CTCAccuracy: 0.0145 sec/iter: 0.5230
[1,0]<stderr>:INFO:absl:global_steps: 2402 learning_rate: 2.6855e-05 loss: 178.7106 Accuracy: 0.0975 CTCAccuracy: 0.0189 sec/iter: 0.5094
[1,0]<stderr>:INFO:absl:global_steps: 2412 learning_rate: 2.6967e-05 loss: 251.3557 Accuracy: 0.1304 CTCAccuracy: 0.0160 sec/iter: 0.5294
[1,0]<stderr>:INFO:absl:global_steps: 2422 learning_rate: 2.7079e-05 loss: 197.2500 Accuracy: 0.1160 CTCAccuracy: 0.0174 sec/iter: 0.4883
[1,0]<stderr>:INFO:absl:global_steps: 2432 learning_rate: 2.7191e-05 loss: 201.6909 Accuracy: 0.1243 CTCAccuracy: 0.0214 sec/iter: 0.5232
[1,0]<stderr>:INFO:absl:global_steps: 2442 learning_rate: 2.7302e-05 loss: 219.6146 Accuracy: 0.1139 CTCAccuracy: 0.0209 sec/iter: 0.5313
[1,0]<stderr>:INFO:absl:global_steps: 2452 learning_rate: 2.7414e-05 loss: 210.6917 Accuracy: 0.1069 CTCAccuracy: 0.0224 sec/iter: 0.5297
[1,0]<stderr>:INFO:absl:global_steps: 2462 learning_rate: 2.7526e-05 loss: 199.5819 Accuracy: 0.1171 CTCAccuracy: 0.0258 sec/iter: 0.5058
[1,0]<stderr>:INFO:absl:global_steps: 2472 learning_rate: 2.7638e-05 loss: 203.2135 Accuracy: 0.1358 CTCAccuracy: 0.0217 sec/iter: 0.5170
[1,0]<stderr>:INFO:absl:global_steps: 2482 learning_rate: 2.7750e-05 loss: 221.2340 Accuracy: 0.1212 CTCAccuracy: 0.0264 sec/iter: 0.5009
[1,0]<stderr>:INFO:absl:global_steps: 2492 learning_rate: 2.7861e-05 loss: 200.6224 Accuracy: 0.1242 CTCAccuracy: 0.0252 sec/iter: 0.5010
[1,0]<stderr>:INFO:absl:global_steps: 2502 learning_rate: 2.7973e-05 loss: 200.0778 Accuracy: 0.1248 CTCAccuracy: 0.0267 sec/iter: 0.5302
[1,0]<stderr>:INFO:absl:global_steps: 2512 learning_rate: 2.8085e-05 loss: 222.4271 Accuracy: 0.1395 CTCAccuracy: 0.0302 sec/iter: 0.5033
[1,0]<stderr>:INFO:absl:global_steps: 2522 learning_rate: 2.8197e-05 loss: 187.1288 Accuracy: 0.1371 CTCAccuracy: 0.0345 sec/iter: 0.5138
[1,0]<stderr>:INFO:absl:global_steps: 2532 learning_rate: 2.8309e-05 loss: 210.6801 Accuracy: 0.1250 CTCAccuracy: 0.0334 sec/iter: 0.5309
[1,0]<stderr>:INFO:absl:global_steps: 2542 learning_rate: 2.8420e-05 loss: 206.6094 Accuracy: 0.1373 CTCAccuracy: 0.0366 sec/iter: 0.5176
[1,0]<stderr>:INFO:absl:global_steps: 2552 learning_rate: 2.8532e-05 loss: 231.3967 Accuracy: 0.1410 CTCAccuracy: 0.0402 sec/iter: 0.5295
[1,0]<stderr>:INFO:absl:global_steps: 2562 learning_rate: 2.8644e-05 loss: 191.0818 Accuracy: 0.1386 CTCAccuracy: 0.0330 sec/iter: 0.4963
[1,0]<stderr>:INFO:absl:global_steps: 2572 learning_rate: 2.8756e-05 loss: 203.6715 Accuracy: 0.1307 CTCAccuracy: 0.0356 sec/iter: 0.4897
[1,0]<stderr>:INFO:absl:global_steps: 2582 learning_rate: 2.8868e-05 loss: 155.5527 Accuracy: 0.1095 CTCAccuracy: 0.0386 sec/iter: 0.4892
[1,0]<stderr>:INFO:absl:global_steps: 2592 learning_rate: 2.8979e-05 loss: 185.6594 Accuracy: 0.1363 CTCAccuracy: 0.0417 sec/iter: 0.5025
[1,0]<stderr>:INFO:absl:global_steps: 2602 learning_rate: 2.9091e-05 loss: 197.4785 Accuracy: 0.1405 CTCAccuracy: 0.0462 sec/iter: 0.4773
[1,0]<stderr>:INFO:absl:global_steps: 2612 learning_rate: 2.9203e-05 loss: 162.1462 Accuracy: 0.1718 CTCAccuracy: 0.0501 sec/iter: 0.5484
[1,0]<stderr>:INFO:absl:global_steps: 2622 learning_rate: 2.9315e-05 loss: 190.9265 Accuracy: 0.1246 CTCAccuracy: 0.0401 sec/iter: 0.5152
[1,0]<stderr>:INFO:absl:global_steps: 2632 learning_rate: 2.9427e-05 loss: 204.6503 Accuracy: 0.1441 CTCAccuracy: 0.0399 sec/iter: 0.5389
[1,0]<stderr>:INFO:absl:global_steps: 2642 learning_rate: 2.9538e-05 loss: 229.9904 Accuracy: 0.1486 CTCAccuracy: 0.0399 sec/iter: 0.5362
[1,0]<stderr>:INFO:absl:global_steps: 2652 learning_rate: 2.9650e-05 loss: 195.4038 Accuracy: 0.1338 CTCAccuracy: 0.0477 sec/iter: 0.5121
[1,0]<stderr>:INFO:absl:global_steps: 2662 learning_rate: 2.9762e-05 loss: 199.0373 Accuracy: 0.1532 CTCAccuracy: 0.0483 sec/iter: 0.4892
[1,0]<stderr>:INFO:absl:global_steps: 2672 learning_rate: 2.9874e-05 loss: 194.7556 Accuracy: 0.1463 CTCAccuracy: 0.0485 sec/iter: 0.5264
[1,0]<stderr>:INFO:absl:global_steps: 2682 learning_rate: 2.9986e-05 loss: 201.4649 Accuracy: 0.1572 CTCAccuracy: 0.0479 sec/iter: 0.4930
[1,0]<stderr>:INFO:absl:global_steps: 2692 learning_rate: 3.0097e-05 loss: 187.1717 Accuracy: 0.1372 CTCAccuracy: 0.0522 sec/iter: 0.5236
[1,0]<stderr>:INFO:absl:global_steps: 2702 learning_rate: 3.0209e-05 loss: 196.7782 Accuracy: 0.1384 CTCAccuracy: 0.0626 sec/iter: 0.5116
[1,0]<stderr>:INFO:absl:global_steps: 2712 learning_rate: 3.0321e-05 loss: 191.2981 Accuracy: 0.1460 CTCAccuracy: 0.0557 sec/iter: 0.5245
[1,0]<stderr>:INFO:absl:global_steps: 2722 learning_rate: 3.0433e-05 loss: 180.7610 Accuracy: 0.1523 CTCAccuracy: 0.0565 sec/iter: 0.5264
[1,0]<stderr>:INFO:absl:global_steps: 2732 learning_rate: 3.0545e-05 loss: 192.2156 Accuracy: 0.1481 CTCAccuracy: 0.0522 sec/iter: 0.5371
[1,0]<stderr>:INFO:absl:global_steps: 2742 learning_rate: 3.0656e-05 loss: 187.3254 Accuracy: 0.1296 CTCAccuracy: 0.0563 sec/iter: 0.5177
[1,0]<stderr>:INFO:absl:global_steps: 2752 learning_rate: 3.0768e-05 loss: 194.1685 Accuracy: 0.1606 CTCAccuracy: 0.0529 sec/iter: 0.5139
[1,0]<stderr>:INFO:absl:global_steps: 2762 learning_rate: 3.0880e-05 loss: 137.9509 Accuracy: 0.1468 CTCAccuracy: 0.0576 sec/iter: 0.5451
[1,0]<stderr>:INFO:absl:global_steps: 2772 learning_rate: 3.0992e-05 loss: 185.7297 Accuracy: 0.1376 CTCAccuracy: 0.0654 sec/iter: 0.4942
[1,0]<stderr>:INFO:absl:global_steps: 2782 learning_rate: 3.1104e-05 loss: 198.5176 Accuracy: 0.1403 CTCAccuracy: 0.0678 sec/iter: 0.5176
[1,0]<stderr>:INFO:absl:global_steps: 2792 learning_rate: 3.1216e-05 loss: 191.1202 Accuracy: 0.1758 CTCAccuracy: 0.0580 sec/iter: 0.5229
[1,0]<stderr>:INFO:absl:global_steps: 2802 learning_rate: 3.1327e-05 loss: 185.4781 Accuracy: 0.1674 CTCAccuracy: 0.0633 sec/iter: 0.4946
[1,0]<stderr>:INFO:absl:global_steps: 2812 learning_rate: 3.1439e-05 loss: 188.0192 Accuracy: 0.1690 CTCAccuracy: 0.0723 sec/iter: 0.5167
[1,0]<stderr>:INFO:absl:global_steps: 2822 learning_rate: 3.1551e-05 loss: 182.9052 Accuracy: 0.1537 CTCAccuracy: 0.0660 sec/iter: 0.4736
[1,0]<stderr>:INFO:absl:global_steps: 2832 learning_rate: 3.1663e-05 loss: 183.3493 Accuracy: 0.1503 CTCAccuracy: 0.0645 sec/iter: 0.4941
[1,0]<stderr>:INFO:absl:global_steps: 2842 learning_rate: 3.1775e-05 loss: 198.0439 Accuracy: 0.1706 CTCAccuracy: 0.0652 sec/iter: 0.5180
[1,0]<stderr>:INFO:absl:global_steps: 2852 learning_rate: 3.1886e-05 loss: 182.6220 Accuracy: 0.1679 CTCAccuracy: 0.0759 sec/iter: 0.4951
[1,0]<stderr>:INFO:absl:global_steps: 2862 learning_rate: 3.1998e-05 loss: 171.5905 Accuracy: 0.1514 CTCAccuracy: 0.0627 sec/iter: 0.5028
[1,0]<stderr>:INFO:absl:global_steps: 2872 learning_rate: 3.2110e-05 loss: 195.7145 Accuracy: 0.1762 CTCAccuracy: 0.0732 sec/iter: 0.5149
[1,0]<stderr>:INFO:absl:global_steps: 2882 learning_rate: 3.2222e-05 loss: 196.2762 Accuracy: 0.1454 CTCAccuracy: 0.0756 sec/iter: 0.5135
[1,0]<stderr>:INFO:absl:global_steps: 2892 learning_rate: 3.2334e-05 loss: 183.6970 Accuracy: 0.1603 CTCAccuracy: 0.0738 sec/iter: 0.4897
[1,0]<stderr>:INFO:absl:global_steps: 2902 learning_rate: 3.2445e-05 loss: 165.5402 Accuracy: 0.1705 CTCAccuracy: 0.0699 sec/iter: 0.5313
[1,0]<stderr>:INFO:absl:global_steps: 2912 learning_rate: 3.2557e-05 loss: 171.2136 Accuracy: 0.1727 CTCAccuracy: 0.0839 sec/iter: 0.5094
[1,0]<stderr>:INFO:absl:global_steps: 2922 learning_rate: 3.2669e-05 loss: 187.6684 Accuracy: 0.1767 CTCAccuracy: 0.0761 sec/iter: 0.4997
[1,0]<stderr>:INFO:absl:global_steps: 2932 learning_rate: 3.2781e-05 loss: 186.2896 Accuracy: 0.1898 CTCAccuracy: 0.0798 sec/iter: 0.5498
[1,0]<stderr>:INFO:absl:global_steps: 2942 learning_rate: 3.2893e-05 loss: 188.8284 Accuracy: 0.1793 CTCAccuracy: 0.0809 sec/iter: 0.5281
[1,0]<stderr>:INFO:absl:global_steps: 2952 learning_rate: 3.3004e-05 loss: 181.9745 Accuracy: 0.1638 CTCAccuracy: 0.0768 sec/iter: 0.5142
[1,0]<stderr>:INFO:absl:global_steps: 2962 learning_rate: 3.3116e-05 loss: 182.0608 Accuracy: 0.1950 CTCAccuracy: 0.0749 sec/iter: 0.5012
[1,0]<stderr>:INFO:absl:global_steps: 2972 learning_rate: 3.3228e-05 loss: 178.2918 Accuracy: 0.1995 CTCAccuracy: 0.0853 sec/iter: 0.5268
[1,0]<stderr>:INFO:absl:global_steps: 2982 learning_rate: 3.3340e-05 loss: 199.1426 Accuracy: 0.1959 CTCAccuracy: 0.0856 sec/iter: 0.5175
[1,0]<stderr>:INFO:absl:global_steps: 2992 learning_rate: 3.3452e-05 loss: 185.7378 Accuracy: 0.2036 CTCAccuracy: 0.0889 sec/iter: 0.5204
[1,0]<stderr>:INFO:absl:global_steps: 3002 learning_rate: 3.3563e-05 loss: 150.3258 Accuracy: 0.2017 CTCAccuracy: 0.0939 sec/iter: 0.5411
[1,0]<stderr>:INFO:absl:global_steps: 3012 learning_rate: 3.3675e-05 loss: 181.0743 Accuracy: 0.1652 CTCAccuracy: 0.0879 sec/iter: 0.4956
[1,0]<stderr>:INFO:absl:global_steps: 3022 learning_rate: 3.3787e-05 loss: 168.2666 Accuracy: 0.1710 CTCAccuracy: 0.0898 sec/iter: 0.5160
[1,0]<stderr>:INFO:absl:global_steps: 3032 learning_rate: 3.3899e-05 loss: 173.9260 Accuracy: 0.1981 CTCAccuracy: 0.0941 sec/iter: 0.5102
[1,0]<stderr>:INFO:absl:global_steps: 3042 learning_rate: 3.4011e-05 loss: 178.9901 Accuracy: 0.1836 CTCAccuracy: 0.0759 sec/iter: 0.4828
[1,0]<stderr>:INFO:absl:global_steps: 3052 learning_rate: 3.4122e-05 loss: 157.4940 Accuracy: 0.1849 CTCAccuracy: 0.0893 sec/iter: 0.4743
[1,0]<stderr>:INFO:absl:global_steps: 3062 learning_rate: 3.4234e-05 loss: 185.1281 Accuracy: 0.1661 CTCAccuracy: 0.0888 sec/iter: 0.5097
[1,0]<stderr>:INFO:absl:global_steps: 3072 learning_rate: 3.4346e-05 loss: 159.9022 Accuracy: 0.1911 CTCAccuracy: 0.0950 sec/iter: 0.5075
[1,0]<stderr>:INFO:absl:global_steps: 3082 learning_rate: 3.4458e-05 loss: 176.3337 Accuracy: 0.1945 CTCAccuracy: 0.0967 sec/iter: 0.4756
[1,0]<stderr>:INFO:absl:global_steps: 3092 learning_rate: 3.4570e-05 loss: 146.3986 Accuracy: 0.1924 CTCAccuracy: 0.0972 sec/iter: 0.4724
[1,0]<stderr>:INFO:absl:global_steps: 3102 learning_rate: 3.4681e-05 loss: 155.8538 Accuracy: 0.2049 CTCAccuracy: 0.0950 sec/iter: 0.4883
[1,0]<stderr>:INFO:absl:global_steps: 3112 learning_rate: 3.4793e-05 loss: 161.7282 Accuracy: 0.1899 CTCAccuracy: 0.0942 sec/iter: 0.5278
[1,0]<stderr>:INFO:absl:global_steps: 3122 learning_rate: 3.4905e-05 loss: 160.5112 Accuracy: 0.2063 CTCAccuracy: 0.0919 sec/iter: 0.5465
[1,0]<stderr>:INFO:absl:global_steps: 3132 learning_rate: 3.5017e-05 loss: 190.1340 Accuracy: 0.2028 CTCAccuracy: 0.0997 sec/iter: 0.5460
[1,0]<stderr>:INFO:absl:global_steps: 3142 learning_rate: 3.5129e-05 loss: 160.6425 Accuracy: 0.1884 CTCAccuracy: 0.0971 sec/iter: 0.4841
[1,0]<stderr>:INFO:absl:global_steps: 3152 learning_rate: 3.5240e-05 loss: 178.9462 Accuracy: 0.2102 CTCAccuracy: 0.1021 sec/iter: 0.5007
[1,0]<stderr>:INFO:absl:global_steps: 3162 learning_rate: 3.5352e-05 loss: 162.9329 Accuracy: 0.2114 CTCAccuracy: 0.0996 sec/iter: 0.5404
[1,0]<stderr>:INFO:absl:global_steps: 3172 learning_rate: 3.5464e-05 loss: 163.5896 Accuracy: 0.2155 CTCAccuracy: 0.1017 sec/iter: 0.5284
[1,0]<stderr>:INFO:absl:global_steps: 3182 learning_rate: 3.5576e-05 loss: 165.6703 Accuracy: 0.2193 CTCAccuracy: 0.0949 sec/iter: 0.5291
[1,0]<stderr>:INFO:absl:global_steps: 3192 learning_rate: 3.5688e-05 loss: 173.5873 Accuracy: 0.2214 CTCAccuracy: 0.0988 sec/iter: 0.5101
[1,0]<stderr>:INFO:absl:global_steps: 3202 learning_rate: 3.5799e-05 loss: 161.5460 Accuracy: 0.2152 CTCAccuracy: 0.1058 sec/iter: 0.5016
[1,0]<stderr>:INFO:absl:global_steps: 3212 learning_rate: 3.5911e-05 loss: 169.0766 Accuracy: 0.1877 CTCAccuracy: 0.1031 sec/iter: 0.5334
[1,0]<stderr>:INFO:absl:global_steps: 3222 learning_rate: 3.6023e-05 loss: 157.1616 Accuracy: 0.2300 CTCAccuracy: 0.0946 sec/iter: 0.4873
[1,0]<stderr>:INFO:absl:global_steps: 3232 learning_rate: 3.6135e-05 loss: 164.3186 Accuracy: 0.2198 CTCAccuracy: 0.0991 sec/iter: 0.5124
[1,0]<stderr>:INFO:absl:global_steps: 3242 learning_rate: 3.6247e-05 loss: 157.1775 Accuracy: 0.2341 CTCAccuracy: 0.1038 sec/iter: 0.5086
[1,0]<stderr>:INFO:absl:global_steps: 3252 learning_rate: 3.6358e-05 loss: 170.5222 Accuracy: 0.2202 CTCAccuracy: 0.1114 sec/iter: 0.4734
[1,0]<stderr>:INFO:absl:global_steps: 3262 learning_rate: 3.6470e-05 loss: 153.8534 Accuracy: 0.2049 CTCAccuracy: 0.1039 sec/iter: 0.5332
[1,0]<stderr>:INFO:absl:global_steps: 3272 learning_rate: 3.6582e-05 loss: 154.1566 Accuracy: 0.2081 CTCAccuracy: 0.1021 sec/iter: 0.4706
[1,0]<stderr>:INFO:absl:global_steps: 3282 learning_rate: 3.6694e-05 loss: 176.0593 Accuracy: 0.2330 CTCAccuracy: 0.1280 sec/iter: 0.4814
[1,0]<stderr>:INFO:absl:global_steps: 3292 learning_rate: 3.6806e-05 loss: 131.2148 Accuracy: 0.2371 CTCAccuracy: 0.1172 sec/iter: 0.5030
[1,0]<stderr>:INFO:absl:global_steps: 3302 learning_rate: 3.6917e-05 loss: 143.6461 Accuracy: 0.2276 CTCAccuracy: 0.1142 sec/iter: 0.5324
[1,0]<stderr>:INFO:absl:global_steps: 3312 learning_rate: 3.7029e-05 loss: 135.4046 Accuracy: 0.2076 CTCAccuracy: 0.0971 sec/iter: 0.4925
[1,0]<stderr>:INFO:absl:global_steps: 3322 learning_rate: 3.7141e-05 loss: 168.7331 Accuracy: 0.2426 CTCAccuracy: 0.1119 sec/iter: 0.5151
[1,0]<stderr>:INFO:absl:global_steps: 3332 learning_rate: 3.7253e-05 loss: 163.2872 Accuracy: 0.2574 CTCAccuracy: 0.1026 sec/iter: 0.5153
[1,0]<stderr>:INFO:absl:global_steps: 3342 learning_rate: 3.7365e-05 loss: 168.1546 Accuracy: 0.2259 CTCAccuracy: 0.1198 sec/iter: 0.5152
[1,0]<stderr>:INFO:absl:global_steps: 3352 learning_rate: 3.7476e-05 loss: 156.8849 Accuracy: 0.2372 CTCAccuracy: 0.1020 sec/iter: 0.5022
[1,0]<stderr>:INFO:absl:global_steps: 3362 learning_rate: 3.7588e-05 loss: 146.0330 Accuracy: 0.2215 CTCAccuracy: 0.1184 sec/iter: 0.4984
[1,0]<stderr>:INFO:absl:global_steps: 3372 learning_rate: 3.7700e-05 loss: 140.0961 Accuracy: 0.2236 CTCAccuracy: 0.1212 sec/iter: 0.4850
[1,0]<stderr>:INFO:absl:global_steps: 3382 learning_rate: 3.7812e-05 loss: 158.2572 Accuracy: 0.2411 CTCAccuracy: 0.1110 sec/iter: 0.4901
[1,0]<stderr>:INFO:absl:global_steps: 3392 learning_rate: 3.7924e-05 loss: 156.1621 Accuracy: 0.2340 CTCAccuracy: 0.1115 sec/iter: 0.4939
[1,0]<stderr>:INFO:absl:global_steps: 3402 learning_rate: 3.8036e-05 loss: 157.0611 Accuracy: 0.2456 CTCAccuracy: 0.1238 sec/iter: 0.4889
[1,0]<stderr>:INFO:absl:global_steps: 3412 learning_rate: 3.8147e-05 loss: 164.9370 Accuracy: 0.2208 CTCAccuracy: 0.1253 sec/iter: 0.5140
[1,0]<stderr>:INFO:absl:global_steps: 3422 learning_rate: 3.8259e-05 loss: 159.2752 Accuracy: 0.2419 CTCAccuracy: 0.1171 sec/iter: 0.4685
[1,0]<stderr>:INFO:absl:global_steps: 3432 learning_rate: 3.8371e-05 loss: 163.7039 Accuracy: 0.2739 CTCAccuracy: 0.1045 sec/iter: 0.4874
[1,0]<stderr>:INFO:absl:global_steps: 3442 learning_rate: 3.8483e-05 loss: 141.0573 Accuracy: 0.2410 CTCAccuracy: 0.1250 sec/iter: 0.4806
[1,0]<stderr>:INFO:absl:global_steps: 3452 learning_rate: 3.8595e-05 loss: 155.2927 Accuracy: 0.2520 CTCAccuracy: 0.1151 sec/iter: 0.5358
[1,0]<stderr>:INFO:absl:global_steps: 3462 learning_rate: 3.8706e-05 loss: 157.0276 Accuracy: 0.2297 CTCAccuracy: 0.1262 sec/iter: 0.5070
[1,0]<stderr>:INFO:absl:global_steps: 3472 learning_rate: 3.8818e-05 loss: 156.7075 Accuracy: 0.2621 CTCAccuracy: 0.1182 sec/iter: 0.5141
[1,0]<stderr>:INFO:absl:global_steps: 3482 learning_rate: 3.8930e-05 loss: 147.9864 Accuracy: 0.2603 CTCAccuracy: 0.1190 sec/iter: 0.5208
[1,0]<stderr>:INFO:absl:global_steps: 3492 learning_rate: 3.9042e-05 loss: 151.3907 Accuracy: 0.2396 CTCAccuracy: 0.1183 sec/iter: 0.4972
[1,0]<stderr>:INFO:absl:global_steps: 3502 learning_rate: 3.9154e-05 loss: 161.4901 Accuracy: 0.2453 CTCAccuracy: 0.1225 sec/iter: 0.5236
[1,0]<stderr>:INFO:absl:global_steps: 3512 learning_rate: 3.9265e-05 loss: 164.0286 Accuracy: 0.2432 CTCAccuracy: 0.1278 sec/iter: 0.4881
[1,0]<stderr>:INFO:absl:global_steps: 3522 learning_rate: 3.9377e-05 loss: 165.4756 Accuracy: 0.2943 CTCAccuracy: 0.1315 sec/iter: 0.5361
[1,0]<stderr>:INFO:absl:global_steps: 3532 learning_rate: 3.9489e-05 loss: 148.0261 Accuracy: 0.2753 CTCAccuracy: 0.1311 sec/iter: 0.4960
[1,0]<stderr>:INFO:absl:global_steps: 3542 learning_rate: 3.9601e-05 loss: 146.2114 Accuracy: 0.2456 CTCAccuracy: 0.1425 sec/iter: 0.5062
[1,0]<stderr>:INFO:absl:global_steps: 3552 learning_rate: 3.9713e-05 loss: 140.2585 Accuracy: 0.2718 CTCAccuracy: 0.1314 sec/iter: 0.5089
[1,0]<stderr>:INFO:absl:global_steps: 3562 learning_rate: 3.9824e-05 loss: 133.9342 Accuracy: 0.2718 CTCAccuracy: 0.1394 sec/iter: 0.4915
[1,0]<stderr>:INFO:absl:global_steps: 3572 learning_rate: 3.9936e-05 loss: 164.9926 Accuracy: 0.2469 CTCAccuracy: 0.1289 sec/iter: 0.5161
[1,0]<stderr>:INFO:absl:global_steps: 3582 learning_rate: 4.0048e-05 loss: 174.4803 Accuracy: 0.2543 CTCAccuracy: 0.1266 sec/iter: 0.4879
[1,0]<stderr>:INFO:absl:global_steps: 3592 learning_rate: 4.0160e-05 loss: 144.8828 Accuracy: 0.2568 CTCAccuracy: 0.1356 sec/iter: 0.4979
[1,0]<stderr>:INFO:absl:global_steps: 3602 learning_rate: 4.0272e-05 loss: 149.7460 Accuracy: 0.2713 CTCAccuracy: 0.1207 sec/iter: 0.4811
[1,0]<stderr>:INFO:absl:global_steps: 3612 learning_rate: 4.0383e-05 loss: 129.0918 Accuracy: 0.2834 CTCAccuracy: 0.1351 sec/iter: 0.5139
[1,0]<stderr>:INFO:absl:global_steps: 3622 learning_rate: 4.0495e-05 loss: 145.7905 Accuracy: 0.2561 CTCAccuracy: 0.1288 sec/iter: 0.5038
[1,0]<stderr>:INFO:absl:global_steps: 3632 learning_rate: 4.0607e-05 loss: 129.6169 Accuracy: 0.2810 CTCAccuracy: 0.1477 sec/iter: 0.4674
[1,0]<stderr>:INFO:absl:global_steps: 3642 learning_rate: 4.0719e-05 loss: 126.2148 Accuracy: 0.2707 CTCAccuracy: 0.1210 sec/iter: 0.4857
[1,0]<stderr>:INFO:absl:global_steps: 3652 learning_rate: 4.0831e-05 loss: 142.6204 Accuracy: 0.2569 CTCAccuracy: 0.1410 sec/iter: 0.5044
[1,0]<stderr>:INFO:absl:global_steps: 3662 learning_rate: 4.0942e-05 loss: 145.3462 Accuracy: 0.2609 CTCAccuracy: 0.1337 sec/iter: 0.5031
[1,0]<stderr>:INFO:absl:global_steps: 3672 learning_rate: 4.1054e-05 loss: 139.3558 Accuracy: 0.2769 CTCAccuracy: 0.1314 sec/iter: 0.5100
[1,0]<stderr>:INFO:absl:global_steps: 3682 learning_rate: 4.1166e-05 loss: 141.3438 Accuracy: 0.2794 CTCAccuracy: 0.1535 sec/iter: 0.5050
[1,0]<stderr>:INFO:absl:global_steps: 3692 learning_rate: 4.1278e-05 loss: 120.2864 Accuracy: 0.2678 CTCAccuracy: 0.1383 sec/iter: 0.4947
[1,0]<stderr>:INFO:absl:global_steps: 3702 learning_rate: 4.1390e-05 loss: 130.2971 Accuracy: 0.2741 CTCAccuracy: 0.1470 sec/iter: 0.5107
[1,0]<stderr>:INFO:absl:global_steps: 3712 learning_rate: 4.1501e-05 loss: 137.7590 Accuracy: 0.2802 CTCAccuracy: 0.1445 sec/iter: 0.5224
[1,0]<stderr>:INFO:absl:global_steps: 3722 learning_rate: 4.1613e-05 loss: 149.7298 Accuracy: 0.2720 CTCAccuracy: 0.1542 sec/iter: 0.5260
[1,0]<stderr>:INFO:absl:global_steps: 3732 learning_rate: 4.1725e-05 loss: 141.3852 Accuracy: 0.2815 CTCAccuracy: 0.1398 sec/iter: 0.4609
[1,0]<stderr>:INFO:absl:global_steps: 3742 learning_rate: 4.1837e-05 loss: 142.4189 Accuracy: 0.2783 CTCAccuracy: 0.1446 sec/iter: 0.5032
[1,0]<stderr>:INFO:absl:>>>>> start evaluate in epoch 1
[1,0]<stderr>:INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_recognition.SpeechRecognitionDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/dev.csv'), ('input_length_range', [10, 15000]), ('output_length_range', [1, 10000]), ('remove_unk', True), ('speed_permutation', [1.0]), ('text_config', {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'})]
[1,0]<stdout>:Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
[1,0]<stderr>:INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
[1,0]<stderr>:INFO:absl:Loading data from examples/asr/thchs30/data/dev.csv
[1,0]<stdout>:before filter by unk:893
[1,0]<stdout>:after filter by unk:893
[1,0]<stdout>:afiter filter by input length:893
[1,0]<stdout>:after filter by output length:893
[1,1]<stderr>:INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_recognition.SpeechRecognitionDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/dev.csv'), ('input_length_range', [10, 15000]), ('output_length_range', [1, 10000]), ('remove_unk', True), ('speed_permutation', [1.0]), ('text_config', {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'})]
[1,1]<stdout>:Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
[1,0]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,1]<stderr>:INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
[1,1]<stderr>:INFO:absl:Loading data from examples/asr/thchs30/data/dev.csv
[1,1]<stdout>:before filter by unk:893
[1,1]<stdout>:after filter by unk:893
[1,1]<stdout>:afiter filter by input length:893
[1,1]<stdout>:after filter by output length:893
[1,1]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,1]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:INFO:absl:loss: 92.7564 Accuracy: 0.2655 CTCAccuracy: 0.1525
[1,0]<stderr>:INFO:absl:loss: 116.4315 Accuracy: 0.2693 CTCAccuracy: 0.1708
[1,0]<stderr>:INFO:absl:loss: 127.9051 Accuracy: 0.2751 CTCAccuracy: 0.1776
[1,0]<stderr>:INFO:absl:loss: 128.8595 Accuracy: 0.2752 CTCAccuracy: 0.1711
[1,0]<stderr>:INFO:absl:loss: 127.3169 Accuracy: 0.2796 CTCAccuracy: 0.1695
[1,0]<stderr>:INFO:absl:loss: 132.1985 Accuracy: 0.2843 CTCAccuracy: 0.1662
[1,0]<stderr>:INFO:absl:loss: 137.5543 Accuracy: 0.2882 CTCAccuracy: 0.1669
[1,0]<stderr>:INFO:absl:loss: 135.9014 Accuracy: 0.2918 CTCAccuracy: 0.1640
[1,0]<stderr>:INFO:absl:loss: 147.9614 Accuracy: 0.2926 CTCAccuracy: 0.1639
[1,0]<stderr>:INFO:absl:loss: 150.5678 Accuracy: 0.2948 CTCAccuracy: 0.1624
[1,0]<stderr>:INFO:absl:loss: 139.3522 Accuracy: 0.2982 CTCAccuracy: 0.1610
[1,1]<stderr>:INFO:absl:perform batch_wise_shuffle with batch_size 8
[1,1]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,0]<stderr>:INFO:absl:loss: 148.6549 Accuracy: 0.2978 CTCAccuracy: 0.1588
[1,0]<stderr>:INFO:absl:epoch: 1 loss: 134.1923 Accuracy: 0.2978 CTCAccuracy: 0.1588
[1,0]<stderr>:INFO:absl:saving model in :examples/asr/thchs30/ckpts/mtl_transformer_ctc/ckpt
[1,0]<stderr>:INFO:absl:>>>>> start training in epoch 2
[1,0]<stderr>:INFO:absl:perform batch_wise_shuffle with batch_size 8
[1,0]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,1]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:INFO:absl:global_steps: 3743 learning_rate: 4.1848e-05 loss: 113.7596 Accuracy: 0.2228 CTCAccuracy: 0.1337 sec/iter: 66.3322
[1,0]<stderr>:INFO:absl:global_steps: 3753 learning_rate: 4.1960e-05 loss: 120.8736 Accuracy: 0.2905 CTCAccuracy: 0.1508 sec/iter: 0.4841
[1,0]<stderr>:INFO:absl:global_steps: 3763 learning_rate: 4.2072e-05 loss: 144.2999 Accuracy: 0.3156 CTCAccuracy: 0.1437 sec/iter: 0.4949
[1,0]<stderr>:INFO:absl:global_steps: 3773 learning_rate: 4.2183e-05 loss: 137.9420 Accuracy: 0.2999 CTCAccuracy: 0.1481 sec/iter: 0.4952
[1,0]<stderr>:INFO:absl:global_steps: 3783 learning_rate: 4.2295e-05 loss: 155.0527 Accuracy: 0.3112 CTCAccuracy: 0.1434 sec/iter: 0.5351
[1,0]<stderr>:INFO:absl:global_steps: 3793 learning_rate: 4.2407e-05 loss: 134.2270 Accuracy: 0.2929 CTCAccuracy: 0.1493 sec/iter: 0.4973
[1,0]<stderr>:INFO:absl:global_steps: 3803 learning_rate: 4.2519e-05 loss: 132.1023 Accuracy: 0.3061 CTCAccuracy: 0.1431 sec/iter: 0.5091
[1,0]<stderr>:INFO:absl:global_steps: 3813 learning_rate: 4.2631e-05 loss: 139.4626 Accuracy: 0.3181 CTCAccuracy: 0.1610 sec/iter: 0.5481
[1,0]<stderr>:INFO:absl:global_steps: 3823 learning_rate: 4.2742e-05 loss: 143.8769 Accuracy: 0.3148 CTCAccuracy: 0.1519 sec/iter: 0.5282
[1,0]<stderr>:INFO:absl:global_steps: 3833 learning_rate: 4.2854e-05 loss: 126.2943 Accuracy: 0.3128 CTCAccuracy: 0.1577 sec/iter: 0.5296
[1,0]<stderr>:INFO:absl:global_steps: 3843 learning_rate: 4.2966e-05 loss: 141.0374 Accuracy: 0.3025 CTCAccuracy: 0.1374 sec/iter: 0.5159
[1,0]<stderr>:INFO:absl:global_steps: 3853 learning_rate: 4.3078e-05 loss: 131.3300 Accuracy: 0.3126 CTCAccuracy: 0.1405 sec/iter: 0.5150
[1,0]<stderr>:INFO:absl:global_steps: 3863 learning_rate: 4.3190e-05 loss: 139.5851 Accuracy: 0.3186 CTCAccuracy: 0.1552 sec/iter: 0.5158
[1,0]<stderr>:INFO:absl:global_steps: 3873 learning_rate: 4.3301e-05 loss: 147.0780 Accuracy: 0.3361 CTCAccuracy: 0.1733 sec/iter: 0.4899
[1,0]<stderr>:INFO:absl:global_steps: 3883 learning_rate: 4.3413e-05 loss: 111.7100 Accuracy: 0.3240 CTCAccuracy: 0.1435 sec/iter: 0.5454
[1,0]<stderr>:INFO:absl:global_steps: 3893 learning_rate: 4.3525e-05 loss: 141.2039 Accuracy: 0.3425 CTCAccuracy: 0.1472 sec/iter: 0.5399
[1,0]<stderr>:INFO:absl:global_steps: 3903 learning_rate: 4.3637e-05 loss: 124.0555 Accuracy: 0.3048 CTCAccuracy: 0.1567 sec/iter: 0.5503
[1,0]<stderr>:INFO:absl:global_steps: 3913 learning_rate: 4.3749e-05 loss: 142.4030 Accuracy: 0.3089 CTCAccuracy: 0.1592 sec/iter: 0.4937
[1,0]<stderr>:INFO:absl:global_steps: 3923 learning_rate: 4.3860e-05 loss: 137.2387 Accuracy: 0.3221 CTCAccuracy: 0.1462 sec/iter: 0.5170
[1,0]<stderr>:INFO:absl:global_steps: 3933 learning_rate: 4.3972e-05 loss: 131.1842 Accuracy: 0.3346 CTCAccuracy: 0.1721 sec/iter: 0.4887
[1,0]<stderr>:INFO:absl:global_steps: 3943 learning_rate: 4.4084e-05 loss: 145.8045 Accuracy: 0.3180 CTCAccuracy: 0.1576 sec/iter: 0.5137
[1,0]<stderr>:INFO:absl:global_steps: 3953 learning_rate: 4.4196e-05 loss: 139.5471 Accuracy: 0.3309 CTCAccuracy: 0.1595 sec/iter: 0.5336
[1,0]<stderr>:INFO:absl:global_steps: 3963 learning_rate: 4.4308e-05 loss: 119.7223 Accuracy: 0.3236 CTCAccuracy: 0.1598 sec/iter: 0.5210
[1,0]<stderr>:INFO:absl:global_steps: 3973 learning_rate: 4.4419e-05 loss: 132.8500 Accuracy: 0.3301 CTCAccuracy: 0.1561 sec/iter: 0.5105
[1,0]<stderr>:INFO:absl:global_steps: 3983 learning_rate: 4.4531e-05 loss: 146.9025 Accuracy: 0.3351 CTCAccuracy: 0.1502 sec/iter: 0.5259
[1,0]<stderr>:INFO:absl:global_steps: 3993 learning_rate: 4.4643e-05 loss: 110.6287 Accuracy: 0.3359 CTCAccuracy: 0.1609 sec/iter: 0.5146
[1,0]<stderr>:INFO:absl:global_steps: 4003 learning_rate: 4.4755e-05 loss: 142.3387 Accuracy: 0.3573 CTCAccuracy: 0.1531 sec/iter: 0.5154
[1,0]<stderr>:INFO:absl:global_steps: 4013 learning_rate: 4.4867e-05 loss: 124.7979 Accuracy: 0.3352 CTCAccuracy: 0.1422 sec/iter: 0.5081
[1,0]<stderr>:INFO:absl:global_steps: 4023 learning_rate: 4.4979e-05 loss: 130.1436 Accuracy: 0.3470 CTCAccuracy: 0.1538 sec/iter: 0.5119
[1,0]<stderr>:INFO:absl:global_steps: 4033 learning_rate: 4.5090e-05 loss: 116.3231 Accuracy: 0.3263 CTCAccuracy: 0.1606 sec/iter: 0.4708
[1,0]<stderr>:INFO:absl:global_steps: 4043 learning_rate: 4.5202e-05 loss: 125.0963 Accuracy: 0.3589 CTCAccuracy: 0.1609 sec/iter: 0.5429
[1,0]<stderr>:INFO:absl:global_steps: 4053 learning_rate: 4.5314e-05 loss: 143.4653 Accuracy: 0.3376 CTCAccuracy: 0.1679 sec/iter: 0.5159
[1,0]<stderr>:INFO:absl:global_steps: 4063 learning_rate: 4.5426e-05 loss: 126.8832 Accuracy: 0.3581 CTCAccuracy: 0.1580 sec/iter: 0.4895
[1,0]<stderr>:INFO:absl:global_steps: 4073 learning_rate: 4.5538e-05 loss: 128.9706 Accuracy: 0.3577 CTCAccuracy: 0.1721 sec/iter: 0.5043
[1,0]<stderr>:INFO:absl:global_steps: 4083 learning_rate: 4.5649e-05 loss: 137.0126 Accuracy: 0.3687 CTCAccuracy: 0.1682 sec/iter: 0.5440
[1,0]<stderr>:INFO:absl:global_steps: 4093 learning_rate: 4.5761e-05 loss: 132.1545 Accuracy: 0.3680 CTCAccuracy: 0.1677 sec/iter: 0.5001
[1,0]<stderr>:INFO:absl:global_steps: 4103 learning_rate: 4.5873e-05 loss: 128.4430 Accuracy: 0.3728 CTCAccuracy: 0.1729 sec/iter: 0.5470
[1,0]<stderr>:INFO:absl:global_steps: 4113 learning_rate: 4.5985e-05 loss: 135.5235 Accuracy: 0.3441 CTCAccuracy: 0.1594 sec/iter: 0.4916
[1,0]<stderr>:INFO:absl:global_steps: 4123 learning_rate: 4.6097e-05 loss: 125.6838 Accuracy: 0.3708 CTCAccuracy: 0.1660 sec/iter: 0.5446
[1,0]<stderr>:INFO:absl:global_steps: 4133 learning_rate: 4.6208e-05 loss: 113.4418 Accuracy: 0.3592 CTCAccuracy: 0.1535 sec/iter: 0.4778
[1,0]<stderr>:INFO:absl:global_steps: 4143 learning_rate: 4.6320e-05 loss: 138.3230 Accuracy: 0.3984 CTCAccuracy: 0.1729 sec/iter: 0.4875
[1,0]<stderr>:INFO:absl:global_steps: 4153 learning_rate: 4.6432e-05 loss: 100.7225 Accuracy: 0.4010 CTCAccuracy: 0.1916 sec/iter: 0.5156
[1,0]<stderr>:INFO:absl:global_steps: 4163 learning_rate: 4.6544e-05 loss: 114.5786 Accuracy: 0.3670 CTCAccuracy: 0.1635 sec/iter: 0.4751
[1,0]<stderr>:INFO:absl:global_steps: 4173 learning_rate: 4.6656e-05 loss: 126.2112 Accuracy: 0.3783 CTCAccuracy: 0.1634 sec/iter: 0.4928
[1,0]<stderr>:INFO:absl:global_steps: 4183 learning_rate: 4.6767e-05 loss: 100.4150 Accuracy: 0.3580 CTCAccuracy: 0.1746 sec/iter: 0.4652
[1,0]<stderr>:INFO:absl:global_steps: 4193 learning_rate: 4.6879e-05 loss: 121.1741 Accuracy: 0.4051 CTCAccuracy: 0.1622 sec/iter: 0.5295
[1,0]<stderr>:INFO:absl:global_steps: 4203 learning_rate: 4.6991e-05 loss: 133.0445 Accuracy: 0.3873 CTCAccuracy: 0.1805 sec/iter: 0.5290
[1,0]<stderr>:INFO:absl:global_steps: 4213 learning_rate: 4.7103e-05 loss: 154.6612 Accuracy: 0.3837 CTCAccuracy: 0.1749 sec/iter: 0.5098
[1,0]<stderr>:INFO:absl:global_steps: 4223 learning_rate: 4.7215e-05 loss: 119.1598 Accuracy: 0.4000 CTCAccuracy: 0.1701 sec/iter: 0.5330
[1,0]<stderr>:INFO:absl:global_steps: 4233 learning_rate: 4.7326e-05 loss: 123.3386 Accuracy: 0.3724 CTCAccuracy: 0.1900 sec/iter: 0.5303
[1,0]<stderr>:INFO:absl:global_steps: 4243 learning_rate: 4.7438e-05 loss: 135.8512 Accuracy: 0.4085 CTCAccuracy: 0.1903 sec/iter: 0.5150
[1,0]<stderr>:INFO:absl:global_steps: 4253 learning_rate: 4.7550e-05 loss: 121.1786 Accuracy: 0.3886 CTCAccuracy: 0.1646 sec/iter: 0.5233
[1,0]<stderr>:INFO:absl:global_steps: 4263 learning_rate: 4.7662e-05 loss: 124.3240 Accuracy: 0.4015 CTCAccuracy: 0.1803 sec/iter: 0.5216
[1,0]<stderr>:INFO:absl:global_steps: 4273 learning_rate: 4.7774e-05 loss: 125.6750 Accuracy: 0.4431 CTCAccuracy: 0.1792 sec/iter: 0.5372
[1,0]<stderr>:INFO:absl:global_steps: 4283 learning_rate: 4.7885e-05 loss: 115.0892 Accuracy: 0.3966 CTCAccuracy: 0.1886 sec/iter: 0.4899
[1,0]<stderr>:INFO:absl:global_steps: 4293 learning_rate: 4.7997e-05 loss: 108.2699 Accuracy: 0.4021 CTCAccuracy: 0.1722 sec/iter: 0.5193
[1,0]<stderr>:INFO:absl:global_steps: 4303 learning_rate: 4.8109e-05 loss: 118.7293 Accuracy: 0.4221 CTCAccuracy: 0.1754 sec/iter: 0.5265
[1,0]<stderr>:INFO:absl:global_steps: 4313 learning_rate: 4.8221e-05 loss: 102.0635 Accuracy: 0.4134 CTCAccuracy: 0.1743 sec/iter: 0.5095
[1,0]<stderr>:INFO:absl:global_steps: 4323 learning_rate: 4.8333e-05 loss: 119.0098 Accuracy: 0.4455 CTCAccuracy: 0.1764 sec/iter: 0.4938
[1,0]<stderr>:INFO:absl:global_steps: 4333 learning_rate: 4.8444e-05 loss: 106.1624 Accuracy: 0.4110 CTCAccuracy: 0.1834 sec/iter: 0.5192
[1,0]<stderr>:INFO:absl:global_steps: 4343 learning_rate: 4.8556e-05 loss: 121.2999 Accuracy: 0.4284 CTCAccuracy: 0.1645 sec/iter: 0.5343
[1,0]<stderr>:INFO:absl:global_steps: 4353 learning_rate: 4.8668e-05 loss: 111.3314 Accuracy: 0.4453 CTCAccuracy: 0.1817 sec/iter: 0.5207
[1,0]<stderr>:INFO:absl:global_steps: 4363 learning_rate: 4.8780e-05 loss: 116.4530 Accuracy: 0.4408 CTCAccuracy: 0.1920 sec/iter: 0.5099
[1,0]<stderr>:INFO:absl:global_steps: 4373 learning_rate: 4.8892e-05 loss: 118.8592 Accuracy: 0.4265 CTCAccuracy: 0.1973 sec/iter: 0.5432
[1,0]<stderr>:INFO:absl:global_steps: 4383 learning_rate: 4.9003e-05 loss: 120.6527 Accuracy: 0.4418 CTCAccuracy: 0.1782 sec/iter: 0.5492
[1,0]<stderr>:INFO:absl:global_steps: 4393 learning_rate: 4.9115e-05 loss: 125.8778 Accuracy: 0.4319 CTCAccuracy: 0.1860 sec/iter: 0.4901
[1,0]<stderr>:INFO:absl:global_steps: 4403 learning_rate: 4.9227e-05 loss: 120.3756 Accuracy: 0.4055 CTCAccuracy: 0.1787 sec/iter: 0.5135
[1,0]<stderr>:INFO:absl:global_steps: 4413 learning_rate: 4.9339e-05 loss: 120.2269 Accuracy: 0.4176 CTCAccuracy: 0.1904 sec/iter: 0.4960
[1,0]<stderr>:INFO:absl:global_steps: 4423 learning_rate: 4.9451e-05 loss: 122.8696 Accuracy: 0.4502 CTCAccuracy: 0.1920 sec/iter: 0.5513
[1,0]<stderr>:INFO:absl:global_steps: 4433 learning_rate: 4.9562e-05 loss: 103.9131 Accuracy: 0.4153 CTCAccuracy: 0.1763 sec/iter: 0.5266
[1,0]<stderr>:INFO:absl:global_steps: 4443 learning_rate: 4.9674e-05 loss: 122.2341 Accuracy: 0.4236 CTCAccuracy: 0.1969 sec/iter: 0.5261
[1,0]<stderr>:INFO:absl:global_steps: 4453 learning_rate: 4.9786e-05 loss: 116.0219 Accuracy: 0.4527 CTCAccuracy: 0.1755 sec/iter: 0.5313
[1,0]<stderr>:INFO:absl:global_steps: 4463 learning_rate: 4.9898e-05 loss: 119.1239 Accuracy: 0.4299 CTCAccuracy: 0.1907 sec/iter: 0.5030
[1,0]<stderr>:INFO:absl:global_steps: 4473 learning_rate: 5.0010e-05 loss: 124.3230 Accuracy: 0.4470 CTCAccuracy: 0.1927 sec/iter: 0.5126
[1,0]<stderr>:INFO:absl:global_steps: 4483 learning_rate: 5.0121e-05 loss: 104.8344 Accuracy: 0.4756 CTCAccuracy: 0.1786 sec/iter: 0.5176
[1,0]<stderr>:INFO:absl:global_steps: 4493 learning_rate: 5.0233e-05 loss: 99.9008 Accuracy: 0.4828 CTCAccuracy: 0.1982 sec/iter: 0.5225
[1,0]<stderr>:INFO:absl:global_steps: 4503 learning_rate: 5.0345e-05 loss: 109.1396 Accuracy: 0.4786 CTCAccuracy: 0.1818 sec/iter: 0.5279
[1,0]<stderr>:INFO:absl:global_steps: 4513 learning_rate: 5.0457e-05 loss: 120.3318 Accuracy: 0.4648 CTCAccuracy: 0.1921 sec/iter: 0.5368
[1,0]<stderr>:INFO:absl:global_steps: 4523 learning_rate: 5.0569e-05 loss: 125.0047 Accuracy: 0.4800 CTCAccuracy: 0.1942 sec/iter: 0.5292
[1,0]<stderr>:INFO:absl:global_steps: 4533 learning_rate: 5.0680e-05 loss: 132.6775 Accuracy: 0.4534 CTCAccuracy: 0.1761 sec/iter: 0.5398
[1,0]<stderr>:INFO:absl:global_steps: 4543 learning_rate: 5.0792e-05 loss: 121.3897 Accuracy: 0.4659 CTCAccuracy: 0.1955 sec/iter: 0.4951
[1,0]<stderr>:INFO:absl:global_steps: 4553 learning_rate: 5.0904e-05 loss: 102.9724 Accuracy: 0.4538 CTCAccuracy: 0.1812 sec/iter: 0.5141
[1,0]<stderr>:INFO:absl:global_steps: 4563 learning_rate: 5.1016e-05 loss: 117.7613 Accuracy: 0.4623 CTCAccuracy: 0.2005 sec/iter: 0.5192
[1,0]<stderr>:INFO:absl:global_steps: 4573 learning_rate: 5.1128e-05 loss: 107.7686 Accuracy: 0.4805 CTCAccuracy: 0.2002 sec/iter: 0.5061
[1,0]<stderr>:INFO:absl:global_steps: 4583 learning_rate: 5.1239e-05 loss: 116.8086 Accuracy: 0.4798 CTCAccuracy: 0.1934 sec/iter: 0.5203
[1,0]<stderr>:INFO:absl:global_steps: 4593 learning_rate: 5.1351e-05 loss: 112.7117 Accuracy: 0.4843 CTCAccuracy: 0.1927 sec/iter: 0.5102
[1,0]<stderr>:INFO:absl:global_steps: 4603 learning_rate: 5.1463e-05 loss: 104.3841 Accuracy: 0.5082 CTCAccuracy: 0.1876 sec/iter: 0.5188
[1,0]<stderr>:INFO:absl:global_steps: 4613 learning_rate: 5.1575e-05 loss: 108.7880 Accuracy: 0.5059 CTCAccuracy: 0.2135 sec/iter: 0.5169
[1,0]<stderr>:INFO:absl:global_steps: 4623 learning_rate: 5.1687e-05 loss: 108.0007 Accuracy: 0.5050 CTCAccuracy: 0.2070 sec/iter: 0.4992
[1,0]<stderr>:INFO:absl:global_steps: 4633 learning_rate: 5.1799e-05 loss: 118.8467 Accuracy: 0.4991 CTCAccuracy: 0.2050 sec/iter: 0.5156
[1,0]<stderr>:INFO:absl:global_steps: 4643 learning_rate: 5.1910e-05 loss: 106.3136 Accuracy: 0.5039 CTCAccuracy: 0.1984 sec/iter: 0.5160
[1,0]<stderr>:INFO:absl:global_steps: 4653 learning_rate: 5.2022e-05 loss: 90.9521 Accuracy: 0.5218 CTCAccuracy: 0.1819 sec/iter: 0.4794
[1,0]<stderr>:INFO:absl:global_steps: 4663 learning_rate: 5.2134e-05 loss: 93.8855 Accuracy: 0.4769 CTCAccuracy: 0.1900 sec/iter: 0.5459
[1,0]<stderr>:INFO:absl:global_steps: 4673 learning_rate: 5.2246e-05 loss: 111.6322 Accuracy: 0.4931 CTCAccuracy: 0.1904 sec/iter: 0.5263
[1,0]<stderr>:INFO:absl:global_steps: 4683 learning_rate: 5.2358e-05 loss: 104.4508 Accuracy: 0.4935 CTCAccuracy: 0.2032 sec/iter: 0.5060
[1,0]<stderr>:INFO:absl:global_steps: 4693 learning_rate: 5.2469e-05 loss: 98.9909 Accuracy: 0.5088 CTCAccuracy: 0.1991 sec/iter: 0.4899
[1,0]<stderr>:INFO:absl:global_steps: 4703 learning_rate: 5.2581e-05 loss: 103.3782 Accuracy: 0.5198 CTCAccuracy: 0.2000 sec/iter: 0.4994
[1,0]<stderr>:INFO:absl:global_steps: 4713 learning_rate: 5.2693e-05 loss: 99.6416 Accuracy: 0.5199 CTCAccuracy: 0.2076 sec/iter: 0.5009
[1,0]<stderr>:INFO:absl:global_steps: 4723 learning_rate: 5.2805e-05 loss: 131.9154 Accuracy: 0.4907 CTCAccuracy: 0.2014 sec/iter: 0.4860
[1,0]<stderr>:INFO:absl:global_steps: 4733 learning_rate: 5.2917e-05 loss: 101.8291 Accuracy: 0.5036 CTCAccuracy: 0.2004 sec/iter: 0.4755
[1,0]<stderr>:INFO:absl:global_steps: 4743 learning_rate: 5.3028e-05 loss: 99.0289 Accuracy: 0.5313 CTCAccuracy: 0.1967 sec/iter: 0.5096
[1,0]<stderr>:INFO:absl:global_steps: 4753 learning_rate: 5.3140e-05 loss: 90.0337 Accuracy: 0.5267 CTCAccuracy: 0.1985 sec/iter: 0.5065
[1,0]<stderr>:INFO:absl:global_steps: 4763 learning_rate: 5.3252e-05 loss: 101.2851 Accuracy: 0.5328 CTCAccuracy: 0.2213 sec/iter: 0.5274
[1,0]<stderr>:INFO:absl:global_steps: 4773 learning_rate: 5.3364e-05 loss: 90.6875 Accuracy: 0.5253 CTCAccuracy: 0.2021 sec/iter: 0.5271
[1,0]<stderr>:INFO:absl:global_steps: 4783 learning_rate: 5.3476e-05 loss: 84.7121 Accuracy: 0.5444 CTCAccuracy: 0.1885 sec/iter: 0.5225
[1,0]<stderr>:INFO:absl:global_steps: 4793 learning_rate: 5.3587e-05 loss: 117.8168 Accuracy: 0.5558 CTCAccuracy: 0.2057 sec/iter: 0.4935
[1,0]<stderr>:INFO:absl:global_steps: 4803 learning_rate: 5.3699e-05 loss: 95.2634 Accuracy: 0.5355 CTCAccuracy: 0.2192 sec/iter: 0.5063
[1,0]<stderr>:INFO:absl:global_steps: 4813 learning_rate: 5.3811e-05 loss: 96.5155 Accuracy: 0.5783 CTCAccuracy: 0.2094 sec/iter: 0.5230
[1,0]<stderr>:INFO:absl:global_steps: 4823 learning_rate: 5.3923e-05 loss: 79.5108 Accuracy: 0.5258 CTCAccuracy: 0.2118 sec/iter: 0.4939
[1,0]<stderr>:INFO:absl:global_steps: 4833 learning_rate: 5.4035e-05 loss: 101.5877 Accuracy: 0.5480 CTCAccuracy: 0.1934 sec/iter: 0.4881
[1,0]<stderr>:INFO:absl:global_steps: 4843 learning_rate: 5.4146e-05 loss: 95.7761 Accuracy: 0.5217 CTCAccuracy: 0.2127 sec/iter: 0.5060
[1,0]<stderr>:INFO:absl:global_steps: 4853 learning_rate: 5.4258e-05 loss: 98.1653 Accuracy: 0.5610 CTCAccuracy: 0.2015 sec/iter: 0.5423
[1,0]<stderr>:INFO:absl:global_steps: 4863 learning_rate: 5.4370e-05 loss: 109.9502 Accuracy: 0.5463 CTCAccuracy: 0.2231 sec/iter: 0.5147
[1,0]<stderr>:INFO:absl:global_steps: 4873 learning_rate: 5.4482e-05 loss: 104.4598 Accuracy: 0.5739 CTCAccuracy: 0.2076 sec/iter: 0.5423
[1,0]<stderr>:INFO:absl:global_steps: 4883 learning_rate: 5.4594e-05 loss: 103.5842 Accuracy: 0.5844 CTCAccuracy: 0.2065 sec/iter: 0.4972
[1,0]<stderr>:INFO:absl:global_steps: 4893 learning_rate: 5.4705e-05 loss: 102.5248 Accuracy: 0.5919 CTCAccuracy: 0.2138 sec/iter: 0.5120
[1,0]<stderr>:INFO:absl:global_steps: 4903 learning_rate: 5.4817e-05 loss: 98.7228 Accuracy: 0.5756 CTCAccuracy: 0.2034 sec/iter: 0.5267
[1,0]<stderr>:INFO:absl:global_steps: 4913 learning_rate: 5.4929e-05 loss: 91.7630 Accuracy: 0.5564 CTCAccuracy: 0.2198 sec/iter: 0.5124
[1,0]<stderr>:INFO:absl:global_steps: 4923 learning_rate: 5.5041e-05 loss: 93.4146 Accuracy: 0.6147 CTCAccuracy: 0.2098 sec/iter: 0.5082
[1,0]<stderr>:INFO:absl:global_steps: 4933 learning_rate: 5.5153e-05 loss: 97.1316 Accuracy: 0.5800 CTCAccuracy: 0.2016 sec/iter: 0.5113
[1,0]<stderr>:INFO:absl:global_steps: 4943 learning_rate: 5.5264e-05 loss: 81.8216 Accuracy: 0.6087 CTCAccuracy: 0.2182 sec/iter: 0.5056
[1,0]<stderr>:INFO:absl:global_steps: 4953 learning_rate: 5.5376e-05 loss: 94.9047 Accuracy: 0.6069 CTCAccuracy: 0.2196 sec/iter: 0.5143
[1,0]<stderr>:INFO:absl:global_steps: 4963 learning_rate: 5.5488e-05 loss: 102.5701 Accuracy: 0.6128 CTCAccuracy: 0.2282 sec/iter: 0.5242
[1,0]<stderr>:INFO:absl:global_steps: 4973 learning_rate: 5.5600e-05 loss: 98.1724 Accuracy: 0.6200 CTCAccuracy: 0.2239 sec/iter: 0.5191
[1,0]<stderr>:INFO:absl:global_steps: 4983 learning_rate: 5.5712e-05 loss: 109.5492 Accuracy: 0.6298 CTCAccuracy: 0.2163 sec/iter: 0.4929
[1,0]<stderr>:INFO:absl:global_steps: 4993 learning_rate: 5.5823e-05 loss: 102.1132 Accuracy: 0.5897 CTCAccuracy: 0.2034 sec/iter: 0.5088
[1,0]<stderr>:INFO:absl:global_steps: 5003 learning_rate: 5.5935e-05 loss: 115.3296 Accuracy: 0.5792 CTCAccuracy: 0.2060 sec/iter: 0.4846
[1,0]<stderr>:INFO:absl:global_steps: 5013 learning_rate: 5.6047e-05 loss: 89.4462 Accuracy: 0.5908 CTCAccuracy: 0.2338 sec/iter: 0.4893
[1,0]<stderr>:INFO:absl:global_steps: 5023 learning_rate: 5.6159e-05 loss: 96.5373 Accuracy: 0.6234 CTCAccuracy: 0.2160 sec/iter: 0.5274
[1,0]<stderr>:INFO:absl:global_steps: 5033 learning_rate: 5.6271e-05 loss: 92.3879 Accuracy: 0.6165 CTCAccuracy: 0.2212 sec/iter: 0.4914
[1,0]<stderr>:INFO:absl:global_steps: 5043 learning_rate: 5.6382e-05 loss: 87.3994 Accuracy: 0.6257 CTCAccuracy: 0.2181 sec/iter: 0.4591
[1,0]<stderr>:INFO:absl:global_steps: 5053 learning_rate: 5.6494e-05 loss: 101.0725 Accuracy: 0.6202 CTCAccuracy: 0.1955 sec/iter: 0.4874
[1,0]<stderr>:INFO:absl:global_steps: 5063 learning_rate: 5.6606e-05 loss: 99.0735 Accuracy: 0.6386 CTCAccuracy: 0.2109 sec/iter: 0.5120
[1,0]<stderr>:INFO:absl:global_steps: 5073 learning_rate: 5.6718e-05 loss: 102.9287 Accuracy: 0.6278 CTCAccuracy: 0.2098 sec/iter: 0.5176
[1,0]<stderr>:INFO:absl:global_steps: 5083 learning_rate: 5.6830e-05 loss: 123.7954 Accuracy: 0.6354 CTCAccuracy: 0.2163 sec/iter: 0.5065
[1,0]<stderr>:INFO:absl:global_steps: 5093 learning_rate: 5.6941e-05 loss: 92.8499 Accuracy: 0.6732 CTCAccuracy: 0.2187 sec/iter: 0.5148
[1,0]<stderr>:INFO:absl:global_steps: 5103 learning_rate: 5.7053e-05 loss: 102.4156 Accuracy: 0.6891 CTCAccuracy: 0.1982 sec/iter: 0.5415
[1,0]<stderr>:INFO:absl:global_steps: 5113 learning_rate: 5.7165e-05 loss: 83.6439 Accuracy: 0.6348 CTCAccuracy: 0.2350 sec/iter: 0.4841
[1,0]<stderr>:INFO:absl:global_steps: 5123 learning_rate: 5.7277e-05 loss: 92.6497 Accuracy: 0.6202 CTCAccuracy: 0.2105 sec/iter: 0.4991
[1,0]<stderr>:INFO:absl:global_steps: 5133 learning_rate: 5.7389e-05 loss: 85.7386 Accuracy: 0.6700 CTCAccuracy: 0.2077 sec/iter: 0.4930
[1,0]<stderr>:INFO:absl:global_steps: 5143 learning_rate: 5.7500e-05 loss: 82.3397 Accuracy: 0.6426 CTCAccuracy: 0.1907 sec/iter: 0.5241
[1,0]<stderr>:INFO:absl:global_steps: 5153 learning_rate: 5.7612e-05 loss: 95.6016 Accuracy: 0.6355 CTCAccuracy: 0.2214 sec/iter: 0.5169
[1,0]<stderr>:INFO:absl:global_steps: 5163 learning_rate: 5.7724e-05 loss: 99.4559 Accuracy: 0.6457 CTCAccuracy: 0.2183 sec/iter: 0.5005
[1,0]<stderr>:INFO:absl:global_steps: 5173 learning_rate: 5.7836e-05 loss: 118.1766 Accuracy: 0.6858 CTCAccuracy: 0.1960 sec/iter: 0.5296
[1,0]<stderr>:INFO:absl:global_steps: 5183 learning_rate: 5.7948e-05 loss: 96.0516 Accuracy: 0.6582 CTCAccuracy: 0.2044 sec/iter: 0.5513
[1,0]<stderr>:INFO:absl:global_steps: 5193 learning_rate: 5.8060e-05 loss: 97.6494 Accuracy: 0.6778 CTCAccuracy: 0.2118 sec/iter: 0.5027
[1,0]<stderr>:INFO:absl:global_steps: 5203 learning_rate: 5.8171e-05 loss: 88.2734 Accuracy: 0.7011 CTCAccuracy: 0.2236 sec/iter: 0.5097
[1,0]<stderr>:INFO:absl:global_steps: 5213 learning_rate: 5.8283e-05 loss: 95.5788 Accuracy: 0.6670 CTCAccuracy: 0.2212 sec/iter: 0.4954
[1,0]<stderr>:INFO:absl:global_steps: 5223 learning_rate: 5.8395e-05 loss: 80.5820 Accuracy: 0.6996 CTCAccuracy: 0.2124 sec/iter: 0.5262
[1,0]<stderr>:INFO:absl:global_steps: 5233 learning_rate: 5.8507e-05 loss: 81.8283 Accuracy: 0.6886 CTCAccuracy: 0.2218 sec/iter: 0.5293
[1,0]<stderr>:INFO:absl:global_steps: 5243 learning_rate: 5.8619e-05 loss: 85.9700 Accuracy: 0.6919 CTCAccuracy: 0.2204 sec/iter: 0.5377
[1,0]<stderr>:INFO:absl:global_steps: 5253 learning_rate: 5.8730e-05 loss: 88.6322 Accuracy: 0.6743 CTCAccuracy: 0.2333 sec/iter: 0.4821
[1,0]<stderr>:INFO:absl:global_steps: 5263 learning_rate: 5.8842e-05 loss: 93.0800 Accuracy: 0.7134 CTCAccuracy: 0.2188 sec/iter: 0.5269
[1,0]<stderr>:INFO:absl:global_steps: 5273 learning_rate: 5.8954e-05 loss: 69.9162 Accuracy: 0.7065 CTCAccuracy: 0.2316 sec/iter: 0.4833
[1,0]<stderr>:INFO:absl:global_steps: 5283 learning_rate: 5.9066e-05 loss: 91.3350 Accuracy: 0.6895 CTCAccuracy: 0.2203 sec/iter: 0.4936
[1,0]<stderr>:INFO:absl:global_steps: 5293 learning_rate: 5.9178e-05 loss: 103.2391 Accuracy: 0.7091 CTCAccuracy: 0.2182 sec/iter: 0.4922
[1,0]<stderr>:INFO:absl:global_steps: 5303 learning_rate: 5.9289e-05 loss: 93.6416 Accuracy: 0.7070 CTCAccuracy: 0.2252 sec/iter: 0.5142
[1,0]<stderr>:INFO:absl:global_steps: 5313 learning_rate: 5.9401e-05 loss: 99.5646 Accuracy: 0.6697 CTCAccuracy: 0.2270 sec/iter: 0.5347
[1,0]<stderr>:INFO:absl:global_steps: 5323 learning_rate: 5.9513e-05 loss: 76.5102 Accuracy: 0.7429 CTCAccuracy: 0.2104 sec/iter: 0.5008
[1,0]<stderr>:INFO:absl:global_steps: 5333 learning_rate: 5.9625e-05 loss: 81.1494 Accuracy: 0.6812 CTCAccuracy: 0.2322 sec/iter: 0.4758
[1,0]<stderr>:INFO:absl:global_steps: 5343 learning_rate: 5.9737e-05 loss: 106.2966 Accuracy: 0.7126 CTCAccuracy: 0.2097 sec/iter: 0.5390
[1,0]<stderr>:INFO:absl:global_steps: 5353 learning_rate: 5.9848e-05 loss: 85.9434 Accuracy: 0.7293 CTCAccuracy: 0.2338 sec/iter: 0.4959
[1,0]<stderr>:INFO:absl:global_steps: 5363 learning_rate: 5.9960e-05 loss: 87.4237 Accuracy: 0.7189 CTCAccuracy: 0.2125 sec/iter: 0.4872
[1,0]<stderr>:INFO:absl:global_steps: 5373 learning_rate: 6.0072e-05 loss: 71.2363 Accuracy: 0.7321 CTCAccuracy: 0.2200 sec/iter: 0.5037
[1,0]<stderr>:INFO:absl:global_steps: 5383 learning_rate: 6.0184e-05 loss: 75.3471 Accuracy: 0.7524 CTCAccuracy: 0.2212 sec/iter: 0.5301
[1,0]<stderr>:INFO:absl:global_steps: 5393 learning_rate: 6.0296e-05 loss: 92.1645 Accuracy: 0.7058 CTCAccuracy: 0.2347 sec/iter: 0.5047
[1,0]<stderr>:INFO:absl:global_steps: 5403 learning_rate: 6.0407e-05 loss: 75.1991 Accuracy: 0.7170 CTCAccuracy: 0.2265 sec/iter: 0.5110
[1,0]<stderr>:INFO:absl:global_steps: 5413 learning_rate: 6.0519e-05 loss: 76.6572 Accuracy: 0.7411 CTCAccuracy: 0.2359 sec/iter: 0.5168
[1,0]<stderr>:INFO:absl:global_steps: 5423 learning_rate: 6.0631e-05 loss: 66.7233 Accuracy: 0.7421 CTCAccuracy: 0.2252 sec/iter: 0.4922
[1,0]<stderr>:INFO:absl:global_steps: 5433 learning_rate: 6.0743e-05 loss: 84.4430 Accuracy: 0.7322 CTCAccuracy: 0.2402 sec/iter: 0.5189
[1,0]<stderr>:INFO:absl:global_steps: 5443 learning_rate: 6.0855e-05 loss: 88.4436 Accuracy: 0.7330 CTCAccuracy: 0.2504 sec/iter: 0.5574
[1,0]<stderr>:INFO:absl:global_steps: 5453 learning_rate: 6.0966e-05 loss: 68.7955 Accuracy: 0.7020 CTCAccuracy: 0.2239 sec/iter: 0.5070
[1,0]<stderr>:INFO:absl:global_steps: 5463 learning_rate: 6.1078e-05 loss: 78.1629 Accuracy: 0.7473 CTCAccuracy: 0.2442 sec/iter: 0.4928
[1,0]<stderr>:INFO:absl:global_steps: 5473 learning_rate: 6.1190e-05 loss: 80.3354 Accuracy: 0.7410 CTCAccuracy: 0.2361 sec/iter: 0.5117
[1,0]<stderr>:INFO:absl:global_steps: 5483 learning_rate: 6.1302e-05 loss: 83.2121 Accuracy: 0.7455 CTCAccuracy: 0.2417 sec/iter: 0.5115
[1,0]<stderr>:INFO:absl:global_steps: 5493 learning_rate: 6.1414e-05 loss: 82.1980 Accuracy: 0.7383 CTCAccuracy: 0.2417 sec/iter: 0.4913
[1,0]<stderr>:INFO:absl:global_steps: 5503 learning_rate: 6.1525e-05 loss: 78.5782 Accuracy: 0.7510 CTCAccuracy: 0.2437 sec/iter: 0.5086
[1,0]<stderr>:INFO:absl:global_steps: 5513 learning_rate: 6.1637e-05 loss: 76.0226 Accuracy: 0.7781 CTCAccuracy: 0.2544 sec/iter: 0.4972
[1,0]<stderr>:INFO:absl:global_steps: 5523 learning_rate: 6.1749e-05 loss: 87.8707 Accuracy: 0.7692 CTCAccuracy: 0.2357 sec/iter: 0.4970
[1,0]<stderr>:INFO:absl:global_steps: 5533 learning_rate: 6.1861e-05 loss: 75.3602 Accuracy: 0.7643 CTCAccuracy: 0.2388 sec/iter: 0.5040
[1,0]<stderr>:INFO:absl:global_steps: 5543 learning_rate: 6.1973e-05 loss: 82.1475 Accuracy: 0.7649 CTCAccuracy: 0.2308 sec/iter: 0.5242
[1,0]<stderr>:INFO:absl:global_steps: 5553 learning_rate: 6.2084e-05 loss: 74.2398 Accuracy: 0.7697 CTCAccuracy: 0.2406 sec/iter: 0.5081
[1,0]<stderr>:INFO:absl:global_steps: 5563 learning_rate: 6.2196e-05 loss: 66.0623 Accuracy: 0.7721 CTCAccuracy: 0.2462 sec/iter: 0.4795
[1,0]<stderr>:INFO:absl:global_steps: 5573 learning_rate: 6.2308e-05 loss: 84.6851 Accuracy: 0.7619 CTCAccuracy: 0.2155 sec/iter: 0.4583
[1,0]<stderr>:INFO:absl:global_steps: 5583 learning_rate: 6.2420e-05 loss: 80.1678 Accuracy: 0.7962 CTCAccuracy: 0.2416 sec/iter: 0.4944
[1,0]<stderr>:INFO:absl:global_steps: 5593 learning_rate: 6.2532e-05 loss: 68.9496 Accuracy: 0.7795 CTCAccuracy: 0.2459 sec/iter: 0.5075
[1,0]<stderr>:INFO:absl:global_steps: 5603 learning_rate: 6.2643e-05 loss: 72.3827 Accuracy: 0.7544 CTCAccuracy: 0.2480 sec/iter: 0.5282
[1,0]<stderr>:INFO:absl:global_steps: 5613 learning_rate: 6.2755e-05 loss: 79.8508 Accuracy: 0.8037 CTCAccuracy: 0.2402 sec/iter: 0.5023
[1,1]<stderr>:INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_recognition.SpeechRecognitionDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/dev.csv'), ('input_length_range', [10, 15000]), ('output_length_range', [1, 10000]), ('remove_unk', True), ('speed_permutation', [1.0]), ('text_config', {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'})]
[1,1]<stdout>:Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
[1,1]<stderr>:INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
[1,1]<stderr>:INFO:absl:Loading data from examples/asr/thchs30/data/dev.csv
[1,1]<stdout>:before filter by unk:893
[1,1]<stdout>:after filter by unk:893
[1,1]<stdout>:afiter filter by input length:893
[1,1]<stdout>:after filter by output length:893
[1,1]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,0]<stderr>:INFO:absl:>>>>> start evaluate in epoch 2
[1,0]<stderr>:INFO:absl:hparams: [('audio_config', {'type': 'Fbank', 'filterbank_channel_count': 40}), ('cls', <class 'athena.data.datasets.speech_recognition.SpeechRecognitionDatasetBuilder'>), ('cmvn_file', 'examples/asr/thchs30/data/cmvn'), ('data_csv', 'examples/asr/thchs30/data/dev.csv'), ('input_length_range', [10, 15000]), ('output_length_range', [1, 10000]), ('remove_unk', True), ('speed_permutation', [1.0]), ('text_config', {'type': 'vocab', 'model': 'examples/asr/thchs30/data/vocab'})]
[1,0]<stdout>:Fbank params: [('channel', 1), ('cls', <class 'athena.transform.feats.fbank.Fbank'>), ('delta_delta', False), ('dither', 0.0), ('filterbank_channel_count', 40), ('frame_length', 0.01), ('global_mean', [0.0]), ('global_variance', [1.000001]), ('is_fbank', True), ('local_cmvn', False), ('lower_frequency_limit', 60), ('order', 2), ('output_type', 1), ('preEph_coeff', 0.97), ('raw_energy', 1), ('remove_dc_offset', True), ('snip_edges', 1), ('type', 'Fbank'), ('upper_frequency_limit', 0), ('window', 2), ('window_length', 0.025), ('window_type', 'povey')]
[1,0]<stderr>:INFO:absl:Successfully load cmvn file examples/asr/thchs30/data/cmvn
[1,0]<stderr>:INFO:absl:Loading data from examples/asr/thchs30/data/dev.csv
[1,0]<stdout>:before filter by unk:893
[1,0]<stdout>:after filter by unk:893
[1,0]<stdout>:afiter filter by input length:893
[1,0]<stdout>:after filter by output length:893
[1,0]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,1]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:INFO:absl:loss: 49.5292 Accuracy: 0.8192 CTCAccuracy: 0.2429
[1,0]<stderr>:INFO:absl:loss: 61.8484 Accuracy: 0.8013 CTCAccuracy: 0.2875
[1,0]<stderr>:INFO:absl:loss: 69.9180 Accuracy: 0.8056 CTCAccuracy: 0.2851
[1,0]<stderr>:INFO:absl:loss: 72.1294 Accuracy: 0.8036 CTCAccuracy: 0.2856
[1,0]<stderr>:INFO:absl:loss: 63.4664 Accuracy: 0.8117 CTCAccuracy: 0.2828
[1,0]<stderr>:INFO:absl:loss: 72.1545 Accuracy: 0.8163 CTCAccuracy: 0.2794
[1,0]<stderr>:INFO:absl:loss: 72.9044 Accuracy: 0.8166 CTCAccuracy: 0.2788
[1,0]<stderr>:INFO:absl:loss: 70.5060 Accuracy: 0.8216 CTCAccuracy: 0.2738
[1,0]<stderr>:INFO:absl:loss: 79.1763 Accuracy: 0.8199 CTCAccuracy: 0.2710
[1,0]<stderr>:INFO:absl:loss: 86.1606 Accuracy: 0.8201 CTCAccuracy: 0.2695
[1,0]<stderr>:INFO:absl:loss: 76.3004 Accuracy: 0.8223 CTCAccuracy: 0.2680
[1,1]<stderr>:INFO:absl:perform batch_wise_shuffle with batch_size 8
[1,1]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,0]<stderr>:INFO:absl:loss: 84.4107 Accuracy: 0.8199 CTCAccuracy: 0.2669
[1,0]<stderr>:INFO:absl:epoch: 2 loss: 72.5232 Accuracy: 0.8199 CTCAccuracy: 0.2669
[1,0]<stderr>:INFO:absl:saving model in :examples/asr/thchs30/ckpts/mtl_transformer_ctc/ckpt
[1,0]<stderr>:INFO:absl:>>>>> start training in epoch 3
[1,0]<stderr>:INFO:absl:perform batch_wise_shuffle with batch_size 8
[1,0]<stderr>:INFO:absl:please be patient, enable tf.function, it takes time ...
[1,1]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:WARNING:absl:the length of logits is shorter than that of labels
[1,0]<stderr>:INFO:absl:global_steps: 5614 learning_rate: 6.2766e-05 loss: 75.1360 Accuracy: 0.8088 CTCAccuracy: 0.2757 sec/iter: 66.0567
[1,0]<stderr>:INFO:absl:global_steps: 5624 learning_rate: 6.2878e-05 loss: 79.6415 Accuracy: 0.7901 CTCAccuracy: 0.2277 sec/iter: 0.5128
[1,0]<stderr>:INFO:absl:global_steps: 5634 learning_rate: 6.2990e-05 loss: 75.5064 Accuracy: 0.8187 CTCAccuracy: 0.2340 sec/iter: 0.5024
[1,0]<stderr>:INFO:absl:global_steps: 5644 learning_rate: 6.3102e-05 loss: 56.2395 Accuracy: 0.8013 CTCAccuracy: 0.2491 sec/iter: 0.4802
[1,0]<stderr>:INFO:absl:global_steps: 5654 learning_rate: 6.3214e-05 loss: 61.7807 Accuracy: 0.7889 CTCAccuracy: 0.2535 sec/iter: 0.5250
[1,0]<stderr>:INFO:absl:global_steps: 5664 learning_rate: 6.3325e-05 loss: 74.9574 Accuracy: 0.8142 CTCAccuracy: 0.2483 sec/iter: 0.5281