Table 3. The range of the model hyperparameters

Hyperparameters	Values
batch type	folded
batch size	32
accum grad	8
max epoch	50
patience	none
init	chainer	xavier uniform	xavier normal	kaiminguniform	kaiming normal
optim	adam
lr	0.005
scheduler	warmuplr
warmup steps	10,000	20,000	30,000	40,000
keep nbest model	5	10	15	20
ctc weight	0.0	0.1	0.2	0.3	0.4
lsm weight	0.0	0.1	0.2	0.3	0.4
length normalized loss	true			false