Connectionist temporal classification
Alex Graves, Santiago Fernández, Faustino J. Gomez et al. · International Conference on Machine Learning · 2006
Many real-world sequence learning tasks require the prediction of sequences of labels from noisy, unsegmented input data. In speech recognition, for example, an acoustic signal is transcribed into words or sub-word units. Recurrent neural networks (RNNs) are powerful sequence learners that would seem well suited to such tasks. However, because they require pre-segmented training data, and post-processing to transform their outputs into label sequences, their applicability has so far been limited. This paper presents a novel method for training RNNs to label unsegmented sequences directly, thereby solving both problems. An experiment on the TIMIT speech corpus demonstrates its advantages over both a baseline HMM and a hybrid HMM-RNN.
Cited by 5,355 works. doi:10.1145/1143844.1143891
Authors
References
- Long Short-Term Memory
- A tutorial on hidden Markov models and selected applications in speech recognition
- Neural networks for pattern recognition
- Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
- Bidirectional recurrent neural networks
- Backpropagation through time: what it does and how to do it
- Framewise phoneme classification with bidirectional LSTM and other neural network architectures
- Connectionist Speech Recognition: A Hybrid Approach
- Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition
- An application of recurrent nets to phone probability estimation