Title: | Adaptation of a feedforward artificial neural network using a linear transform |
Other Titles: | Adaptace ANN pomocí LT |
Authors: | Trmal, Jan Zelinka, Jan Müller, Luděk |
Citation: | TRMAL, Jan; ZELINKA, Jan; MÜLLER, Luděk. Adaptation of a feedforward artificial neural network using a linear transform. In: Text, speech and dialogue. Berlin: Springer, 2010, p. 423-430. (Lecture notes in computer science; 6231). ISBN 3-642-15759-9. |
Issue Date: | 2010 |
Publisher: | Springer |
Document type: | článek article |
URI: | http://www.kky.zcu.cz/cs/publications/TrmalJan_2010_Adaptationof http://hdl.handle.net/11025/16968 |
ISBN: | 3-642-15759-9 |
Keywords: | MLP ANN;aplikace informačních systémů;human computer interaction |
Keywords in different language: | MLP ANN;information systems applications;human computer interaction |
Abstract in different language: | In this paper we present a novel method for adaptation of a multi-layer perceptron neural network (MLP ANN). Nowadays, the adaptation of the ANN is usually done as an incremental retraining either of a subset or the complete set of the ANN parameters. However, since sometimes the amount of the adaptation data is quite small, there is a fundamental drawback of such approach – during retraining, the network parameters can be easily overfitted to the new data. There certainly are techniques that can help overcome this problem (earlystopping, cross-validation), however application of such techniques leads to more complex and possibly more data hungry training procedure. The proposed method approaches the problem from a different perspective. We use the fact that in many cases we have an additional knowledge about the problem. Such additional knowledge can be used to limit the dimensionality of the adaptation problem. We applied the proposed method on speaker adaptation of a phoneme recognizer based on traps (Temporal Patterns) parameters. We exploited the fact that the employed traps parameters are constructed using log-outputs of mel-filter bank and by virtue of reformulating the first layer weight matrix adaptation problem as a mel-filter bank output adaptation problem, we were able to significantly limit the number of free variables. Adaptation using the proposed method resulted in a substantial improvement of phoneme recognizer accuracy. |
Rights: | © Jan Trmal - Jan Zelinka - Luděk Müller |
Appears in Collections: | Články / Articles (KKY) |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
TrmalJan_2010_Adaptationof.pdf | Plný text | 116,46 kB | Adobe PDF | View/Open |
Please use this identifier to cite or link to this item:
http://hdl.handle.net/11025/16968
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.