Comparison of Four Neural Net Learning Methods for Dynamic System Identification

Si-Zhao QIN, Hong-Te SU, Thomas J. MCAVOY

Research output: Journal PublicationsJournal Article (refereed)peer-review

144 Citations (Scopus)


Nonlinear system identification is being reexamined by many researchers using neural networks. Although both batch learning and pattern learning are employed at present, it is not clear yet whether they will always give rise to the same model. Further, validity of pattern learning has not been given in a strict mathematical sense, although it is practically effective. In this paper, in order to establish a groundwork for comparison, both pattern learning and batch learning rules are rederived for nonlinear system identification using multilayer feedforward networks and external recurrent networks. Furthermore, the conditions under which the pattern learning rules will give approximately the same model as the batch learning rules are derived as three theorems. Pattern learning is shown to approach batch learning provided that the learning rate is small. As a result, the validity of pattern learning is established. Finally, theoretical results are illustrated via simulation. © 1992 IEEE
Original languageEnglish
Pages (from-to)122-130
Number of pages9
JournalIEEE Transactions on Neural Networks
Issue number1
Publication statusPublished - Jan 1992
Externally publishedYes


Dive into the research topics of 'Comparison of Four Neural Net Learning Methods for Dynamic System Identification'. Together they form a unique fingerprint.

Cite this