# Publications on Neural Networks (some Deep Learning)

## See New
Stuff
for
2000-present publications (some duplication with other lists)

For copies of any untrievable papers, please contact Lee Giles.

## What's here:

- Refereed Journal Papers
- Refereed Conference Papers
- Edited Books & Book Chapters
- Edited Proceedings and Special Issues
- Old Technical Reports
- Bibliography in latex bib file format of most of the older publications

## Refereed Journal Papers:

- P. Tino, B.G. Horne, C.L. Giles, "Attractive
Periodic
Sets in Discrete-Time
Recurrent Networks (with Emphasis on Fixed-Point Stability
and
Bifurcations in Two-Neuron Networks),"
*Neural Computation*, 13(*6*), 1379-1414, 2001. - C.L. Giles, S. Lawrence, A-C. Tsoi, "Noisy
Time
Series Prediction Using a Recurrent Neural Network and
Grammatical
Inference,"
*Machine Learning*, 44, 161-183, 2001. - R. Bakker , J.C. Schouten , C. L. Giles , Floris Takens,
C.M. van
den Bleek, "Learning
Chaotic
Attractors by Neural Networks,"
*Neural Computation,*12(10), 2355-2383, 2000. - S. Lawrence, C.L. Giles, S. Fong, "Natural
Language
Grammatical Inference with Recurrent Neural Networks,"
*IEEE Trans. on Knowledge and Data Engineering*, 12(1), 126-140, 2000. - The labeled corpus used in this study.
- C.L. Giles, C.W. Omlin, K. K. Thornber, "Equivalence
in
Knowledge Representation: Automata, Recurrent Neural
Networks, and
Dynamical Fuzzy Systems,"
*Proceedings of the IEEE*, 87(9), 1999. - T. Lin, B.G. Horne, C.L. Giles, "How
Embedded
Memory in
Recurrent
Neural Network Architectures Helps Learning Long-term
Temporal
Dependencies,"
*Neural Networks*11(5), p. 861, 1998. - C.W. Omlin, K.K. Thornber, C.L. Giles, "Fuzzy
Finite-State
Automata Can Be Deterministically Encoded Into Recurrent
Neural Networks,"
*IEEE Trans. on Fuzzy Systems,*6(1), p. 76, 1998. - S. Lawrence, A. Back, A-C. Tsoi, C.L. Giles, "On
the
Distribution of Performance from Multiple Neural Network
Trials,"
*IEEE Trans. Neural Networks,*8(6), p. 1507, 1997. - D.S. Clouse, C.L. Giles, B.G. Horne, G.W.
Cottrell, "Time-Delay
Neural
Networks: Representation and Induction of Finite State
Machines,"
*IEEE Trans. on Neural Networks,*8(5), p. 1065, 1997. - T. Lin, C.L. Giles, B.G. Horne, S.Y. Kung, "A
Delay Damage Model Selection Algorithm for NARX Neural
Networks
*," IEEE Trans., on Signal Processing*, "Special Issue on Neural Networks," 45(11), p. 2719, 1997.**(IEEE SIGNAL PROCESSING SOCIETY 1998 YOUNG AUTHOR BEST PAPER AWARD)** - H. Siegelmann, C.L.Giles, "The Complexity of
Language
Recognition
by Neural Networks,"
*Neurocomputing*, Special Issue on "Recurrent Networks for Sequence Processing," Eds: M. Gori, M. Mozer, A.H. Tsoi, W. Watrous, vol. 15, p. 327, 1997. - H. T. Siegelmann, B.G. Horne, C.L. Giles, "Computational
capabilities
of recurrent NARX neural networks,"
*IEEE Trans. on Systems, Man and Cybernetics--Part B: Cybernetics*, 27(2), p. 208, 1997. - Steve Lawrence, C. Lee Giles, Ah Chung Tsoi,
Andrew
D. Back, "Face
Recognition:
A Convolutional Neural Network Approach,"
*IEEE Trans. on Neural Networks*, 8(1), p. 98, 1997. - T. Lin, B.G. Horne, P. Tino, C.L. Giles, "Learning
long--term
dependencies in NARX recurrent neural networks,"
*IEEE Trans. on Neural Networks*, 7(6), p. 1329, 1996. (**OUTSTANDING PAPER AWARD for 1996**)*IEEE TRANSACTIONS ON NEURAL NETWORKS* - C.W. Omlin, C.L. Giles, "Constructing
Deterministic
Finite-State Automata in Recurrent Neural Networks,"
*Journal of the ACM*, 45(6), 937-972, 1996. - Kam Jim, C.L. Giles, B.G. Horne, "Synaptic
Noise
in Dynamically-driven Recurrent Neural Networks:
Convergence and
Generalization
*," IEEE Trans. on Neural Networks*, 7(6), p. 1424, 1996. - C.W. Omlin, C.L. Giles, "Stable
Encoding
of Large Finite-State Automata in Recurrent Neural
Networks
with Sigmoid Discriminants
*," Neural Computation*, 8(*4*), p. 675, 1996. - C.W. Omlin, C.L. Giles, "Extraction
of
Rules from Discrete-Time Recurrent Neural Networks,"
*Neural Networks*, 9(1), 41-52, 1996. - C.W. Omlin, C.L. Giles, "Rule
Revision
with Recurrent Neural Networks,"
*IEEE Trans. on Knowledge and Data Engineering*, 8(1), pp. 183-188, 1996. - C.L. Giles, B.G. Horne, T. Lin, "Learning
a
Class of Large Finite State Machines with a Recurrent
Neural Network
*," Neural Networks*, 8(9), 1359-1365, 1995. - M.W. Goudreau, C.L. Giles, "Using
Recurrent
Neural
Networks
to Learn the Structure of Interconnection Networks,"
*Neural Networks*, 8(5), 793-804, 1995. - C.L. Giles, M.W. Goudreau, "Routing
in
Optical Multistage Interconnection Networks: A Neural
Network
Solution
*," IEEE/OSA J. of Lightwave Technology*, Special Issue on Optical Interconnections for Information Processing, 13(6), p. 1111, 1995. - C.L. Giles, D. Chen, G.Z. Sun, H.H. Chen,
Y.C. Lee,
M.W. Goudreau, "Constructive
Learning
of Recurrent Neural Networks: Problems with Recurrent
Cascade
Correlation
and a Simple Solution,"
*IEEE Trans. on Neural Networks*, 6(4), p. 829, 1995. - C. L. Giles, C.W. Omlin, "Pruning
Recurrent
Neural Networks for Improved Generalization Performance
*, "IEEE Trans. on Neural Networks*, 5(5), p. 848, 1994. - M.W. Goudreau, C.L. Giles, S.T. Chakradhar,
D. Chen, "First-Order
Vs.
Second-Order Single Layer Recurrent Neural Networks,"
*IEEE Trans. on Neural Networks*, 5 (3), p. 511, 1994. - C.L. Giles, G.M. Kuhn, R.J. Williams (Guest
Editors)
- Special Issue on "Dynamical Recurrent Neural Networks,"
*IEEE Trans. on Neural Networks*, 5(2), 1994. bib.file of special issue - C.B. Miller, C.L. Giles, "Experimental
Comparison
of the Effect of Order in Recurrent Neural Networks,"
*International Journal of Pattern Recognition and Artificial Intelligence*, (Special Issue on Neural Networks), 7(4), p. 849, 1993. - C.L. Giles, C.W. Omlin, "Extraction,
Insertion and
Refinement of Production Rules in Recurrent Neural
Networks,"
*Connection Science*, Special Issue on "Architectures for Integrating Symbolic and Neural Processes", 5(3-4), p.307, 1993. - C.L. Giles, C.B. Miller, D. Chen, H.H. Chen,
G.Z.
Sun, Y.C. Lee, "Learning
and
Extracting Finite State Automata with
Second-Order
Recurrent Neural Networks,"
*Neural Computation*, 4(3), p. 393, 1992. - M.W. Goudreau, C.L. Giles, "Routing in Random
Multistage Interconnection Networks: Comparing Exhaustive
Search,
Greedy and Neural Network
Approaches,"
*International Journal of Neural Systems*, 3(2), 1992. - C.L. Giles, T. Maxwell, "Learning,
Invariance,
and Generalization in High Order Neural Networks,"
*Applied Optics*, 26, #23, p. 4972 (1987). Reprinted in: - (1)
*Selected Papers on Optical Computing*, eds. H.J. Caulfield and G. Gheen, SPIE Milestone Series, SPIE vol. 1142, 1989. - (2)
*Artificial Neural Networks: Concepts and Theory*, eds. P. Mehra and B. W. Wah, IEEE Computer Society Press, Los Alamitos, CA. 1992. - (3)
*Selected Papers on Optical Neural Networks*, ed. S. Jutamulia, SPIE Milestone Series, SPIE vol. MS 96, 1994.

## Refereed Conference Papers:

- Alexander G. Ororbia II, C. Lee Giles, and Daniel Kifer
*,*"Unifying Adversarial Training Algorithms with Flexible Deep Data Gradient Regularization," arXiv:1601.07213 [cs.LG], 2016.

- Alexander G. Ororbia II, C. Lee Giles, and David Reitter
*,*Online Semi-Supervised Learning with Deep Hybrid Boltzmann Machines and Denoising Autoencoders. arXiv:1511.06964 [cs], 2015.

- Alexander G. Ororbia II, C. Lee Giles, and David Reitter.
"Learning
a deep hybrid model for semi-supervised text
classification,"
*Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP)*, Lisbon, Portugal, 2015. - Alexander G. Ororbia II, David Reitter, Jian Wu, and C.
Lee Giles. "Online
learning of deep hybrid architectures for semi-supervised
categorization,"
*Proc. European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD)*. Porto, Portugal, 2015.

- Wenyi Huang, Zhaohui Wu, Liang Chen, Prasenjit Mitra, C.
Lee
Giles, "A Neural
Probabilistic Model for Context Based Citation
Recommendation," Proceedings
of the Twenty-Ninth AAAI
Conference on Artificial Intelligence AAAI 2015,
2404-2410,
2015.

- Rembrandt Bakker, Jaap
C. Schouten, Marc-Olivier
Coppens, Floris
Takens, C.
Lee Giles, Cor
M. van den Bleek,
"Robust
Learning
of Chaotic Attractors,"
*Advances in Neural Information Processing Systems*, NIPS 1999, 879-885, 1999.

- M.F. Sakr, S.P. Levitan, C.L. Giles, D.M.
Chiarulli, "Reconfigurable
Processor
Employing Optical Channels,"
*Optics in Computing, OC'98*, Proceedings of the SPIE, vol. 3490, p. 564, 1998. - C.L. Giles, T. Lin, B.G. Horne, S-Y. Kung, "The Past Is Important: A Method for Determining Memory Structure in NARX Neural Networks," IEEE World Conference on Computational Intelligence, p. 1834, 1998.
- R. Bakker, J.C. Schouten, C.M. van der Bleek,
C.L.
Giles, "Neural Learning of Chaotic Dynamics: The Error
Propagation
Algorithm,"
*IEEE World Conference on Computational Intelligence*, p. 2483, 1998. - T. Lin, C.L. Giles, B.G. Horne, "What to
Remember,
How Memory Order Affects the Performance of NARX Neural
Networks,"
*IEEE World Conference on Computational Intelligence*, p. 1051, 1998. - Guo-Zheng Sun, C. Lee Giles, Hsing-Hen Chen, "The Neural Network Pushdown Automaton: Architecture, Dynamics and Training," Adaptive Processing of Sequences and Data Structures, Lecture Notes in Computer Science, Volume 1387, 296-345, 1998.
- Back, B.G. Horne, A. C. Tsoi, C.L. Giles, "Low
Sensitivity Time Delay Neural Networks with Cascade Form
Structure,"
*Neural Networks for Signal Processing VII, Proceedings of the 1997 IEEE Workshop*, IEEE Press, p. 44, 1997. - C.L. Giles, T. Lin, B.G. Horne, "Remembering
the
Past:
The Role of Embedded Memory in Recurrent Neural Network
Architectures,"
*Neural Networks for Signal Processing VII, Proceedings of the 1997 IEEE Workshop*, IEEE Press, p. 34, 1997. - S. Lawrence, A. Back, A-C. Tsoi, C.L. Giles, "The
Gamma
MLP - Using Multiple Temporal Resolutions for Improved
Classification,"
*Neural Networks for Signal Processing VII, Proceedings of the 1997 IEEE Workshop*, IEEE Press, p. 256, 1997. - C.L. Giles, S. Lawrence, A-C. Tsoi, "Rule
Inference
for
Financial Prediction using Recurrent Neural Networks,"
*Proceedings of the IEEE/IAFE Conf. on Computational Intelligence for Financial Engineering*, p. 253, IEEE, 1997. - M.F. Sakr, S.P. Levitan, D.M. Chiarulli , B.G. Horne, C.L. Giles, "Predicting Multiprocessor Memory Access Patterns with Learning Models," Proceedings of the Fourteenth International Conference on Machine Learning, Ed. D. Fisher, p. 305-312, Morgan Kaufmann, 1997.
- S. Lawrence, C.L. Giles, A-C. Tsoi, "Lessons in Neural Network Training: Overfitting may be harder than expected," Proceedings of the 14th AAAI, p. 362, MIT Press, 1997.
- M.F. Sakr, C.L. Giles, S.P. Levitan, B.G.
Horne, M.
Maggini, D.M. Chiarulli, "On-Line
Prediction
of Multiprocessor Memory Access Patterns,"
*Proceedings of the IEEE International Conference on Neural Networks*, p. 1564, 1996,**BEST PAPER AWARD.** - M.F. Sakr, S.P. Levitan, C.L. Giles, D.M.
Chiarulli,
B.G. Horne, M. Maggini, "Predictive
Control
of Opto-Electronic Reconfigurable Interconnection Networks
Using Neural
Networks,"
*2nd International Conference on Massively Parallel Processing Using Optical Interconnections*, (ed.) E. Schenfeld, 326-335, IEEE Computer Society Press, 1995. - B.G. Horne, C.L. Giles, "An
Experimental
Comparison
of Recurrent Neural Networks,"
*Advances in Neural Information Processing Systems 7*, eds: G. Tesauro, D. Touretzky, T. Leen, p. 697, MIT Press, 1995. - L.R. Leerink, C.L. Giles, B.G. Horne, M.A.
Jabri, "Learning
with
Product Units
*," Advances in Neural Information Processing Systems 7*, Eds: G. Tesauro, D. Touretzky, T. Leen, p. 537, MIT Press, 1995. - K. Jim, C. L. Giles, B. G. Horne, "Effects
of
Noise
on
Convergence and Generalization in Recurrent Networks,"
*Advances in Neural Information Processing Systems 7*, Eds: G. Tesauro, D. Touretzky, T. Leen, p. 649, MIT Press, 1995. - C.L. Giles, B.G. Horne, "Representation and
Learning
in Recurrent Neural Network Architectures,"
*Proceedings of the Eighth Yale Workshop on Adaptive and Learning Systems*, p. 128, 1994. - C.W. Omlin, C.L. Giles, B.G. Horne, L.R.
Leerink,
T. Lin, "Training
Recurrent
Neural Networks with Temporal Input Encodings,"
*IEEE International Conference on Neural Networks (ICNN'94)*, p. 1267, 1994. - C.W. Omlin and C.L. Giles, "Constructing
Deterministic
Finite-State Automata in Sparse Recurrent Neural Networks,"
*IEEE International Conference on Neural Networks (ICNN'94)*, p. 1732, 1994. - M.W. Goudreau, C.L. Giles, "Discovering the
Structure
of a Self Routing Interconnection Network with a Recurrent
Neural
Network,"
*Proceedings of the International Workshop on Neural Network Applications in Telecommunications*, Eds. J. Alspector, R. Goodman, T.X. Brown, Lawrence Erlbaum, Hillsdale, NJ, p. 52, 1993. - S. Das, C.L. Giles, G.Z. Sun, "Using
Prior
Knowledge
in a NNPDA to Learn Context-Free Languages,"
*Advances in Neural Information Processing Systems 5*, S.J. Hanson, J.D. Cowan, C.L. Giles (eds), Morgan Kaufmann, San Mateo, Ca., p. 65, 1993. - M.W. Goudreau and C.L. Giles, "On recurrent
neural
networks and representing finite state recognizers,"
*Third International Conference on Artificial Neural Networks*, Institution of Electrical Engineers, London, UK, p. 55, 1993. - D. Chen, C.L. Giles, G.Z. Sun, H.H. Chen, Y.C.
Lee,
M.W. Goudreau, "Constructive Learning of Recurrent Neural
Networks,"
*1993 IEEE International Conference on Neural Networks*, March 28 - April 1, vol III, p. 1196, 1993. - C.L. Giles, M.W. Goudreau, "A Neural Network
Router
for Optical Interconnection Networks,"
*OSA 1993 Technical Digest Optical Computing*, Series Vol 7, OTuA8, 1993. - Sreerupa Das, C. Lee Giles, Guo-Zheng Sun, "Learning context-free grammars: Capabilities and limitations of a recurrent neural network with an external stack memory," In Proceedings of The Fourteenth Annual Conference of Cognitive Science Society. Indiana University. 1992.
- H.T. Siegelmann, E.D. Sontag, C.L. Giles, "The
Complexity of Language Recognition by Neural Networks,"
*Algorithms, Software, Architecture, (Ed) J. van Leeuwen*, Series - Information Processing 92, Vol 1, Elsevier, Amsterdam, p. 329-335, 1992. - C.L. Giles, C.W. Omlin, "Inserting Rules into
Recurrent
Neural Networks,"
*Neural Networks for Signal Processing II*, Proceedings of the 1992 IEEE Workshop, eds. S.Y. Kung, F. Fallside, J. Aa. Sorenson, C.A. Kamm, IEEE Press, p. 13, 1992. - D. Chen, C.L. Giles G. Z. Sun, H. H. Chen, Y.C.
Lee,
"Learning Finite State Transactionsducers with a Recurrent
Neural
Network,"
*IJCNN International Joint Conference on Neural Networks*, Beijing, China, Vol 1, p. 129, Publishing House of Electronics Industry, Beijing, 1992. - C.W. Omlin, C.L. Giles, C.B. Miller,
"Heuristics for
the Extraction of Rules from Discrete-Time Recurrent Neural
Networks,"
*Proceedings of the International Joint Conference on Neural Networks*, IEEE-92CH3114-6, vol I, p. 33, 1992. - C.W. Omlin, C. L. Giles, "Training Second-Order
Recurrent Neural Networks Using Hints,"
*Proceedings of the 9th International Conference on Machine Learning*, eds. D. Sleeman and P. Edwards, Morgan Kaufmann Publishers, San Mateo, CA, p. 363, 1992. - C.L. Giles, C.B. Miller, D. Chen, G.Z. Sun,
H.H. Chen,
Y.C. Lee, "Extracting and Learning an Unknown Grammar with
Recurrent
Neural Networks,"
*Advances in Neural Information Processing Systems 4*, eds. J.E. Moody, S.J. Hanson and R.P. Lippmann, Morgan Kaufmann, San Mateo, Ca., p. 317, 1992. - M.W. Goudreau, C.L.Giles, "Neural Network
Routing
for Random Multiple Stage Interconnection Networks,"
*Neural Information Processing Systems 4*, Morgan Kaufmann Publishers, eds. J.E. Moody, S.J. Hanson, R.P. Lippmann, p.722, 1992.

## Reprinted Papers, Edited Books & Book Chapters:

- T. Lin, B.G. Horne, P. Tino, C.L. Giles,
“Learning
long--term dependencies with NARX networks,”
*IEEE Trans. on Neural Networks*, 7(6), p. 1329, 1996. Reprinted in Recurrent Neural Networks: Design and Applications, (eds) L.C. Jain, L. Medsker, CRC Press, 1999. - S. Lawrence, I. Burns, A.D. Back, A.C. Tsoi,
C.L.
Giles,” Neural Network Classification and Unequal Prior
Class
Probabilities,”
in
*Tricks of the Trade: Lecture Notes in Computer Science State-of-the-Art Surveys*, (eds) G. Orr, K.-R. Muller, R. Caruana, Springer Verlag, 1998. - S. Lawrence, C.L. Giles, A-C. Tsoi, “Symbolic
Conversion, Grammatical Inference and Rule Extraction for
Foreign
Exchange Rate Prediction,”
*Neural Networks in the Capital Markets NNCM96*, (eds) Y. Abu-Mostafa, A.S. Weigend, A.-P. N. Refenes, World Scientific Press, Singapore, p. 333, 1998. - P. Tino, B.G. Horne, C.L. Giles P.C.
Collingwood, Finite
State
Machines and Recurrent Neural Networks --Automata and
Dynamical
Systems Approaches.
*Neural Networks and Pattern Recognition*, (eds) J.E. Dayhoff, O. Omidvar, Academic Press, 171-220, 1998. - G.Z.Sun, C.L. Giles, H.H. Chen, Y.C. Lee, The
Neural
Network Pushdown
Automata:
Architecture, Dynamics and Training, in
*Adaptive Processing of Sequences and Data Structures*, (eds) C.L. Giles, M. Gori, Lecture Notes in Artificial Intelligence, 296-345, Springer Verlag, 1998. - M. Maggini, C.L. Giles, B.G. Horne, "Financial
Time Series
Forecasting
Using K-Nearest Neighbors Classification,"
*Nonlinear Financial Forecasting, Proceedings of the First INFFC*, (ed) R.B. Caldwell, p. 169, Finance & Technology Publishing Haymarket, VA, 1997. - S. Lawrence, S. Fong, C.L. Giles, "Natural
Language Grammatical
Inference:
A Comparison of Recurrent Neural Networks and Machine
Learning
Methods,"
*Lecture Notes on Artificial Intelligence, Connectionist, Statistical and Symbolic Approaches to Learning for Natural Language Processing,*eds. S. Wermter, E. Riloff, G. Scheler, Springer-Verlag, NY, 1996. - D. Chen, C.L. Giles, G.Z. Sun, M.
Goudreau,
H.H. Chen, Y.C. Lee, “A Method for Constructive Learning of
Recurrent
Neural
Networks,” Ch. 6,
*Computational Learning Theory and Natural Learning Systems III*,” (eds) T. Petsche, S. Hanson, J. Shavlik, MIT Press, Cambridge, MA, 1995. - H.T. Siegelmann, B.G. Horne, C.L.
Giles, “What
NARX Networks Can Compute,”
*Lecture Notes in Computer Science*, (eds) M.Bartosek, J.Staudek, J.Wiedermann, vol. 1012, Springer-Verlag, NY, 1995. - C.L. Giles, C.B. Miller, “The Effect of
Higher
Order in Recurrent Neural Networks: Experiments,” Ch 6,
*Artificial Neural Networks for Speech and Vision*, (ed) R.J. Mammone, Chapman & Hall, London, 1994. - M.W. Goudreau, C.L. Giles, “Routing in
Random
Multistage Interconnection Networks,” Ch 3,
*Neural Network Applications in Telecommunications*, (eds) B. Yuhas, N. Ansari, Kluwer, Cambridge, MA, 1994. - C.W. Omlin and C.L. Giles, “Extraction
and
Insertion of Symbolic Information in Recurrent Neural
Networks,” in
*Artificial Intelligence and Neural Networks: Steps Toward Principled Integration*, (eds) V. Honavar and L. Uhr, Academic Press, Cambridge, Chapter XII, MA, 1994. - C.B. Miller, C.L. Giles, “Experimental
Comparison
of the Effect of Order in Recurrent Neural Networks,”
*International Journal of Pattern Recognition and Artificial Intelligence*, 7(4), p. 849, 1993. Reprinted in:*Advances in Pattern Recognition Systems Using Neural Network Technologies*, (eds) I. Guyon, P.S.P. Wang, Series in Machine Perception & Artificial Intelligence - Vol 7, World Scientific, River Edge, N.J., 1993. - C.L. Giles, et.al., “Learning and
Extracting
Finite State Automata with Second-Order Recurrent Neural
Networks,”
*Neural Computation*, 4(3), p. 393, 1992. Reprinted in:*Artificial Neural Networks*, (eds) E. Sanchez-Sinencia, C. Lau, IEEE Press, Piscataway, N.J., 1992.

## Edited Proceedings and Special Issues:

- C.L. Giles, R. Sun, J. Zurada (Guest Editors) -
Special
Issue on “Neural Networks and Hybrid Intelligent Models:
Foundations,
Theory, and Applications,”
*IEEE Trans. on Neural Networks,*9(5), 1998. - J. Principe, L. Giles, N. Morgan, E. Wilson,
*Proceedings of the 1997 IEEE Workshop Neural Networks for Signal Processing VII*, IEEE Press, 1997. - C.L. Giles, G.M. Kuhn, R.J. Williams (Guest
Editors)
- Special Issue on “Dynamical Recurrent Neural Networks,”
*IEEE Trans. on Neural Networks*, 5(2), 1994. - S.J. Hanson, J.D. Cowan, C.L. Giles,
*Advances in Neural Information Processing Systems 5*, Morgan Kaufmann, San Mateo, CA, 1993.

## Technical Reports:

- Andrew D. Back, Ah Chung Tsoi, Bill G. Horne,
C.
Lee Giles, Alternative
Discrete-Time
Operators and Their Application to Nonlinear Models,
U.
of Maryland
*Technical Report CS-TR-3738 and UMIACS-TR-97-03*, 1997. - M.F. Sakr, S.P. Levitan, D.M. Chiarulli, B.G.
Horne,
C.L. Giles, Performance
of
On-Line Learning Methods in Predicting Multiprocessor
Memory Access
Patterns,
U. of Maryland
*Technical Report UMIACS-TR-96-59 and CS-TR-3676*, 1996. - Steve Lawrence, C. Lee Giles, Ah Chung Tsoi, What
Size
Neural Network Gives Optimal Generalization? Convergence
Properties of
Backpropagation. U. of Maryland
*Technical Report CS-TR-3617*. - Steve Lawrence, C. Lee Giles, Sandiway Fong, On
the
Applicability of Neural Network and Machine Learning
Methodologies
to
Natural Language Processing.
*Technical Report UMIACS-TR-95-64*. - P. Tino, B.G. Horne, C.L. Giles, Fixed
Points
in Two--Neuron Discrete Time Recurrent Networks: Stability
and
Bifurcation Considerations."
*Technical Report UMIACS-TR-95-51*. - C.W. Omlin, C.L. Giles, Fault-Tolerant
Implementation
of Finite-State Automata in Recurrent Neural Networks.
*RPI Computer Science Technical Report 95-3*. - Daniel S. Clouse, C.L. Giles, B.G. Horne,
G.W. Cottrell, Learning
Large
DeBruijn Automata with Feed-Forward Neural Networks.
*Technical Report UCSD CS94-398*. - Sun, G. Z., C. Lee Giles, H. H. Chen, Y. C. Lee, "The neural network pushdown automaton: Model, stack and learning simulations," U. of Maryland Technical Report UMIACS-TR-93-77 & CS-TR-3118, 1993.