Machine learningEconometrics & Forecasting

Universality of Linear Recurrences Followed by Non-linear Projections: Finite-Width Guarantees and Benefits of Complex Eigenvalues

The study reveals that deep neural networks using linear complex-valued RNNs and MLPs can accurately approximate regular causal sequence-to-sequence maps, with complex eigenvalues near unit disk aiding in information storage.