Abstract
Deep neural networks are usually trained in the space of the nodes, by adjusting the weights of existing links via suitable optimization protocols. We here propose a radically new approach which anchors the learning process to reciprocal space. Specifically, the training acts on the spectral domain and seeks to modify the eigenvalues and eigenvectors of transfer operators in direct space. The proposed method is ductile and can be tailored to return either linear or non-linear classifiers. Adjusting the eigenvalues, when freezing the eigenvectors entries, yields performances that are superior to those attained with standard methods restricted to operate with an identical number of free parameters. To recover a feed-forward architecture in direct space, we have postulated a nested indentation of the eigenvectors. Different non-orthogonal basis could be employed to export the spectral learning to other frameworks, as e.g. reservoir computing.
Original language | English |
---|---|
Article number | 1330 |
Journal | Nature Communications |
Volume | 12 |
Issue number | 1 |
DOIs | |
Publication status | Published - 26 Feb 2021 |
Keywords
- machine learning
- neural networks
- Artificial Intelligence
- MNIST database
- spectral domain
Fingerprint
Dive into the research topics of 'Machine learning in spectral domain'. Together they form a unique fingerprint.Student theses
-
A Journey Through Reciprocal Space: from Deep Spectral Learning to Topological Signals
Author: Giambagli, L., 21 Feb 2024Supervisor: Carletti, T. (Supervisor), Fanelli, D. (External person) (Co-Supervisor), Libert, A. (President), Frasca, M. (External person) (Jury), SCHAUB, M. (Jury) & Clementi, C. (External person) (Jury)
Student thesis: Doc types › Doctor of Sciences
File