Complex-valued neural networks for machine learning on non-stationary physical data

Jesper Søren Dramsch*, Mikael Lüthje, Anders Nymark Christensen

*Corresponding author for this work

Research output: Contribution to journalJournal articleResearchpeer-review

Abstract

Deep learning has become an area of interest in most scientific areas, including physical sciences. Modern networks apply real-valued transformations on the data. Particularly, convolutions in convolutional neural networks discard phase information entirely. Many deterministic signals, such as seismic data or electrical signals, contain significant information in the phase of the signal. We explore complex-valued deep convolutional networks to leverage non-linear feature maps. Seismic data commonly has a lowcut filter applied, to attenuate noise from ocean waves and similar long wavelength contributions. In non-stationary data, the phase content can stabilize training and improve the generalizability of neural networks. While it has been shown that phase content can be restored in deep neural networks, we show how including phase information in feature maps improves both training and inference from deterministic physical data. Furthermore, we show that smaller complex networks outperform larger real-valued networks.

Original languageEnglish
Article number104643
JournalComputers and Geosciences
Volume146
Number of pages13
ISSN0098-3004
DOIs
Publication statusPublished - Jan 2021

Keywords

  • Deep learning
  • Geophysics
  • Machine learning
  • Neural networks
  • Physics-based machine learning
  • Seismic

Fingerprint Dive into the research topics of 'Complex-valued neural networks for machine learning on non-stationary physical data'. Together they form a unique fingerprint.

Cite this