Optimization of fiber optics communication systems via end-to-end learning

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review


One of the key limiting factors in fiber optic communication systems is the nonlinear transmission impairment, due to the Kerr nonlinearity of optical fibers. In order to deal with this impairment, end-to-end learning can be applied to the optical fiber channel. Here, we discuss two different applications. The first, more standard, approach relies on a standard optical fiber communication system with conventional pulse shaping and makes use of autoencoders to optimize geometric constellation shaping, thus providing a solution robust to nonlinear optical impairments. This method relies on approximate perturbation models of the fiber channel. In the second approach, instead, end-to-end learning is used to jointly train a nonlinear Fourier transform (NFT) based transmitter and a neural network (NN) based receiver. This second direction therefore makes use of a theoretically optimal signaling scheme for lossless transmission and adapts it to a realistic scenario through end-to-end learning. In this case, the full split-step Fourier method is used to more precisely model the fiber channel. Through geometric constellation shaping, gains up to 0.13bit/4D numerically and 0.12 bit/4D experimentally can be shown. For end-to-end learning optimized transceivers for nonlinear frequency division multiplexing (NFDM) systems improvement of up to two orders of magnitude are achieved with respect to bit error ratio (BER) in a preliminary numerical analysis.
Original languageEnglish
Title of host publicationProceedings of 22nd International Conference on Transparent Optical Networks (ICTON)
Number of pages3
Publication date2020
Article number9203560
ISBN (Print)978-1-7281-8423-4
Publication statusPublished - 2020
Event22nd International Conference on Transparent Optical Networks - Virtual event, Bari, Italy
Duration: 19 Jul 202023 Jul 2020
Conference number: 22


Conference22nd International Conference on Transparent Optical Networks
LocationVirtual event
Internet address
Series 2012 14th International Conference on Transparent Optical Networks (ICTON)


  • Optical communication
  • Neural networks
  • Constellation shaping
  • Nonlinearity compensation


Dive into the research topics of 'Optimization of fiber optics communication systems via end-to-end learning'. Together they form a unique fingerprint.

Cite this