Deep Reinforcement Learning Improves Automatic Routing Performance in OTNs

Facebook X LinkedIn Email
BARCELONA, Spain, March 6, 2019 — Researchers from Universitat Politècnica de Catalunya and Huawei have retooled an AI technique to make optical transport networks (OTNs) run more efficiently. OTNs could be used to package data in the fiber optic cables used for transmitting data over long distances, and improving OTN performance would make this transmission more efficient.

OTNs require rules to make the split-second decisions required to manage large amounts of traffic. In a new approach to writing these rules, the researchers combined two machine learning techniques: reinforcement learning and deep learning. In reinforcement learning, a virtual “agent” learns through trial and error to optimize how resources are managed. Deep learning supports the reinforcement-based approach by using neural networks to draw more abstract conclusions from each round of trial and error.

So far, the most advanced deep reinforcement learning algorithms have been able to optimize some resource allocation in OTNs, but become stuck when they run into novel scenarios. The researchers worked to overcome this by varying the manner in which data are presented to the agent. After learning the OTNs through 5000 rounds of simulations, the researchers found that the deep reinforcement learning agent directed traffic with 30 percent greater efficiency than the current state-of-the-art algorithm.

One thing that surprised the team was how easily the new approach was able to learn about the networks after starting out with a blank slate. “This means that without prior knowledge, a deep reinforcement learning agent can learn how to optimize a network autonomously,” professor Albert Cabellos-Aparicio said. “This results in optimization strategies that outperform expert algorithms.” With the enormous scale some optical transport networks already have, Cabellos-Aparicio said, even small advances in efficiency could reap large returns in reduced latency and operational costs.

Next, the team plans to apply its deep reinforcement learning strategies in combination with graph networks, an emerging field within artificial intelligence with the potential to transform the computer networks, chemistry, and logistics used in industry and science.

The team’s technical results are outlined in a paper presented at OFC: The Optical Fiber Communications Conference and Exhibition, March 3-7, in San Diego (   

Published: March 2019
deep learning
Deep learning is a subset of machine learning that involves the use of artificial neural networks to model and solve complex problems. The term "deep" in deep learning refers to the use of deep neural networks, which are neural networks with multiple layers (deep architectures). These networks, often called deep neural networks or deep neural architectures, have the ability to automatically learn hierarchical representations of data. Key concepts and components of deep learning include: ...
artificial intelligence
The ability of a machine to perform certain complex functions normally associated with human intelligence, such as judgment, pattern recognition, understanding, learning, planning, and problem solving.
Research & TechnologyeducationAmericasEuropeOpticsfiber opticsoptical networksneural networksdeep learningartificial intelligenceoptical transport networksUniversitat Politècnica de CatalunyaHuaweideep reinforcement learning

We use cookies to improve user experience and analyze our website traffic as stated in our Privacy Policy. By using this website, you agree to the use of cookies unless you have disabled them.