Ayar Labs’ optical I/O unleashes the potential of next-generation AI compute architectures

Ayar Labs, the leader in chip-to-chip optical connectivity, is developing with NVIDIA groundbreaking artificial intelligence (AI) infrastructure based on optical I/O technology to meet future demands of AI and high performance computing (HPC) workloads. The collaboration will focus on integrating Ayar Labs’ technology to develop scale-out architectures enabled by high-bandwidth, low-latency and ultra-low-power optical-based interconnects for future NVIDIA products. Together, the companies plan to accelerate the development and adoption of optical I/O technology to support the explosive growth of AI and machine learning (ML) applications and data volumes.

Meeting Future Performance and Power Requirements with Optical I/O

Optical I/O uniquely changes the performance and power trajectories of system designs by enabling compute, memory and networking ASICs to communicate with dramatically increased bandwidth, at lower latency, over longer distances and at a fraction of the power of existing electrical I/O solutions. The technology is also foundational to enabling emerging heterogeneous compute systems, disaggregated/pooled designs, and unified memory architectures that are critical to accelerating future data center innovation.

“Today’s state-of-the-art AI/ML training architectures are limited by current copper-based compute-to-compute interconnects to build scale-out systems for tomorrow’s requirements,” said Charles Wuischpard, CEO of Ayar Labs. “Our work with NVIDIA to develop next-generation solutions based on optical I/O provides the foundation for the next leap in AI capabilities to address the world’s most sophisticated problems.”

Delivering the ‘Next Million-X’ Speedup for AI with Optical Interconnect

“Over the past decade, NVIDIA-accelerated computing has delivered a million-X speedup in AI,” said Rob Ober, Chief Platform Architect for Data Center Products at NVIDIA. “The next million-X will require new, advanced technologies like optical I/O to support the bandwidth, power and scale requirements of future AI and ML workloads and system architectures.”

As AI model sizes continue to grow, by 2023 NVIDIA believes that models will have 100 trillion or more connections – a 600X increase from 2021 – exceeding the technical capabilities of existing platforms. Traditional electrical-based interconnects will reach their bandwidth limits, driving lower application performance, higher latency and increased power consumption. New interconnect solutions and system architectures are needed to address the scale, performance and power demands of the next generation of AI. Ayar Labs’ collaboration with NVIDIA is focused on addressing these future challenges by developing next-generation architectures with optical I/O.

To learn more about Ayar Labs’ chip-to-chip optical technology, please visit: https://ayarlabs.com/

About Ayar Labs

Ayar Labs is disrupting the traditional performance, cost, and efficiency curves of the semiconductor and computing industries by driving a 1000x improvement in interconnect bandwidth density at 10x lower power. Ayar Labs’ patented approach uses industry standard cost-effective silicon processing techniques to develop high speed, high density, low power optical-based interconnect “chiplets” and lasers to replace traditional electrical based I/O. The company was founded in 2015 and is funded by a number of domestic and international venture capital firms as well as strategic investors. For more information, visit www.ayarlabs.com.

View source version on businesswire.com: https://www.businesswire.com/news/home/20220525005285/en/