HomeTech info

IBM Unveils Breakthrough Optical Data Transmission Technology That Enables 'Light-Speed' AI Training

IBM has developed a new optical technology that can help train AI models at the 'speed of light' while also saving significant energy. IBM says that by applying these new breakthroughs to data centers, the energy saved when training a typical AI model is equivalent to the annual energy use of 5,000 US households.

According to IBM, while data centers connect to the outside world using fiber optic cables, copper wires are still the predominant material used inside. These copper wires are responsible for connecting GPU accelerators that spend a lot of time waiting for data from other devices while using power, which significantly increases operating costs. Commenting on the new optical data transmission technology, Dario Gil, senior vice president and director of research at IBM, said:

As AI creates a need for more power and processing power, data centers must evolve – and generic packaged optics technology could help large-scale data centers better adapt to future demands. With this breakthrough, processors of the future will communicate in the same way fiber optic cables carry data in and out of data centers, ushering in a new era of faster, more sustainable communications that can handle massive AI workloads.

IBM Unveils Breakthrough Optical Data Transmission Technology That Enables 'Light-Speed' AI Training Picture 1

IBM outlines its new co-package optics (CPO) prototype in a technical paper. Essentially, by dramatically increasing bandwidth in data centers, GPU downtime can be minimized, accelerating AI processing.

IBM claims the technology can reduce the training time for large language models (LLMs) from three months to three weeks. At the same time, the increased energy efficiency will cut down on energy usage and reduce the costs associated with LLM training.

4 ★ | 1 Vote

You should read it

May be interested

  • MyLiFi lights provide safe Internet via LED lightsMyLiFi lights provide safe Internet via LED lights
    mylifi is a light bulb that provides a secure, wireless internet connection for neighboring devices, all through the led's data transmission capacity.
  • What is an optical switch? Advantages and disadvantages of optical switchesWhat is an optical switch? Advantages and disadvantages of optical switches
    optical switches are used on mid- and high-end keyboards, providing fast processing speed. let's find out what an optical switch is in this article.
  • Laptop plays HD content over Wi-FiLaptop plays HD content over Wi-Fi
    at the 2010 computex exhibition in taiwan, asus unveiled two laptops for g73jw and g53 gamers with the advantage of a built-in wirelesshd transmission technology that enables hd content transmission with digital devices. other.
  • New chip creates network 'up to 100 times faster than 5G'New chip creates network 'up to 100 times faster than 5G'
    a new type of d-band transceiver chip with a bandwidth of 56ghz using silicon complementary metal oxide semiconductor (cmos) technology has achieved the world's fastest wireless transmission speed of up to 640gbps.
  • 12 best WiFi data transfer apps on Android in 202112 best WiFi data transfer apps on Android in 2021
    the article introduces you to 12 applications for transferring data over wifi on android devices to help you easily share data quickly and conveniently. click now to see details!
  • How to Calculate Data Transfer SpeedHow to Calculate Data Transfer Speed
    data transfer rate (dtr) is the rate at which a certain amount of data is transferred in a specific period of time. you'll probably want to know what this speed is if you're downloading something from the internet or transferring data from one source to another. first, change the units so that the file size and transfer rate are both bits or bytes and have the same prefix (kilo, mega, giga, or tera). then plug your numbers into the formula s = a ÷ t, where a is the amount of data and t is the transmission time to calculate s (transfer rate). you can also calculate the amount of data or transfer time if you know either of these variables and the transfer rate.
  • Frame Relay, solutions for businesses and corporations (Part 1)Frame Relay, solutions for businesses and corporations (Part 1)
    frame relay is a wide area network data transmission service based on packet switching technology. this is a ccitt [1] and ansi [2] standard that defines the process of data transmission over public data networks. currently frame relay serves customers who need to connect wide area networks and use their own applications with high connection speeds (maximum bandwidth of 44,736 mbit / s) and for applications. complex like voice, sound and image. the characteristics of frame relay are the transmission of information over the network
  • Installing Internet at home: Optical cable or copper cable?Installing Internet at home: Optical cable or copper cable?
    internet fiber optic cable is a type of internet service provider that uses wires made of fiberglass or synthetic fibers and transmits data by light. therefore, it can transfer data at very high speeds (up to more than 10 gb / s).
  • USB 3.0 has a lot more to offer than 4.8 Gb / sUSB 3.0 has a lot more to offer than 4.8 Gb / s
    the new data transfer standard is 10 times faster than the current usb 2.0, but experts say it will include breakthrough features such as handling multiple streams of data at the same time.
  • USB 3.0: good technology, but still waitingUSB 3.0: good technology, but still waiting
    the following article will provide readers with a reason why usb 3.0, also known as superspeed ​​usb, with a transfer rate of 5 gbps, has not become an interface of choice since its introduction in 2008. .

Tech info