English

Scientists demonstrate a new optical neural network training method that can crush electronic microprocessors

102
2023-09-27 15:24:41
See translation

The current deep neural network system (such as ChatGPT) can quickly improve energy efficiency by 100 times in training, and "future improvements will greatly increase by several orders of magnitude. Scientists from MIT and other institutions have demonstrated a new optical neural network training method that can crush state-of-the-art electronic microprocessors.

Moreover, the computational density of the demonstrated system is about two orders of magnitude higher than that of Nvidia, Google, or Graphcore systems.

Basically, this means that the most advanced models can be trained with 100 times less energy and occupy less space at the same speed.

Artificial neural networks mimic the way biological brains process information. These artificial intelligence systems aim to learn, combine, and summarize information from big datasets, reshaping the field of information processing. Current applications include images, objects, speech recognition, games, medicine, and physical chemistry.

The current artificial intelligence model has reached hundreds of billions of artificial neurons, showing exponential growth and posing challenges to current hardware capabilities.

This paper demonstrates that optical neural network (ONN) methods with high clock speed, parallelism, and low loss data transmission can overcome current limitations.

Our technology opens up a path for large-scale optoelectronic processors to accelerate machine learning tasks from data centers to decentralized edge devices, "the paper wrote.

The ONN method is expected to alleviate the bottlenecks of traditional processors, such as the number of transistors, data mobility energy consumption, and semiconductor size. ONN uses light, which can carry a large amount of information simultaneously due to its wide bandwidth and low data transmission loss. In addition, many photonic circuits can be integrated to expand the system.

In order to move light for calculation, the team led by MIT utilized many laser beams, which were described as "using mass-produced micrometer scale vertical cavity surface emitting lasers for neuron coding".

The researchers explained, "Our scheme is similar to the 'axon synapse dendrite' structure in biological neurons
They believe that the demonstrated system can be expanded through mature wafer level manufacturing processes and photon integration.

Dirk Englund, Associate Professor of Electrical Engineering and Computer Science at the Massachusetts Institute of Technology and the head of this work, explained to SciTechDaily that the size of models such as ChatGPT is limited by the capabilities of today's supercomputers. Therefore, training larger models is not economically feasible.

He claimed, "Our new technology can make it possible to cross machine learning models, otherwise it would not be possible in the near future.

This paper titled "Deep Learning Using Coherent VCSEL Neural Networks" was published by a large team of scientists. This work has received support from the Army Research Office, NTT Research, and NTT Netcast Awards, as well as financial support from the Volkswagen Foundation. The three researchers of the team have applied for patents related to this technology.

Source: Laser Network

Related Recommendations
  • Korean researchers use laser ablation to create deformable micro supercapacitors

    Recently, a research team from the Korea Institute of Industrial Technology and POSTECH University successfully utilized laser sintering pattern technology to create a deformable micro supercapacitor (MSCs), specifically designed to provide energy storage solutions for soft electronic devices. This breakthrough meets the urgent need for efficient energy storage systems in stretchable devices in...

    2024-05-30
    See translation
  • Progress in Calibration of Large Aperture Diffractive Lenses in the High Power Laser Physics Joint Laboratory of Shanghai Institute of Optics and Mechanics

    Recently, the High Power Laser Physics Joint Laboratory of Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, proposed a single exposure interferometric calibration method for large aperture diffractive lenses, which provides strong support for the engineering application of large aperture diffractive lenses. The relevant achievements are published in Optics Letters as "...

    2023-10-14
    See translation
  • LASER World of PHOTONICS CHINA- 20th Anniversary Celebration Coming Soon!

    The Annual Grand Event for the Laser, Optics, and Optoelectronics Industry in AsiaLASER World of PHOTONICS CHINA20th Anniversary Celebration Coming Soon!📅 March 11-13📍 Shanghai New International Expo Centre (SNIEC), Entrance Hall 3🏢 Halls: N1-N5, E7-E4💡 1,400+ exhibitors across over 100,000 square meters Visitor Opening HoursDay 1: March 11 (Tuesday) 9:00 - 17:00Day 2: March 12 (Wednesday)...

    03-10
    See translation
  • GOLDEN laser die-cutting machine will be exhibited at UPAKEXPO 2024

    At the UpakExpo 2024 exhibition to be held in Moscow at the end of January, Chinese company Golden Laser will showcase for the first time two laser die-cutting machines focused on the printing, labeling, and packaging markets in Russia.The Golden Laser LC350 is a web machine designed to handle labels printed on digital and flexographic printing machines. It can cut, die cut, and kiss cut paper, pl...

    2024-01-12
    See translation
  • Developing a concentration independent pressure sensing method for high-temperature combustion diagnosis

    Recently, a research group led by Professor Gao Xiaoming and Professor Liu Kun of the Chinese Academy of Sciences Hefei Institute of Physical Sciences developed a concentration independent pressure sensing method based on two-color laser absorption spectrum for high-temperature combustion diagnosis.The research findings are published in Optics Letters.Aircraft engines are developing towards high-t...

    2024-03-08
    See translation