English

Scientists demonstrate a new optical neural network training method that can crush electronic microprocessors

1221
2023-09-27 15:24:41
See translation

The current deep neural network system (such as ChatGPT) can quickly improve energy efficiency by 100 times in training, and "future improvements will greatly increase by several orders of magnitude. Scientists from MIT and other institutions have demonstrated a new optical neural network training method that can crush state-of-the-art electronic microprocessors.

Moreover, the computational density of the demonstrated system is about two orders of magnitude higher than that of Nvidia, Google, or Graphcore systems.

Basically, this means that the most advanced models can be trained with 100 times less energy and occupy less space at the same speed.

Artificial neural networks mimic the way biological brains process information. These artificial intelligence systems aim to learn, combine, and summarize information from big datasets, reshaping the field of information processing. Current applications include images, objects, speech recognition, games, medicine, and physical chemistry.

The current artificial intelligence model has reached hundreds of billions of artificial neurons, showing exponential growth and posing challenges to current hardware capabilities.

This paper demonstrates that optical neural network (ONN) methods with high clock speed, parallelism, and low loss data transmission can overcome current limitations.

Our technology opens up a path for large-scale optoelectronic processors to accelerate machine learning tasks from data centers to decentralized edge devices, "the paper wrote.

The ONN method is expected to alleviate the bottlenecks of traditional processors, such as the number of transistors, data mobility energy consumption, and semiconductor size. ONN uses light, which can carry a large amount of information simultaneously due to its wide bandwidth and low data transmission loss. In addition, many photonic circuits can be integrated to expand the system.

In order to move light for calculation, the team led by MIT utilized many laser beams, which were described as "using mass-produced micrometer scale vertical cavity surface emitting lasers for neuron coding".

The researchers explained, "Our scheme is similar to the 'axon synapse dendrite' structure in biological neurons
They believe that the demonstrated system can be expanded through mature wafer level manufacturing processes and photon integration.

Dirk Englund, Associate Professor of Electrical Engineering and Computer Science at the Massachusetts Institute of Technology and the head of this work, explained to SciTechDaily that the size of models such as ChatGPT is limited by the capabilities of today's supercomputers. Therefore, training larger models is not economically feasible.

He claimed, "Our new technology can make it possible to cross machine learning models, otherwise it would not be possible in the near future.

This paper titled "Deep Learning Using Coherent VCSEL Neural Networks" was published by a large team of scientists. This work has received support from the Army Research Office, NTT Research, and NTT Netcast Awards, as well as financial support from the Volkswagen Foundation. The three researchers of the team have applied for patents related to this technology.

Source: Laser Network

Related Recommendations
  • Compact short pulse laser with an efficiency of up to 80%

    The research team from the University of Stuttgart and Stuttgart Instruments GmbH has published a groundbreaking research result in the journal Nature - a new compact ultra short pulse laser. This device achieves a significant improvement in efficiency while maintaining excellent precision, with its energy conversion efficiency reaching more than twice that of existing common devices. In addition,...

    11-12
    See translation
  • Shanghai Optical and Mechanical Institute has made progress in ultra-low threshold Rydberg state single mode polariton lasers based on symmetric engineering

    Recently, the research team of Dong Hongxing and Zhang Long from the Research Center of Infrared Optical Materials of the Chinese Academy of Sciences Shanghai Institute of Optics and Precision Mechanics, in cooperation with Huazhong University of Science and Technology, reported a new mechanism for generating dynamically tunable single-mode lasers from exciton polaritons with ultra-low thresholds,...

    2023-10-12
    See translation
  • Amazemet uses Siemens Xcelerator software for scaling metal 3D printing

    Polish metal 3D printing company Amazemet uses the Xcelerator software combination from industrial manufacturing company Siemens.The spin off company of Warsaw University of Technology is using Siemens workflow management software to develop its metal powder atomizer and 3D printing post-processing equipment.Amazemet was founded in 2016, and its ultrasonic atomization device is capable of producin...

    2024-04-18
    See translation
  • A review of research on residual stresses in carbon steel welding

    Researchers from the University of Witwatersrand in South Africa have reported a review of research on residual stresses in carbon steel welding: formation mechanisms, mitigation strategies, and advances in advanced post weld heat treatment technologies. The relevant paper titled "A comprehensive review of residual stresses in carbon steel welding: formation mechanisms, mitigation strategies, and ...

    04-12
    See translation
  • CO2 laser cutting machine for battery shell shaped parts: an innovative tool in energy technology manufacturing

    The development of new energy technology has made battery technology the engine for advancing clean energy. In battery manufacturing, the cutting of battery shell shaped parts is a crucial step. CO2 laser cutting machines have become an innovative tool for promoting the development of this field due to their high efficiency and precision. This article will delve into the important characteristics ...

    2023-12-25
    See translation