{"id":105625,"date":"2025-03-07T02:37:00","date_gmt":"2025-03-07T01:37:00","guid":{"rendered":"https:\/\/www.sonnenseite.com\/?p=105625"},"modified":"2025-03-07T09:30:48","modified_gmt":"2025-03-07T08:30:48","slug":"new-method-significantly-reduces-ai-energy-consumption","status":"publish","type":"post","link":"https:\/\/www.sonnenseite.com\/en\/science\/new-method-significantly-reduces-ai-energy-consumption\/","title":{"rendered":"New method significantly reduces AI energy consumption"},"content":{"rendered":"\n

The enormous computing resources needed to train neural networks for artificial intelligence (AI) result in massive power consumption. <\/p>\n\n\n\n

Researchers at the Technical University of Munich (TUM) have developed a method that is 100 times faster and therefore much more energy efficient. Instead of taking an iterative approach, the parameters are computed directly based on probabilities. The results so far are comparable in quality to existing iterative methods.<\/p>\n\n\n\n

AI applications such as large language models (LLMs) have become an integral part of our everyday lives. The required computing, storage and transmission capacities are provided by data centers that consume vast amounts of energy. In Germany alone this amounted to around 16 billion kWh in 2020, or around 1% of the country\u2019s total energy consumption. For 2025, this figure is expected to increase to 22 billion kWh.<\/p>\n\n\n\n

New method is 100 times faster with comparable accuracy<\/h4>\n\n\n\n

The arrival of more complex AI applications in the coming years will substantially increase the demands on data center capacity. These applications will use up huge amounts of energy for the training of neural networks. To counteract this trend, researchers have developed a training method that is 100 times faster while achieving accuracy comparable to existing procedures. This will significantly reduce the energy consumption for training.<\/p>\n\n\n\n

The functioning of neural networks, which are used in AI for such tasks as image recognition or language processing, is inspired by way the human brain works. These networks consist of interconnected nodes called artificial neurons. The input signals are weighted with certain parameters and then summed up. If a defined threshold is exceeded, the signal is passed on to the next node. To train the network, the initial selection of parameter values is usually randomized, for example using a normal distribution. The values are then incrementally adjusted to gradually improve the network predictions. Because of the many iterations required, this training is extremely demanding and consumes a lot of electricity.<\/p>\n\n\n\n

Parameters selected according to probabilities<\/h4>\n\n\n\n

Felix Dietrich, a professor of Physics-enhanced Machine Learning, and his team have developed a new method. Instead of iteratively determining the parameters between the nodes, their approach uses probabilities. Their probabilistic method is based on the targeted use of values at critical locations in the training data where large and rapid changes in values are taking place. The objective of the current study is to use this approach to acquire energy-conserving dynamic systems from the data. Such systems change over the course of time in accordance with certain rules and are found in climate models and in financial markets, for example.<\/p>\n\n\n\n

\u201cOur method makes it possible to determine the required parameters with minimal computing power. This can make the training of neural networks much faster and, as a result, more energy efficient,\u201d says Felix Dietrich. \u201cIn addition, we have seen that the accuracy of the new method is comparable to that of iteratively trained networks.\u201d<\/p>\n\n\n\n