• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

HSE and Yandex Propose Method to Speed Up Neural Networks for Image Generation

HSE and Yandex Propose Method to Speed Up Neural Networks for Image Generation

© iStock

A team of scientists at HSE FCS and Yandex Research has proposed a method that reduces computational costs and accelerates text-to-image generation in diffusion models without compromising quality. These models currently set the standard for text-to-image generation, but their use is limited by high computational loads, the company said in a statement.

It is further specified that the developed method—Scale-wise Distillation of Diffusion Models (SwD)—avoids redundant computations during image generation, allowing results to be produced in just 0.3–0.4 seconds.

According to one of the authors, the generation process in diffusion models typically requires dozens of steps involving high-resolution computations. However, in the early stages, only the general structure of the image is formed, and fine details are not yet distinguishable; as a result, some of these computations are redundant. The proposed SwD framework addresses this problem in two ways. First, generation begins at a low resolution and is progressively refined as noise is reduced, eliminating redundant computations in the early stages. Second, the method uses distillation of pre-trained models such as FLUX and Stable Diffusion 3.5, whereby a simpler student model learns to replicate the output of a more complex one, reducing the number of generation steps from dozens to just 4–6. 

The authors propose a new loss function for training—Maximum Mean Discrepancy (MMD), which compares how the teacher model 'sees' an image at its internal processing levels with how the student model represents the same image. Unlike traditional approaches, this method does not require auxiliary models, simplifying and accelerating training, the company emphasises. Moreover, MMD can be used as a standalone distillation (knowledge compression) technique: in experiments, the time per training iteration was reduced sevenfold compared to more complex combined approaches. 

The new approach reduces generation time from several seconds to just 0.3–0.4 seconds while maintaining visual quality. As a result, SwD makes modern diffusion models faster and more cost-efficient to use, improving their accessibility for practical applications, the company statement says.

The solution is described in a paper to be presented at ICLR 2026, one of the leading conferences on artificial intelligence.

See also:

Neural Network Maps as a Method for Constructing Mathematical Models

Scientists from HSE University–Nizhny Novgorod and the Institute of Physics Belgrade, Serbia, are jointly exploring the application of machine learning techniques and neural networks to the study of nonlinear dynamics. Natalya Stankevich, Leading Research Fellow at the Laboratory of Topological Methods in Dynamics of the Faculty of Informatics, Mathematics, and Computer Science at HSE University–Nizhny Novgorod, spoke to the HSE News Service about this international project.

HSE Scientists Develop Method to Compress Large Language Models Without Losing Quality

Researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science have developed a new compression method for large language models such as GPT and LLaMA that reduces their size by 25–36% without additional training or significant loss of accuracy. This is the first approach to use mathematical transformations—specifically, rotations of model weights—to make models more amenable to compression with structured matrices. The study results have been published in ACL Findings 2025. The code is available on GitHub.

Machine Learning Models Can Help Reduce Volatility and Boost Stock Market Returns

The use of machine learning models makes it possible to achieve greater accuracy in predicting risks in the Russian stock market compared to classical econometric approaches. The predictive power of these models increases by 23%, while the average investor’s return can reach up to 13% per annum. These conclusions were drawn by Nikita Lysenok from the Department of Financial Market Infrastructure at the HSE Faculty of Economic Sciences. The paper has been published in Fundamental and Applied Mathematics.

Pocket Money, Personal Interest, and Family Practices: What Shapes Students’ Economic Literacy?

University students' economic literacy depends not only on their field of study but also on their interest in economics, the learning environment, and family financial practices. For example, students who received pocket money irregularly tend to perform better on economic literacy tests than their peers who received financial support on a regular basis. These findings come from a study conducted by HSE University involving more than 1,100 students from five Russian universities. The findings have been published in Cakrawala Pendidikan.

HSE Study Reveals Imbalance in the Generative AI Market

Researchers at HSE University analysed how effectively the global generative artificial intelligence market converts investment into real revenue, concluding that AI is currently developing faster than it is paying off. The results have been published in the journal Foresight and STI Governance.

‘Entering Robotics Now Means Growing with the Area’

Unmanned vehicles, courier robots, and smart speakers are rapidly becoming a part of our lives. In 2026, the HSE Faculty of Computer Science opens its new Bachelor’s Programme ‘Design of Intelligent Robotic Systems’ (DIRS). It will train specialists at the intersection of IT, artificial intelligence, and robotics. Academic Supervisor of DIRS Vadim Morgachev explains how studies are organised and why graduates of the programme ‘will definitely be accepted into the future.’

HSE Scientists Train Neural Network to 'Hear' Faults in Electric Motors

Researchers at the AI and Digital Science Institute of the HSE Faculty of Computer Science have developed a new method—the Signature-Guided Data Augmentation (SGDA) framework—that achieves 99% accuracy in motor fault detection and 86% accuracy in fault classification. The application of this approach can reduce industrial equipment repair costs, minimise downtime, and improve production safety. The study results have been published in Engineering Applications of Artificial Intelligence.

HSE Graduate’s AI Project Wins at TECH & AI Awards

Daria Davydova, graduate of the HSE Graduate School of Business and Head of the AI Implementation Unit at the Artificial Intelligence Department of Alfa-Bank, received a prize at the TECH & AI Awards. She was awarded for the best AI solution for optimising business processes. The winners were determined as part of the VII Russian Summit and Awards on Digital Transformation (CDO/CDTO Summit & Awards).

MIEM Tech Day at Pokrovka: Exploring HSE’s Engineering DNA Together

On May 26, 2026, the central atrium of the building at 11 Pokrovsky Bulvar will host the annual large-scale festival of engineering developments created by project teams from the HSE Tikhonov Moscow Institute of Electronics and Mathematics (HSE MIEM). The programme includes presentations of the best student technological projects, stands from partner companies and joint workshops, a lecture series featuring practising engineers, a round table on the development of engineering education, and presentations of MIEM master’s degree programmes.

The 'Second Shift' Is Not Why Women Avoid News

Women are more likely than men to avoid political and economic news, but the reasons for this behaviour are linked less to structural inequality or family-related stress than to personal attitudes and the emotional perception of news content. This conclusion was reached by HSE researchers after analysing data from a large-scale survey of more than 10,000 residents across 61 regions of Russia. The study findings have been published in Woman in Russian Society.