• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

Tabular Data Anonymisation Solution for Safe Use in AI Systems Developed at HSE University

Tabular Data Anonymisation Solution for Safe Use in AI Systems Developed at HSE University

© iStock

The AI and Digital Science Institute at the HSE Faculty of Computer Science has developed a tabular data anonymisation service designed to prepare corporate datasets for use in analytics and AI applications. The solution can identify personal data in structured datasets, apply consistent and reproducible anonymisation rules, and generate the artifacts required for quality control, auditing, and subsequent use of data in secure environments.

The solution addresses one of the key challenges of AI adoption in organisations: real-world data is essential for training, testing, and monitoring models, yet its direct use often carries the risk of exposing personal information. This challenge is particularly acute when working with data from corporate information systems, where information about users, employees, students, or clients is stored in the form of interconnected tables, identifiers, and attributes.

The service developed at HSE University addresses this challenge by combining processing rules, a replacement registry, and a reproducible anonymisation model. Given identical input data, the system produces consistent and predictable results, which is essential for the replicability of experiments, data quality assurance, and subsequent auditing. This approach preserves the structure of the dataset and maintains its suitability for analytical applications and AI use scenarios.

The solution is being developed in compliance with Russian personal data legislation and applicable requirements for data anonymisation. Its architecture provides for separate storage of source data and processing artifacts, as well as management of replacement rules, access controls, integrity checks, and a replacement registry. Together, these mechanisms enable the service to be integrated into a controlled AI data lifecycle management framework.

Currently, the service is used within HSE University's SmartMLOps platform to process data from the university's corporate information systems. Its applications include preparing data for analytics, testing, and the deployment of AI services. The solution can also be adapted for use in secure environments by organisations handling sensitive datasets, including those in education, healthcare, industry, finance, and government.

A separate line of development focuses on creating a version for unstructured data such as text documents, communications, contracts, and other materials in which personal data appears in free form. This version is currently under development and undergoing pilot testing. It will use a combination of rule-based methods, NLP (natural language processing) tools, and NEM (named entity recognition) models to identify personal data in texts while considering the context.

Hadi Saleh

Hadi Saleh

'It is not enough for AI projects to simply have access to data. It is necessary to prepare data in a way that preserves its analytical value while ensuring that personal information is not disclosed. Our service addresses exactly this engineering challenge: it integrates anonymisation into a managed process for preparing data for AI,' said project leader Hadi Saleh, Head of the Unit for Applied Technological Solutions at the AI and Digital Science Institute, HSE Faculty of Computer Science.

The rights to the core components of the solution are reserved. The team envisions further development of the service both as an internal tool at HSE University and as a solution for deployment in secure environments within organisations that require data preparation for AI while complying with personal data protection requirements.

The project is ranked among the top 10 in the Data Security, Trust, and Quality category of the 2026 Gravitation International University Award in AI and Big Data.

The service was developed by the team of the Strategic Technological Project 'Multi-Agent AI Platform for Sectoral Solutions' as part of HSE University’s Development Programme for 2025–2036, supported under the Priority 2030 Strategic Academic Leadership Programme.

See also:

Scientists Create Open Dataset for Studying Concentration

A team of Russian researchers, including scientists from HSE University–St Petersburg, has developed the first open multimodal dataset containing recordings of brain activity, heart function, and video observations to help researchers understand what happens in the human brain during deep concentration. In the future, the dataset could accelerate the development of neural interfaces, rehabilitation technologies, and AI systems. The article has been published in Scientific Data.

Scientists Propose Method for More Efficient Resource Use in Machine Learning

An international group of researchers, including mathematicians from the AI and Digital Science Institute at the HSE Faculty of Computer Science, has provided a theoretical justification for a simple and computationally efficient method of estimating uncertainty in Stochastic Gradient Descent (SGD). The paper has been published on the scientific preprint server arXiv.org and presented at AISTATS 2026.

Team Success: Aligning Means with Objectives

In corporations, sports, and academia, people often face challenges they cannot handle alone. In such cases, selecting the right team is crucial. Tatiana Mayskaya, Associate Professor at the HSE Faculty of Economic Sciences and the International College of Economics and Finance, together with colleagues from foreign universities, examined team characteristics and found that less diverse teams are better suited to objectives where a high average performance is important, whereas more diverse teams are preferable when avoiding failure is critical. The paper has been published in Economic Theory.

HSE MIEM Students to Develop Two Satellites from Scratch for Orbital Experiments

The devices, created by student teams, will conduct space research on the properties of promising solar cells, on-board energy storage systems, and serial electronics for student satellites.

Economists Propose More Effective Approach to Reducing Smoking

Economists at HSE University have examined how smokers respond to changes in cigarette prices. When tobacco prices increase, cigarette consumption does not always decline. In fact, spending on tobacco may even rise: according to the researchers, a 1% decrease in cigarette affordability leads to a 0.28% increase in per capita tobacco expenditure. The findings suggest that to reduce smoking rates, tobacco prices must rise faster than household incomes. The study has been published in Voprosy Statistiki.

Biologists Discover Unique Properties of MiR-93-5p MicroRNA in Prostate Cancer

Researchers at the International Laboratory of Microphysiological Systems of the HSE Faculty of Biology and Biotechnology investigated how different isoforms of the same microRNA influence gene function in prostate adenocarcinoma. The study found that in some cases, microRNAs can reinforce each other’s effects by targeting and suppressing the same genes. This finding offers a fresh perspective on the molecular mechanisms underlying tumour development and on the search for disease biomarkers. The results have been published in PeerJ.

HSE Researchers Provide the World’s First Legal Definition of a Digital Ecosystem

Digital ecosystems have evolved from a technological innovation into a fundamental institution of the modern economy over the past few years. According to HSE University’s latest estimates, they account for 8.5% of Russia’s GDP. Previously, no jurisdiction had a statutory definition of what constitutes a digital ecosystem. HSE University researchers have addressed this gap by proposing the first legal concept of a digital ecosystem. Their article, ‘The Digital Ecosystem as a Novel Economic Phenomenon and Legal Concept,’ has been published in the BRICS Law Journal.

HSE Economists Use Search Queries to Forecast Birth Rates

Researchers from the HSE Faculty of Economic Sciences have shown that the accuracy of birth rate forecasts for Russia can be improved by almost 50% by incorporating the dynamics of online search queries related to pregnancy and childbirth into forecasting models. In the best-performing models, the forecasting error fell from 4.6% to 3.2%. The findings have been published in Populations and Economics.

When Looking at Their Own Faces, Men Forget Everything

In an experiment involving 15 healthy men, scientists at HSE University investigated how different phases of the cardiac cycle influence the excitability of the motor cortex when participants viewed either their own photograph or the faces of strangers. The researchers found that when participants looked at their own image, the brain’s response to signals from the heart was weaker, meaning that the influence of cardiac activity on the motor cortex decreased. This finding came contrary to expectations, as self-focused attention was thought to enhance the brain's sensitivity to internal bodily signals. The study has been published in Frontiers in Signal Processing.

HSE Researchers Discover Who Eats Out in Russia—And Why

Around one-third of Russians (31.3%) rarely eat out or buy ready-made meals. The core group of active consumers—those who eat out or purchase prepared food almost every day or several times a week—accounts for only about 9% of the population. These are the findings of a study conducted by the HSE Institute for Social Policy. According to the researchers eating out is no longer a marker of high social status in Russia.