ECB on Approach to Discover Plausibility Checks for Reporting Data
The European Central Bank (ECB) published a paper that presents a data-driven approach, based on machine learning, for discovering new plausibility checks on reporting data. The paper aims to provide a further tool to support the development of new checks that extend the validation rules to automatically detect potential quality issues requiring further investigation. The presented approach uses large amounts of historical data to identify patterns of interest in past observations. These patterns are suitable for discovering data anomalies and can serve as a basis for defining new checks. The paper illustrates how such patterns are used by business experts to refine their data quality framework. The paper also provides suggestions for further work that could be done to improve technical performance and prediction quality.
The approach serves business experts in two ways: one of the ways is by inspiring business experts to formulate new plausibility checks, which can be implemented in reporting systems and thus have permanent, positive effects on data quality; the second way is by making it possible to conduct ad hoc investigations into specific observations of anomalous or suspicious values. Overall, the approach has shown its benefits for the use cases considered and will be used for investigative data quality management in the future. The evaluation also provided some insights into potential extended applications. ECB has already started to investigate other sets of templates for identifying new plausibility checks. Preliminary results showed that in the context of the COREP framework, too, it was able to identify latent relationships that may serve as basis for new rules. An interesting next step will be to extend the investigations to relationships that span data from both the FINREP and COREP templates. At present, such relationships are not subject to any checks, so they represent a promising line of investigation. Another extended application regarding data is to cover more reporting periods and to look for seasonal patterns.
Finally, there are some technical improvements that might be worth investigating. One main area for improving the performance of the predictive model is to make a better distinction in the data between missing values and semantic zero values. For instance, the analysis considered differentiating between models for predicting the presence of a data point and those for predicting its actual values. This would make it easier to identify implausible values that actually represent missing or non-reported data. Another area of work on future extensions is a broader evaluation of other models for the regression analysis, also taking into consideration ensemble methods. This might lead to further improvements in prediction quality and needs to be accompanied by explainable artificial intelligence methods.
Related Link: Paper (PDF)
Keywords: Europe, EU, Banking, Plausibility Checks, Reporting, FINREP, COREP, SUBA, Data Quality Checks, Machine Learning, Artificial Intelligence, Regtech, ECB
Featured Experts
María Cañamero
Skilled market researcher; growth strategist; successful go-to-market campaign developer
Nicolas Degruson
Works with financial institutions, regulatory experts, business analysts, product managers, and software engineers to drive regulatory solutions across the globe.
Scott Dietz
Scott is a Director in the Regulatory and Accounting Solutions team responsible for providing accounting expertise across solutions, products, and services offered by Moody’s Analytics in the US. He has over 15 years of experience leading auditing, consulting and accounting policy initiatives for financial institutions.
Previous Article
EBA and EIOPA Set Out Work Priorities for 2022Related Articles
BIS and Central Banks Experiment with GenAI to Assess Climate Risks
A recent report from the Bank for International Settlements (BIS) Innovation Hub details Project Gaia, a collaboration between the BIS Innovation Hub Eurosystem Center and certain central banks in Europe
Nearly 25% G-SIBs Commit to Adopting TNFD Nature-Related Disclosures
Nature-related risks are increasing in severity and frequency, affecting businesses, capital providers, financial systems, and economies.
Singapore to Mandate Climate Disclosures from FY2025
Singapore recently took a significant step toward turning climate ambition into action, with the introduction of mandatory climate-related disclosures for listed and large non-listed companies
SEC Finalizes Climate-Related Disclosures Rule
The U.S. Securities and Exchange Commission (SEC) has finalized the long-awaited rule that mandates climate-related disclosures for domestic and foreign publicly listed companies in the U.S.
EBA Proposes Standards Related to Standardized Credit Risk Approach
The European Banking Authority (EBA) has been taking significant steps toward implementing the Basel III framework and strengthening the regulatory framework for credit institutions in the EU
US Regulators Release Stress Test Scenarios for Banks
The U.S. regulators recently released baseline and severely adverse scenarios, along with other details, for stress testing the banks in 2024. The relevant U.S. banking regulators are the Federal Reserve Bank (FED), the Federal Deposit Insurance Corporation (FDIC), and the Office of the Comptroller of the Currency (OCC).
Asian Governments Aim for Interoperability in AI Governance Frameworks
The regulatory landscape for artificial intelligence (AI), including the generative kind, is evolving rapidly, with governments and regulators aiming to address the challenges and opportunities presented by this transformative technology.
EBA Proposes Operational Risk Standards Under Final Basel III Package
The European Union (EU) has been working on the final elements of Basel III standards, with endorsement of the Banking Package and the publication of the European Banking Authority (EBA) roadmap on Basel III implementation in December 2023.
EFRAG Proposes XBRL Taxonomy and Standard for Listed SMEs Under ESRS
The European Financial Reporting Advisory Group (EFRAG), which plays a crucial role in shaping corporate reporting standards in European Union (EU), is seeking comments, until May 21, 2024, on the Exposure Draft ESRS for listed SMEs.
ECB to Expand Climate Change Work in 2024-2025
Banking regulators worldwide are increasingly focusing on addressing, monitoring, and supervising the institutions' exposure to climate and environmental risks.
