BoE and FCA Examine Use of Machine Learning in Financial Sector in UK
BoE and FCA published a report on the results of a joint survey by BoE and FCA in 2019 to better understand the use of machine learning in the financial services sector in UK. A total of 106 responses were received from this survey, which was sent to almost 300 firms, including banks, credit brokers, e-money institutions, financial market infrastructure firms, investment managers, insurers, non-bank lenders, and principal trading firms. With respect to the respondent firms, the joint BoE-FCA report presents a quantitative overview of the use of machine learning, the machine learning implementation strategies of firms, approaches to the governance of machine learning, and the share of applications developed by third-party providers. Also covered are the perceptions of risks and ethical considerations and perspectives on constraints to development and deployment of machine learning, along with a snapshot of the use of different methods, data, safeguards performance metrics, validation techniques, and perceived levels of complexity.
The survey collected information about the nature of deployment of machine learning, the business areas where it is used, and the maturity of applications. It also collected information on the technical characteristics of specific machine learning use cases. This included how the models were tested and validated, the safeguards built into the software, the types of data and methods used, and considerations around benefits, risks, complexity, and governance. The key findings of the survey include the following:
- Machine learning is increasingly being used in UK financial services. Two-third of the respondents reported that they already use it in some form. The median firm uses live machine learning applications in two business areas and this is expected to more than double within the next three years.
- In many cases, machine learning development has passed the initial development phase and is entering more mature stages of deployment. One-third of the machine learning applications are used for a considerable share of activities in a specific business area. Deployment is most advanced in the banking and insurance sectors.
- Regulation is not seen as an unjustified barrier but some firms stress the need for additional guidance on how to interpret the current regulation. The biggest reported constraints are internal to firms, such as legacy IT systems and data limitations.
- Firms thought that machine learning does not necessarily create new risks, but could be an amplifier of the existing ones. Risks, such as machine learning applications not working as intended, may occur if model validation and governance frameworks do not keep pace with technological developments.
- Firms validate machine learning applications before and after deployment. The most common validation methods are outcome-focused monitoring and testing against benchmarks. However, many firms note that machine learning validation frameworks still need to evolve in line with the nature, scale, and complexity of machine learning applications.
- Firms mostly design and develop machine learning applications in-house. However, they sometimes rely on third-party providers for the underlying platforms and infrastructure, such as cloud computing.
- The majority of users apply their existing model risk management framework to machine learning applications. However, many highlight that these frameworks might have to evolve in line with the increasing maturity and sophistication of machine learning techniques.
This survey was the first step toward better understanding the impact of machine learning on UK financial services and forms the basis for a conversation about how safe machine learning deployment can be supported going forward. To foster further conversation around machine learning innovation, BoE and FCA have announced plans to establish a public-private group to explore some of the questions and technical areas covered in this report. BoE and FCA are also considering repeating this survey in 2020.
Related Links
Keywords: Europe, UK, Banking, Insurance, Securities, Machine Learning, Governance, Risk Management, Fintech, FCA, BoE
Previous Article
IOSCO Publishes Results of Survey on Commodity Derivatives MarketsRelated Articles
BIS and Central Banks Experiment with GenAI to Assess Climate Risks
A recent report from the Bank for International Settlements (BIS) Innovation Hub details Project Gaia, a collaboration between the BIS Innovation Hub Eurosystem Center and certain central banks in Europe
Nearly 25% G-SIBs Commit to Adopting TNFD Nature-Related Disclosures
Nature-related risks are increasing in severity and frequency, affecting businesses, capital providers, financial systems, and economies.
Singapore to Mandate Climate Disclosures from FY2025
Singapore recently took a significant step toward turning climate ambition into action, with the introduction of mandatory climate-related disclosures for listed and large non-listed companies
SEC Finalizes Climate-Related Disclosures Rule
The U.S. Securities and Exchange Commission (SEC) has finalized the long-awaited rule that mandates climate-related disclosures for domestic and foreign publicly listed companies in the U.S.
EBA Proposes Standards Related to Standardized Credit Risk Approach
The European Banking Authority (EBA) has been taking significant steps toward implementing the Basel III framework and strengthening the regulatory framework for credit institutions in the EU
US Regulators Release Stress Test Scenarios for Banks
The U.S. regulators recently released baseline and severely adverse scenarios, along with other details, for stress testing the banks in 2024. The relevant U.S. banking regulators are the Federal Reserve Bank (FED), the Federal Deposit Insurance Corporation (FDIC), and the Office of the Comptroller of the Currency (OCC).
Asian Governments Aim for Interoperability in AI Governance Frameworks
The regulatory landscape for artificial intelligence (AI), including the generative kind, is evolving rapidly, with governments and regulators aiming to address the challenges and opportunities presented by this transformative technology.
EBA Proposes Operational Risk Standards Under Final Basel III Package
The European Union (EU) has been working on the final elements of Basel III standards, with endorsement of the Banking Package and the publication of the European Banking Authority (EBA) roadmap on Basel III implementation in December 2023.
EFRAG Proposes XBRL Taxonomy and Standard for Listed SMEs Under ESRS
The European Financial Reporting Advisory Group (EFRAG), which plays a crucial role in shaping corporate reporting standards in European Union (EU), is seeking comments, until May 21, 2024, on the Exposure Draft ESRS for listed SMEs.
ECB to Expand Climate Change Work in 2024-2025
Banking regulators worldwide are increasingly focusing on addressing, monitoring, and supervising the institutions' exposure to climate and environmental risks.