BoE has set out results of a survey on the impact of COVID-19 events on the use of machine learning and data science. The survey, which was conducted among 17 UK banks and 9 foreign banks with UK operations, aimed to understand how these technologies are being used by the supervised and regulated firms, assess the potential policy implications of these findings, and support the safe and productive deployment of machine learning and data science across the financial sector. BoE states that it will continue to consider whether new policy initiatives may help firms to realize the benefits and more effectively manage the risks of artificial intelligence, machine learning, and data science. One of the survey findings is that COVID-19 events had a "positive" impact on outsourcing and the use of third-party providers by large banks.
In general, half of the surveyed banks reported an increase in the importance of machine learning and data science as a result of the pandemic, with none of the banks believing that COVID-19 crisis will reduce the importance of machine learning and data science for them. Nearly 40% of the survey respondents reported an increase in the importance of machine learning and data science for future operations and a further 10% of the banks reported a large increase. None of the banks reported a decrease in the importance of machine learning and data science. About a third of the banks said there was an increase in the number of ongoing machine learning and data science applications. Yet only 16% of the banks reported an increase in funding and/or resourcing for existing applications and a similar number reported a decrease. Similarly, nearly 35% of banks reported an increase in the number of planned applications but only 23% of the banks reported an increase in funding and/or resourcing for planned applications and 11.5% of banks reported a decrease. Meanwhile, about 35% of the banks reported a negative impact on machine learning model performance. This is likely because the pandemic has created major movements in macroeconomic variables, such as rising unemployment and mortgage forbearance, which required machine learning (as well as traditional) models to be recalibrated. The pandemic has created a major downturn that could not have been forecasted on the basis of economic data alone or historical predictors.
Additionally, notable differences exist between small and large UK banks with respect to their use of third-party vendor products and services. Smaller banks reported a "positive" impact (for example, in terms of performance, impact, use) of COVID-19 on all categories of data science and machine learning, with data collection, and model testing and validation being the areas with the largest "positive’ impact. Large UK banks reported a "positive" impact on use of outsourced platforms and infrastructure. These findings are in line with market intelligence that smaller banks are looking to increase their use of off-the-shelf machine learning products. This stands to reason, given the generally more substantial in-house data and analytical capabilities of large banks. Alongside the usual risks associated with outsourcing, the use of machine learning and data science can pose additional risks and challenges. For example, outsourced machine learning models may be more difficult to interpret because detailed knowledge in terms of how they were developed resides outside the bank. This can make it more difficult for banks to understand how the model works and to monitor performance, which could result in unexpected or unexplained performance and risks materializing. If multiple banks use the same third-party provider and machine learning model, this could also potentially lead to an increase in herding, concentration, and even the possibility of systemic risks where methodologies are common.
Keywords: Europe, UK, Banking, COVID-19, Machine Learning, Artificial Intelligence, Regtech, Big Data, Outsourcing Arrangements, Third-Party Arrangements, BoE
Leading economist; commercial real estate; performance forecasting, econometric infrastructure; data modeling; credit risk modeling; portfolio assessment; custom commercial real estate analysis; thought leader.
Previous ArticleBoE Sets Out Plan to Transform Data Collection from Financial Sector
The European Banking Authority (EBA) published four draft principles to support supervisory efforts in assessing the representativeness of COVID-19-impacted data for banks using the internal ratings based (IRB) credit risk models.
The European Council and the European Parliament (EP) reached a provisional political agreement on the Corporate Sustainability Reporting Directive (CSRD).
The Prudential Regulation Authority (PRA) launched a consultation (CP6/22) that sets out proposal for a new Supervisory Statement on expectations for management of model risk by banks.
The European Commission (EC) published the Delegated Regulation 2022/954, which amends regulatory technical standards on specification of the calculation of specific and general credit risk adjustments.
The Bank for International Settlements (BIS) Innovation Hub updated its work program, announcing a set of projects across various centers.
The European Insurance and Occupational Pensions Authority (EIOPA) published two consultation papers—one on the supervisory statement on exclusions related to systemic events and the other on the supervisory statement on the management of non-affirmative cyber exposures.
Certain members of the U.S. Senate Committee on Banking, Housing, and Urban Affairs issued a letter to the Securities and Exchange Commission (SEC)
The European Insurance and Occupational Pensions Authority (EIOPA) published a consultation paper on the advice on the review of the securitization prudential framework in Solvency II.
The Bank for International Settlements (BIS) published bulletins on lending in decentralized finance (DeFi) system, on blockchain scalability and fragmentation of crypto, and on extractable value and market manipulation in crypto and decentralized finance.
The Prudential Regulation Authority (PRA) issued a statement on PRA buffer adjustment while the Bank of England (BoE) published a notice on the statistical reporting requirements for banks.