BoE has set out results of a survey on the impact of COVID-19 events on the use of machine learning and data science. The survey, which was conducted among 17 UK banks and 9 foreign banks with UK operations, aimed to understand how these technologies are being used by the supervised and regulated firms, assess the potential policy implications of these findings, and support the safe and productive deployment of machine learning and data science across the financial sector. BoE states that it will continue to consider whether new policy initiatives may help firms to realize the benefits and more effectively manage the risks of artificial intelligence, machine learning, and data science. One of the survey findings is that COVID-19 events had a "positive" impact on outsourcing and the use of third-party providers by large banks.
In general, half of the surveyed banks reported an increase in the importance of machine learning and data science as a result of the pandemic, with none of the banks believing that COVID-19 crisis will reduce the importance of machine learning and data science for them. Nearly 40% of the survey respondents reported an increase in the importance of machine learning and data science for future operations and a further 10% of the banks reported a large increase. None of the banks reported a decrease in the importance of machine learning and data science. About a third of the banks said there was an increase in the number of ongoing machine learning and data science applications. Yet only 16% of the banks reported an increase in funding and/or resourcing for existing applications and a similar number reported a decrease. Similarly, nearly 35% of banks reported an increase in the number of planned applications but only 23% of the banks reported an increase in funding and/or resourcing for planned applications and 11.5% of banks reported a decrease. Meanwhile, about 35% of the banks reported a negative impact on machine learning model performance. This is likely because the pandemic has created major movements in macroeconomic variables, such as rising unemployment and mortgage forbearance, which required machine learning (as well as traditional) models to be recalibrated. The pandemic has created a major downturn that could not have been forecasted on the basis of economic data alone or historical predictors.
Additionally, notable differences exist between small and large UK banks with respect to their use of third-party vendor products and services. Smaller banks reported a "positive" impact (for example, in terms of performance, impact, use) of COVID-19 on all categories of data science and machine learning, with data collection, and model testing and validation being the areas with the largest "positive’ impact. Large UK banks reported a "positive" impact on use of outsourced platforms and infrastructure. These findings are in line with market intelligence that smaller banks are looking to increase their use of off-the-shelf machine learning products. This stands to reason, given the generally more substantial in-house data and analytical capabilities of large banks. Alongside the usual risks associated with outsourcing, the use of machine learning and data science can pose additional risks and challenges. For example, outsourced machine learning models may be more difficult to interpret because detailed knowledge in terms of how they were developed resides outside the bank. This can make it more difficult for banks to understand how the model works and to monitor performance, which could result in unexpected or unexplained performance and risks materializing. If multiple banks use the same third-party provider and machine learning model, this could also potentially lead to an increase in herding, concentration, and even the possibility of systemic risks where methodologies are common.
Keywords: Europe, UK, Banking, COVID-19, Machine Learning, Artificial Intelligence, Regtech, Big Data, Outsourcing Arrangements, Third-Party Arrangements, BoE
Leading economist; commercial real estate; performance forecasting, econometric infrastructure; data modeling; credit risk modeling; portfolio assessment; custom commercial real estate analysis; thought leader.
Previous ArticleBoE Sets Out Plan to Transform Data Collection from Financial Sector
The three European Supervisory Authorities (ESAs) issued a letter to inform about delay in the Sustainable Finance Disclosure Regulation (SFDR) mandate, along with a Call for Evidence on greenwashing practices.
The Financial Stability Board (FSB) and the Network for Greening the Financial System (NGFS) published a joint report that outlines the initial findings from climate scenario analyses undertaken by financial authorities to assess climate-related financial risks.
The Financial Stability Board (FSB) published a letter intended for the G20 leaders, highlighting the work that it will undertake under the Indian G20 Presidency in 2023 to strengthen resilience of the financial system.
The International Sustainability Standards Board (ISSB) of the IFRS Foundations made several announcements at COP27 and with respect to its work on the sustainability standards.
The International Organization for Securities Commissions (IOSCO), at COP27, outlined the regulatory priorities for sustainability disclosures, mitigation of greenwashing, and promotion of integrity in carbon markets.
The European Banking Authority (EBA) issued a statement in the context of COP27, clarified the operationalization of intermediate EU parent undertakings (IPUs) of third-country groups
The European Union has finalized and published, in the Official Journal of the European Union, a set of 13 Delegated and Implementing Regulations applicable to the European crowdfunding service providers.
The Office of the Superintendent of Financial Institutions (OSFI) published an annual report on its activities, a report on forward-looking work.
The Australian Prudential Regulation Authority (APRA) finalized amendments to the capital framework, announced a review of the prudential framework for groups.
The Bank for International Settlements (BIS) Innovation Hubs and several central banks are working together on various central bank digital currency (CBDC) pilots.