Featured Product

    BoE Paper Discusses AI and Software Validation Challenges

    November 01, 2021

    The Bank of England (BoE) published a paper on software validation and artificial intelligence in finance. The use of machine learning and artificial intelligence in finance poses growing risks for software validation to financial institutions, markets, and decision makers, making it a key priority for regulators. This paper discusses accepted software validation practices, highlights challenges to those practices introduced by artificial intelligence and potential solutions, and suggests areas of focus for developers when creating artificial intelligence-based solutions for the finance industry. The paper also discusses how practices may need to evolve to respond to these new challenges and is intended to inform policymakers and governance bodies, while also raising awareness among decision makers in financial institutions.

    The paper concludes that the following key points should be borne in mind by financial institutions when developing artificial intelligence/machine learning solutions to support the provision of financial services:

    • Machine learning software development is data-driven, making the technology hard to test conventionally, and the challenges are further exacerbated by end-to-end machine learning systems. Software validation may need to move from testing based on requirements to validation based on representative test datasets. These should include corner cases or tail event cases, representing scenarios not catered for by training datasets.
    • Machine learning “black box” nature can make it impossible to interpret how decisions are made. Explainability techniques may help attribute which factors are most important in a decision making process, but this may not enable identifying which part of a big machine learning model framework is responsible for any undesirable model behavior. Entanglement can also mean inputs are not independent with complex interdependencies between machine learning components. Decomposing machine learning models into smaller parts to generate decisions can add clarity although such opportunities may diminish as machine learning architectures become more end-to-end.
    • The characteristics of training datasets fundamentally influence machine learning model behavior, potentially replicating or amplifying dataset bias. Training datasets must be validated to ensure they are correct and representative, addressing outlier data elements and faulty labels. Datasets used for different purposes such as machine learning training, calibrating machine learning models or checking the accuracy of machine learning models should be free of common biases or flaws to ensure that they are fit for the specific use case that they are applied to. Emergent solutions exist to ensure that datasets are fit for purpose including: repeating data selection in a random way; formally documenting the composition, collection process, recommended uses, and inherent biases of datasets; development of methodologies to detect faulty or skewed datasets; and network graphs to visualize datasets and highlight data relationships graphically.
    • Using parallel processing to support machine learning models can result in unintended or inconsistent outputs disruption if the ordering of computational steps and processing takes place out of sequence because of poor overall modeling framework. It is important that the machine learning models, particularly when there are interdependencies among components and different sub-models, have robust controls over the ordering of computation steps.
    • Machine learning models are non-deterministic in nature. Some commentators have observed challenges associated with integrating non-deterministic machine learning models with software components that are deterministic/procedural in nature, when, for example, the output of an machine learning model changes qualitatively over time, due to re-calibration, impacting integrated software components.

    The paper also provides, for consideration of the policy makers and firms’ governance bodies, a checklist for artificial intelligence software validation. The paper, however, does not focus much on application-specific challenges, which can be considered as a next step where more opinions from subject-matter experts can be incorporated. Similarly, as a next step, one can try to work on more application-specific financial regulations highlighting any gap in existing regulations in a more explicit manner. Machine learning, and artificial intelligence in general, can also help to automate a lot of the existing testing processes and may improve the existing capacity to test software, improving resilience. Therefore, creating the right framework for artificial intelligence software testing could yield wide-reaching benefits, with the appropriate regulatory focus.

     

    Related Links

    Keywords: Europe, UK, Banking, Artificial Intelligence, Machine Learning, Regtech, Software Validation, Modeling Risk, Model Explainability, BoE

    Related Articles
    News

    EBA Publishes Final Regulatory Standards on STS Securitizations

    The European Banking Authority (EBA) published the final draft regulatory technical standards specifying and, where relevant, calibrating the minimum performance-related triggers for simple.

    September 20, 2022 WebPage Regulatory News
    News

    ECB Further Reviews Costs and Benefits Associated with IReF

    The European Central Bank (ECB) is undertaking the integrated reporting framework (IReF) project to integrate statistical requirements for banks into a standardized reporting framework that would be applicable across the euro area and adopted by authorities in other EU member states.

    September 15, 2022 WebPage Regulatory News
    News

    EBA Publishes Funding Plans Report, Receives EMAS Certification

    The European Banking Authority (EBA) has been awarded the top European Standard for its environmental performance under the European Eco-Management and Audit Scheme (EMAS).

    September 15, 2022 WebPage Regulatory News
    News

    MAS Launches SaaS Solution to Simplify Listed Entity ESG Disclosures

    The Monetary Authority of Singapore (MAS) set out the Financial Services Industry Transformation Map 2025 and, in collaboration with the SGX Group, launched ESGenome.

    September 15, 2022 WebPage Regulatory News
    News

    BCBS to Finalize Crypto Rules by End-2022; US to Propose Basel 3 Rules

    The Basel Committee on Banking Supervision met, shortly after a gathering of the Group of Central Bank Governors and Heads of Supervision (GHOS), the oversight body of BCBS.

    September 15, 2022 WebPage Regulatory News
    News

    IOSCO Welcomes Work on Sustainability-Related Corporate Reporting

    The International Organization of Securities Commissions (IOSCO) welcomed the work of the international audit and assurance standard setters—the International Auditing and Assurance Standards Board (IAASB)

    September 15, 2022 WebPage Regulatory News
    News

    BoE Allows One-Day Delay in Statistical Data Submissions by Banks

    The Bank of England (BoE) published a Statistical Notice (2022/18), which informs that due to the Bank Holiday granted for Her Majesty Queen Elizabeth II’s State Funeral on Monday September 19, 2022.

    September 14, 2022 WebPage Regulatory News
    News

    ACPR Amends Reporting Module Timelines Under EBA Framework 3.2

    The French Prudential Control and Resolution Authority (ACPR) announced that the European Banking Authority (EBA) has updated its filing rules and the implementation dates for certain modules of the EBA reporting framework 3.2.

    September 14, 2022 WebPage Regulatory News
    News

    ECB Paper Discusses Disclosure of Climate Risks by Credit Agencies

    The European Central Bank (ECB) published a paper that examines how credit rating agencies accepted by the Eurosystem, as part of the Eurosystem Credit Assessment Framework (ECAF)

    September 13, 2022 WebPage Regulatory News
    News

    APRA to Modernize Prudential Architecture, Reduces Liquidity Facility

    The Australian Prudential Regulation Authority (APRA) announced reduction in the aggregate Committed Liquidity Facility (CLF) for authorized deposit-taking entities to ~USD 33 billion on September 01, 2022.

    September 12, 2022 WebPage Regulatory News
    RESULTS 1 - 10 OF 8514