ACPR Seeks Views on Governance of Artificial Intelligence in Finance
ACPR published a discussion paper on the governance of artificial intelligence in finance. In this paper, ACPR has proposed four principles for evaluating artificial intelligence algorithms and tools—namely, data management, performance, stability, and explainability. ACPR also recommends the governance concerns that need to be taken into account, as early as the design phase of an algorithm. These concerns involve the integration of artificial intelligence into traditional business processes; the impact of this integration on internal controls; the relevance of outsourcing (partially or fully) the design or maintenance phases; and the internal and external audit functions. The comment period for this discussion paper ends on September 04, 2020.
The governance of artificial intelligence algorithms requires careful consideration of the validation of each decision-making process. The regulatory compliance and the performance objectives of these algorithms are only achievable through a certain level of explainability and traceability. In the discussion paper, ACPR recommends focus on the following aspects of governance concerns:
- Integration of artificial intelligence into business processes. This involves ascertaining whether the artificial intelligence component fulfills a critical function, by dint of its operational role or of the associated compliance risk and whether the engineering process follows a well-defined methodology throughout the machine learning lifecycle (from algorithmic design to monitoring in production), in the sense of reproducibility, quality assurance, architectural design, auditability, and automation.
- Human-algorithm interactions. Those can require a particular kind of explainability, intended either for internal operators who need to confirm or reject an algorithm’s output, or for customers who are entitled to understand the decisions impacting them or the commercial offers made to them. Besides, processes involving artificial intelligence often leave room for human intervention, which is beneficial or even necessary, but also bears new risks. Such new risks include the introduction of biases into the explanation of an 4 algorithm’s output, or a stronger feeling of engaging one’s responsibility when contradicting the algorithm than when confirming its decisions.
- Security and outsourcing. Machine learning models are exposed to new kinds of attacks. Furthermore, strategies such as development outsourcing, skills outsourcing, and external hosting should undergo careful risk assessment. More generally, third-party risks should be evaluated.
- Initial and continuous validation process. This process must often be re-examined when designing an artificial intelligence algorithm intended for augmenting or altering an existing process. For instance, the governance framework applicable to a business line may in some cases be maintained, while, in other cases, it will have to be updated before putting the artificial intelligence component into production. Continuous validation process. The continuous monitoring of machine learning algorithm, for instance, requires technical expertise and machine-learning-specific tools to ensure the aforementioned principles are followed over time (appropriate data management, predictive accuracy, stability, and availability of valid explanations).
- Audit. For internal and external audits of artificial-intelligence-based systems in finance, exploratory work led by the ACPR suggests adopting a dual approach. The first facet combines analysis of the source code and data with methods for documenting artificial intelligence algorithms, predictive, models and datasets. The second facet leverages methods providing explanation for an individual decision or for the overall behavior of the algorithm; it also relies on two techniques for testing an algorithm as a black box: challenger models (to compare against the model under test) and benchmarking datasets, both curated by the auditor.
Related Links
Comment Due Date: September 04, 2020
Keywords: Europe, France, Banking, Insurance, Governance, Artificial Intelligence, Fintech, Machine Learning, Regtech, Outsourcing Arrangements, ACPR
Previous Article
ACPR Publishes Version 2.1.0 of the CREDITHAB TaxonomyRelated Articles
FINMA Approves Merger of Credit Suisse and UBS
The Swiss Financial Market Supervisory Authority (FINMA) has approved the takeover of Credit Suisse by UBS.
BOE Sets Out Its Thinking on Regulatory Capital and Climate Risks
The Bank of England (BOE) published a working paper that aims to understand the climate-related disclosures of UK financial institutions.
OSFI Finalizes on Climate Risk Guideline, Issues Other Updates
The Office of the Superintendent of Financial Institutions (OSFI) is seeking comments, until May 31, 2023, on the draft guideline on culture and behavior risk, with final guideline expected by the end of 2023.
APRA Assesses Macro-Prudential Policy Settings, Issues Other Updates
The Australian Prudential Regulation Authority (APRA) published an information paper that assesses its macro-prudential policy settings aimed at promoting stability at a systemic level.
BIS Paper Examines Impact of Greenhouse Gas Emissions on Lending
BIS issued a paper that investigates the effect of the greenhouse gas, or GHG, emissions of firms on bank loans using bank–firm matched data of Japanese listed firms from 2006 to 2018.
HMT Mulls Alignment of Ring-Fencing and Resolution Regimes for Banks
The HM Treasury (HMT) is seeking evidence, until May 07, 2023, on practicalities of aligning the ring-fencing and the banking resolution regimes for banks.
MFSA Sets Out Supervisory Priorities, Issues Reporting Updates
The Malta Financial Services Authority (MFSA) outlined its supervisory priorities for 2023
German Regulators Issue Multiple Reporting Updates for Banks
Deutsche Bundesbank published the nationally deactivated validation rules for the German Commercial Code (HGB) users on the taxonomy 3.2, which became valid from December 31, 2022
BCBS Report Examines Impact of Basel III Framework for Banks
The Basel Committee on Banking Supervision (BCBS) published results of the Basel III monitoring exercise based on the June 30, 2022 data.
PRA Consults on Prudential Rules for "Simpler-Regime" Firms
Among the recent regulatory updates from UK authorities, a key development is the first-phase consultation, from the Prudential Regulation Authority (PRA), on simplifications to the prudential framework that would apply to the simpler-regime firms.