Algorithmic Opacity, Proxy Discrimination and Financial Citizenship in AI-Driven Credit Markets
DOI:
https://doi.org/10.58766/rpgbcb.v20i1.1277Keywords:
artificial intelligence; credit scoring; algorithmic opacity; proxy discrimination; financial citizenship; explainable AI; financial regulation; consumer protection.Abstract
Abstract: This article investigates the intersection of artificial intelligence, consumer credit, and financial governance, arguing that algorithmic opacity in AI-driven credit scoring does not eliminate discrimination but transforms it into an epistemic and governance crisis. Drawing on doctrinal legal analysis, comparative regulatory examination of Brazil, the European Union, and the United States, and an analytical reconstruction of the Apple Card case, the study demonstrates that historical biases are statistically reconstructed through proxy variables while the inherent opacity of machine learning models conceals these processes under a veneer of data-driven objectivity. The result is a structural deficit in evidence, contestability, and supervisory capacity that undermines the core pillars of financial citizenship: protection, participation, and trust. The original contribution lies in reconceptualizing algorithmic credit discrimination as a problem produced by opacity rather than solely by intentional disparate treatment, revealing that the absence of evidence of bias cannot be equated with evidence of fairness when the system under scrutiny is designed in ways that resist independent verification.
Downloads
References
AGGARWAL, Nikita. The norms of algorithmic credit scoring. The Cambridge Law Journal, Cambridge, v. 80, n. 1, p. 42-73, 2021. Disponível em: https://www.cambridge.org/core/journals/cambridge-lawjournal/article/norms-of-algorithmic-credit-scoring/23C9802EEA5EC6F6872512CB7AABC793. Acesso em: 14 mar. 2026.
ARIZA-GARZÓN, Miller Janny; ARROYO, Javier; CAPARRINI, Antonio; SEGOVIA-VARGAS, María Jesús. Explainability of a machine learning granting scoring model in peer-to-peer lending. IEEE Access, Piscataway, v. 8, p. 64873-64890, 2020. DOI: 10.1109/ACCESS.2020.2984412. Disponível em: https://doi.org/10.1109/ACCESS.2020.2984412. Acesso em: 20 abr. 2026.
AVERY, Robert B.; BREVOORT, Kenneth P.; CANNER, Glenn B. Does credit scoring produce a disparate impact? Washington, D.C.: Federal Reserve Board, 2010. (Finance and Economics Discussion Series, 2010-58). Disponível em: https://www.federalreserve.gov/pubs/feds/2010/201058/201058pap.pdf. Acesso em: 22 jan. 2025.
BANCO CENTRAL DO BRASIL. Credit fintechs regulation – CMN Resolution No. 4,656/2020. Brasília: Banco Central do Brasil, 2020. Disponível em: https://www.bcb.gov.br/content/config/Documents/Credit_Fintechs_Regulation_CMN_Resolution_4656_2020.pdf. Acesso em: 20 abr. 2026.
BANCO CENTRAL DO BRASIL. Open Finance. Brasília: Banco Central do Brasil, [s. d.]. Disponível em: https://www.bcb.gov.br/en/financialstability/open_finance. Acesso em: 20 abr. 2026.
BANCO CENTRAL DO BRASIL. Relatório de Cidadania Financeira 2021. Brasília: Banco Central do Brasil, 2021. Disponível em: https://www.bcb.gov.br/content/cidadaniafinanceira/documentos_cidadania/RIF/Relatorio_de_Cidadania_Financeira_2021.pdf. Acesso em: 20 abr. 2026.
BANK FOR INTERNATIONAL SETTLEMENTS. Regulating AI in the financial sector: recent developments and main challenges. Basel: BIS, 2024. (FSI Insights, n. 63). Disponível em: https://www.bis.org/fsi/publ/insights63.pdf. Acesso em: 20 abr. 2026.
BAROCAS, Solon; SELBST, Andrew D. Big data’s disparate impact. California Law Review, Berkeley, v. 104, n. 3, p. 671-732, 2016. Disponível em: https://www.cs.yale.edu/homes/jf/BarocasSelbst.pdf. Acesso em: 3 fev. 2026.
BERG, Tobias; BURG, Valentin; GOMBOVIĆ, Ana; PURI, Manju. On the rise of FinTechs: credit scoring using digital footprints. The Review of Financial Studies, Oxford, v. 33, n. 7, p. 2845-2897, 2020. Disponível em: https://academic.oup.com/rfs/article/33/7/2845/5568311. Acesso em: 19 jul. 2025.
DAS, Sanjiv; STANTON, Richard; WALLACE, Nancy. Algorithmic fairness. Annual Review of Financial Economics, Palo Alto, v. 14, p. 1-32, 2022. Disponível em: https://faculty.haas.berkeley.edu/stanton/pdf/ARfairness.pdf. Acesso em: 11 nov. 2025.
FGV RIO LAW. Implementation and challenges of Open Finance in Brazil. Rio de Janeiro: Fundação Getulio Vargas, [s. d.]. Disponível em: https://direitorio.fgv.br/sites/default/files/arquivos/direito_rio_livro_neasf_18_eng_ap5.pdf. Acesso em: 20 abr. 2026.
FUSTER, Andreas; GOLDSMITH-PINKHAM, Paul; RAMADORAI, Tarun; WALTHER, Ansgar. Predictably unequal? The effects of machine learning on credit markets. The Journal of Finance, Hoboken, v. 77, n. 1, p. 5-47, 2022. Disponível em: https://www.researchgate.net/publication/355710743_Predictably_Unequal_The_Effects_of_Machine_Learning_on_Credit_Markets. Acesso em: 27 ago. 2025.
GRAMEGNA, Alex; GIUDICI, Paolo. SHAP and LIME: an evaluation of discriminative power in credit risk. Frontiers in Artificial Intelligence, Lausanne, v. 4, art. 752558, 2021. Disponível em: https://www.frontiersin.org/articles/10.3389/frai.2021.752558/full. Acesso em: 9 jan. 2026.
HURLIN, Christophe; PÉRIGNON, Christophe; SAURIN, Sébastien. The fairness of credit scoring models. Management Science, Hanover, v. 72, n. 1, p. 406-425, 2026. Disponível em: https://pubsonline.informs.org/doi/10.1287/mnsc.2022.03888. Acesso em: 2 mar. 2026.
INTERNATIONAL MONETARY FUND. Explaining strong credit growth in Brazil despite high policy rates. Washington, D.C., 2025. Disponível em: https://www.imf.org/en/news/articles/2025/10/09/explainingstrong-credit-growth-in-brazil-despite-high-policy-rates. Acesso em: 14 ago. 2026.
KALUS. AI systems and a risk of discrimination in creditworthiness assessments: the role of the EU Artificial Intelligence Act in safeguarding the right to non-discrimination. Stanford: Stanford Law School, 2025. (EU Law Working Paper, n. 112). Disponível em: https://law.stanford.edu/wp-content/uploads/2025/05/EU-Law-WP-112-Kalus.pdf. Acesso em: 20 abr. 2026.
MCKINSEY & COMPANY. Brazil’s financial evolution: unveiling the Brazil Stack. São Paulo: McKinsey & Company, [s. d.]. Disponível em: https://www.mckinsey.com/br/~/media/mckinsey/locations/south%20america/brazil/our%20insights/brazil%20stack/brazil%20stack%20report_al_vf.pdf. Acesso em: 20 abr. 2026.
NEW YORK STATE DEPARTMENT OF FINANCIAL SERVICES. Report on Apple Card Investigation. New York: NYDFS, 2021. Disponível em: https://www.dfs.ny.gov/system/files/documents/2021/03/rpt_202103_apple_card_investigation.pdf. Acesso em: 20 abr. 2026.
OFFICE OF THE COMPTROLLER OF THE CURRENCY. Model risk management: revised guidance (Bulletin 2026-13). Washington, D.C.: OCC, 2026. Disponível em: https://occ.gov/news-issuances/bulletins/2026/bulletin-2026-13.html. Acesso em: 20 abr. 2026.
ORNELAS, José Renato Haas; OLIVEIRA, Raquel de Freitas; SCHECHTMAN, Ricardo. Private credit bureaus and positive information sharing: effects on credit cost?Brasília: Banco Central do Brasil, 2025. (Working Paper Series, n. 624). Disponível em: https://www.bcb.gov.br/content/publicacoes/WorkingPaperSeries/WP624v3.pdf. Acesso em: 21 fev. 2026.
PRINCE, Anya E. R.; SCHWARCZ, Daniel. Proxy discrimination in the age of artificial intelligence and big data. Iowa Law Review, Iowa City, v. 105, n. 3, p. 1257-1318, 2020. Disponível em: https://ilr.law.uiowa.edu/print/volume-105-issue-3/proxy-discrimination-in-the-age-of-artificial-intelligence-and-big-data. Acesso em: 30 abr. 2025.
RUDIN, Cynthia. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, London, v. 1, p. 206-215, 2019. Disponível em: https://www.nature.com/articles/s42256-019-0048-x. Acesso em: 7 dez. 2025.
U.S. GOVERNMENT ACCOUNTABILITY OFFICE. Artificial intelligence: use and oversight in financial services. Washington, D.C.: GAO, 2025. (GAO-25-107197). Disponível em: https://www.gao.gov/assets/gao-25-107197.pdf. Acesso em: 20 abr. 2026.
WORLD BANK. AI for risk-based supervision. Washington, D.C.: World Bank, 2025. Disponível em: https://documents1.worldbank.org/curated/en/099021725190042788/pdf/P503970-2c607262-8673-4797-b5a6-52df7187e543.pdf. Acesso em: 20 abr. 2026.
WORLD BANK. Brazil financial sector assessment. Washington, D.C.: World Bank, 2024. Disponível em: https://documents1.worldbank.org/curated/en/099072425135514500/pdf/P181316-72eed651-b7c2-4137-a1f0-a00c3e1efede.pdf. Acesso em: 20 abr. 2026.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 CC BY-NC-SA 4.0

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This work is licensed under a license Deed - Attribution-NonCommercial-ShareAlike 4.0 International - Creative Commons