Algorithmic Opacity, Proxy Discrimination and Financial Citizenship in AI-Driven Credit Markets
DOI:
https://doi.org/10.58766/rpgbcb.v20i1.1277Palavras-chave:
artificial intelligence, credit scoring, algorithmic opacity, proxy discrimination, financial citizenshipResumo
This article investigates the intersection of artificial intelligence, consumer credit, and financial governance, arguing that algorithmic opacity in AI-driven credit scoring does not eliminate discrimination but transforms it into an epistemic and governance crisis. Methodologically, the research adopts a qualitative, bibliographic-documentary approach grounded in doctrinal legal analysis and comparative law. Data were gathered from legislation, sectoral regulation, peer-reviewed scholarship, and institutional reports produced by the Banco Central do Brasil (BCB), the Bank for International Settlements, the World Bank, and the U.S. Government Accountability Office. The Apple Card controversy is examined as an instrumental case study based on the official report of the New York State Department of Financial Services (2021). The comparative analysis encompasses the regulatory frameworks of Brazil, the European Union, and the United States, allowing for the identification of structural convergences and divergences in institutional responses to algorithmic opacity. The study demonstrates that historical biases are statistically reconstructed through proxy variables while the inherent opacity of machine learning models conceals these processes under a veneer of data-driven objectivity. The result is a structural deficit in evidence, contestability, and supervisory capacity that undermines the core pillars of financial citizenship: protection, participation, and trust. The original contribution lies in reconceptualizing algorithmic credit discrimination as a problem produced by opacity rather than solely by intentional disparate treatment, revealing that the absence of evidence of bias cannot be equated with evidence of fairness when the system under scrutiny is designed in ways that resist independent verification
Downloads
Referências
AGGARWAL, Nikita. The norms of algorithmic credit scoring. The Cambridge Law Journal, Cambridge, v. 80, n. 1, p. 42-73, 2021. Disponível em: https://www.cambridge.org/core/journals/cambridge-lawjournal/article/norms-of-algorithmic-credit-scoring/23C9802EEA5EC6F6872512CB7AABC793. Acesso em: 14 mar. 2026.
ARIZA-GARZÓN, Miller Janny; ARROYO, Javier; CAPARRINI, Antonio; SEGOVIA-VARGAS, María Jesús. Explainability of a machine learning granting scoring model in peer-to-peer lending. IEEE Access, Piscataway, v. 8, p. 64873-64890, 2020. DOI: 10.1109/ACCESS.2020.2984412. Disponível em: https://doi.org/10.1109/ACCESS.2020.2984412. Acesso em: 20 abr. 2026.
AVERY, Robert B.; BREVOORT, Kenneth P.; CANNER, Glenn B. Does credit scoring produce a disparate impact? Washington, D.C.: Federal Reserve Board, 2010. (Finance and Economics Discussion Series, 2010-58). Disponível em: https://www.federalreserve.gov/pubs/feds/2010/201058/201058pap.pdf. Acesso em: 22 jan. 2025.
BANCO CENTRAL DO BRASIL. Credit fintechs regulation – CMN Resolution No. 4,656/2020. Brasília: Banco Central do Brasil, 2020. Disponível em: https://www.bcb.gov.br/content/config/Documents/Credit_Fintechs_Regulation_CMN_Resolution_4656_2020.pdf. Acesso em: 20 abr. 2026.
BANCO CENTRAL DO BRASIL. Open Finance. Brasília: Banco Central do Brasil, [s. d.]. Disponível em: https://www.bcb.gov.br/en/financialstability/open_finance. Acesso em: 20 abr. 2026.
BANCO CENTRAL DO BRASIL. Relatório de Cidadania Financeira 2021. Brasília: Banco Central do Brasil, 2021. Disponível em: https://www.bcb.gov.br/content/cidadaniafinanceira/documentos_cidadania/RIF/Relatorio_de_Cidadania_Financeira_2021.pdf. Acesso em: 20 abr. 2026.
BANK FOR INTERNATIONAL SETTLEMENTS. Regulating AI in the financial sector: recent developments and main challenges. Basel: BIS, 2024. (FSI Insights, n. 63). Disponível em: https://www.bis.org/fsi/publ/insights63.pdf. Acesso em: 20 abr. 2026.
BAROCAS, Solon; SELBST, Andrew D. Big data’s disparate impact. California Law Review, Berkeley, v. 104, n. 3, p. 671-732, 2016. Disponível em: https://www.cs.yale.edu/homes/jf/BarocasSelbst.pdf. Acesso em: 3 fev. 2026.
BERG, Tobias; BURG, Valentin; GOMBOVIĆ, Ana; PURI, Manju. On the rise of FinTechs: credit scoring using digital footprints. The Review of Financial Studies, Oxford, v. 33, n. 7, p. 2845-2897, 2020. Disponível em: https://academic.oup.com/rfs/article/33/7/2845/5568311. Acesso em: 19 jul. 2025.
DAS, Sanjiv; STANTON, Richard; WALLACE, Nancy. Algorithmic fairness. Annual Review of Financial Economics, Palo Alto, v. 14, p. 1-32, 2022. Disponível em: https://faculty.haas.berkeley.edu/stanton/pdf/ARfairness.pdf. Acesso em: 11 nov. 2025.
FGV RIO LAW. Implementation and challenges of Open Finance in Brazil. Rio de Janeiro: Fundação Getulio Vargas, [s. d.]. Disponível em: https://direitorio.fgv.br/sites/default/files/arquivos/direito_rio_livro_neasf_18_eng_ap5.pdf. Acesso em: 20 abr. 2026.
FUSTER, Andreas; GOLDSMITH-PINKHAM, Paul; RAMADORAI, Tarun; WALTHER, Ansgar. Predictably unequal? The effects of machine learning on credit markets. The Journal of Finance, Hoboken, v. 77, n. 1, p. 5-47, 2022. Disponível em: https://www.researchgate.net/publication/355710743_Predictably_Unequal_The_Effects_of_Machine_Learning_on_Credit_Markets. Acesso em: 27 ago. 2025.
GRAMEGNA, Alex; GIUDICI, Paolo. SHAP and LIME: an evaluation of discriminative power in credit risk. Frontiers in Artificial Intelligence, Lausanne, v. 4, art. 752558, 2021. Disponível em: https://www.frontiersin.org/articles/10.3389/frai.2021.752558/full. Acesso em: 9 jan. 2026.
HURLIN, Christophe; PÉRIGNON, Christophe; SAURIN, Sébastien. The fairness of credit scoring models. Management Science, Hanover, v. 72, n. 1, p. 406-425, 2026. Disponível em: https://pubsonline.informs.org/doi/10.1287/mnsc.2022.03888. Acesso em: 2 mar. 2026.
INTERNATIONAL MONETARY FUND. Explaining strong credit growth in Brazil despite high policy rates. Washington, D.C., 2025. Disponível em: https://www.imf.org/en/news/articles/2025/10/09/explainingstrong-credit-growth-in-brazil-despite-high-policy-rates. Acesso em: 14 ago. 2026.
KALUS. AI systems and a risk of discrimination in creditworthiness assessments: the role of the EU Artificial Intelligence Act in safeguarding the right to non-discrimination. Stanford: Stanford Law School, 2025. (EU Law Working Paper, n. 112). Disponível em: https://law.stanford.edu/wp-content/uploads/2025/05/EU-Law-WP-112-Kalus.pdf. Acesso em: 20 abr. 2026.
MCKINSEY & COMPANY. Brazil’s financial evolution: unveiling the Brazil Stack. São Paulo: McKinsey & Company, [s. d.]. Disponível em: https://www.mckinsey.com/br/~/media/mckinsey/locations/south%20america/brazil/our%20insights/brazil%20stack/brazil%20stack%20report_al_vf.pdf. Acesso em: 20 abr. 2026.
NEW YORK STATE DEPARTMENT OF FINANCIAL SERVICES. Report on Apple Card Investigation. New York: NYDFS, 2021. Disponível em: https://www.dfs.ny.gov/system/files/documents/2021/03/rpt_202103_apple_card_investigation.pdf. Acesso em: 20 abr. 2026.
OFFICE OF THE COMPTROLLER OF THE CURRENCY. Model risk management: revised guidance (Bulletin 2026-13). Washington, D.C.: OCC, 2026. Disponível em: https://occ.gov/news-issuances/bulletins/2026/bulletin-2026-13.html. Acesso em: 20 abr. 2026.
ORNELAS, José Renato Haas; OLIVEIRA, Raquel de Freitas; SCHECHTMAN, Ricardo. Private credit bureaus and positive information sharing: effects on credit cost?Brasília: Banco Central do Brasil, 2025. (Working Paper Series, n. 624). Disponível em: https://www.bcb.gov.br/content/publicacoes/WorkingPaperSeries/WP624v3.pdf. Acesso em: 21 fev. 2026.
PRINCE, Anya E. R.; SCHWARCZ, Daniel. Proxy discrimination in the age of artificial intelligence and big data. Iowa Law Review, Iowa City, v. 105, n. 3, p. 1257-1318, 2020. Disponível em: https://ilr.law.uiowa.edu/print/volume-105-issue-3/proxy-discrimination-in-the-age-of-artificial-intelligence-and-big-data. Acesso em: 30 abr. 2025.
RUDIN, Cynthia. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, London, v. 1, p. 206-215, 2019. Disponível em: https://www.nature.com/articles/s42256-019-0048-x. Acesso em: 7 dez. 2025.
U.S. GOVERNMENT ACCOUNTABILITY OFFICE. Artificial intelligence: use and oversight in financial services. Washington, D.C.: GAO, 2025. (GAO-25-107197). Disponível em: https://www.gao.gov/assets/gao-25-107197.pdf. Acesso em: 20 abr. 2026.
WORLD BANK. AI for risk-based supervision. Washington, D.C.: World Bank, 2025. Disponível em: https://documents1.worldbank.org/curated/en/099021725190042788/pdf/P503970-2c607262-8673-4797-b5a6-52df7187e543.pdf. Acesso em: 20 abr. 2026.
WORLD BANK. Brazil financial sector assessment. Washington, D.C.: World Bank, 2024. Disponível em: https://documents1.worldbank.org/curated/en/099072425135514500/pdf/P181316-72eed651-b7c2-4137-a1f0-a00c3e1efede.pdf. Acesso em: 20 abr. 2026.
Downloads
Publicado
Como Citar
Edição
Seção
Licença
Copyright (c) 2026 CC BY-NC-SA 4.0

Este trabalho está licenciado sob uma licença Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.