The integration of machine learning (ML) systems into high-stakes decision-making processes encompassing credit allocation, employment screening, judicial risk assessment, and healthcare triage has accelerated at a pace that substantially outstrips the development of governance frameworks designed to ensure their equitable operation.(1) A foundational challenge within this landscape is the cross-regional generalization problem: algorithms trained on data drawn predominantly from high-income, data-rich regions frequently underperform and exhibit elevated error disparities when deployed in structurally distinct geographic contexts, including Sub-Saharan Africa, South Asia, and Latin America.(2)

This structural asymmetry is neither incidental nor correctable through incremental performance optimization. It reflects deep epistemic hierarchies embedded in the global AI development pipeline, specifically the systematic underrepresentation of low-income and Global South populations in benchmark datasets, the disproportionate concentration of algorithmic development capacity in Western institutions, and the inadequacy of evaluation frameworks that report aggregate performance without regional disaggregation.(3,4) When a credit-scoring model trained on North American financial histories is deployed to evaluate loan applicants in West Africa, the resulting errors are not randomly distributed; they compound existing socioeconomic disadvantage with algorithmic disadvantage, producing what Mehrabi et al.(12) term “historical bias”: the systematic perpetuation of structural inequality through computational means.

The formal literature on algorithmic fairness has developed a rich taxonomy of metrics designed to diagnose and quantify such disparities.(1) Demographic Parity requires equal positive prediction rates across groups; Equalized Odds demands simultaneous parity in True Positive Rate and False Positive Rate; and Calibration requires that predicted probabilities match observed outcome frequencies within each subgroup.(2,5) However, as ( 13 ) formally demonstrated, these criteria are mathematically incompatible when group base rates differ, a condition structurally guaranteed in cross-regional datasets reflecting global inequality. The practical implication is that no single fairness criterion can be universally satisfied across all regions simultaneously; the choice of criterion is therefore normative, political, and distributionally consequential. Because access to large-scale, ethically shareable, cross-regional administrative datasets remains highly restricted due to privacy, governance, and institutional barriers, synthetic data provides a controlled and reproducible mechanism for modelling structurally grounded regional disparities while avoiding legal and ethical constraints associated with sensitive real-world records.

Despite the maturity of theoretical fairness research, empirical studies evaluating end-to-end bias detection and mitigation pipelines simultaneously across multiple world regions remain limited.(6,7) Most existing studies evaluate fairness interventions on one or two protected attributes, typically race or gender, within a single national context, most commonly the United States.(8) Such experimental designs underestimate the complexity of real-world deployment environments in which regional heterogeneity, unequal base rates, and structural socioeconomic asymmetries interact simultaneously across multiple dimensions.

The present study directly addresses this gap. We design, train, and evaluate a three-model bias detection and mitigation pipeline implementing pre-processing and post-processing debiasing strategies on a synthetic cross-regional dataset (N = 6 000) parameterised using empirically grounded socioeconomic distributional statistics across six world regions.( 9) Three model variants are evaluated: a Baseline Logistic Regression (LR), a Fairness-Aware Reweighted LR, and a Calibrated Gradient Boosting Machine (GBM). Four fairness metrics are assessed simultaneously across all regions: AUC-ROC, Equalized Odds, Demographic Parity Gap (DPG), and F1 Score.

Contributions of the Study

This study makes four principal contributions to the algorithmic fairness literature:

It demonstrates that pre-processing reweighting strategies produce negligible improvement in cross-regional fairness when structural disparities are embedded within the feature space rather than arising solely from class imbalance.

It identifies persistent threshold collapse across all models and regions, meaning the classifiers label nearly all observations as positive despite high aggregate recall, thereby exposing limitations concealed by conventional performance metrics.

It provides empirical evidence that demographic parity disparities in structurally disadvantaged regions, particularly Sub-Saharan Africa, remain resistant to post-hoc mitigation strategies.

It reveals that the performance costs of fairness intervention are geographically asymmetric, disproportionately affecting already disadvantaged regions while high-resource regions remain comparatively unaffected.

These findings contribute directly to ongoing debates concerning the operationalisation of responsible AI principles in cross-regional deployment settings, the adequacy of existing fairness metrics under unequal regional base rates, and the governance implications of deploying ML systems in Global South contexts without region-specific auditing frameworks.( 9,10,11 ) The remainder of this paper presents the Methods, Results, Discussion, and Conclusions sections.

Research Design and Dataset Construction

This study adopts a data-centric experimental design in which bias detection and mitigation interventions are systematically evaluated across six geopolitically and socioeconomically distinct world regions: Sub-Saharan Africa, South Asia, East Asia, Western Europe, North America, and Latin America. A synthetic cross-regional dataset (N = 6,000) was constructed to reflect documented distributional asymmetries in key socioeconomic indicators, drawing on published parameters from the World Bank Development Indicators (2023), the International Labour Organization Labour Statistics Database (2023), and the Global Financial Inclusion Database (Findex, 2022).

Five input features were operationalised: age (continuous, 18–70 years); income (log-normally distributed); education (ordinal, 0–3); credit history (binary); and employment status (categorical, 0–2). Regional feature distributions were independently parameterised to reflect empirically grounded inequalities in access to financial services, formal employment, and tertiary education. A binary outcome variable encoding a generic favourable algorithmic decision, analogous to loan approval or employment screening was generated via a logistic function incorporating region-specific structural noise parameters ( μ ∈ { − 0.15 , − 0.08 , + 0.05 , + 0.12 , + 0.14 , − 0.03 } ) (\mu \in \ \{ - 0.15,\ - 0.08,\ + 0.05,\ + 0.12,\ + 0.14,\ - 0.03\}) , ensuring that outcome distributions embed historically grounded disparities characteristic of real-world cross-regional administrative data (Sambasivan et al., 2021; Paullada et al., 2021).

Justification for Dataset Size (N = 6 000)

The synthetic dataset size of N = 6 000 was selected to ensure balanced regional representation while maintaining sufficient statistical stability for cross-regional fairness evaluation. Each of the six study regions contributed approximately 1 000 observations, allowing reliable estimation of region-specific fairness metrics, including AUC-ROC, Equalized Odds, Demographic Parity Gap, and F1 Score. Prior fairness studies have demonstrated that subgroup fairness metrics become unstable under small subgroup sample sizes due to variance inflation and threshold sensitivity, particularly in unequal base-rate settings. The selected sample size therefore provided adequate representation for each regional subgroup while preserving computational efficiency for repeated cross-validation, calibration procedures, and comparative model evaluation. Furthermore, the dataset size aligns with established synthetic fairness benchmarking practices in algorithmic bias research, where controlled medium-scale datasets are commonly used to isolate structural disparities without introducing unnecessary stochastic instability.

The dataset was partitioned into training (75%, n = 4,500) and held-out test (25%, n = 1,500) sets using stratified random splitting to preserve outcome-class proportions. All continuous features were standardised to zero mean and unit variance prior to model training. Regional identity was encoded as an ordinal integer and included as a model input to enable region-conditional learning, consistent with real-world deployment contexts in which geographic metadata is routinely available to decision systems.

Bias Mitigation Pipeline Architecture

Three model variants were trained and evaluated within a unified five-stage pipeline, each representing a distinct position within the canonical pre-processing → in-processing → post-processing debiasing taxonomy (Caton   &   Haas, 2020). The full architectural flow is illustrated in Figure 1.

Model 1: Baseline Logistic Regression (LR). A standard L2-regularised logistic regression (max_iter = 1,000) trained without fairness constraint. This model serves as the counterfactual baseline, representing deployment in the absence of any algorithmic fairness intervention.

Model 2: Fairness-Aware Reweighted LR. Sample weights inversely proportional to regional frequency were applied during training, implementing a pre-processing debiasing strategy (Kamiran &  Calders , 2012). Weights were computed as wᵢ = N / nr, where N denotes total training sample size and nr denotes the count of observations from region r.

Model 3: Calibrated Gradient Boosting Machine (GBM). A Gradient Boosting Classifier (150 estimators; max depth = 4; learning rate = 0.08) was trained with 5-fold stratified cross-validation, followed by isotonic regression calibration applied post-hoc to out-of-fold probability outputs (Zadrozny & Elkan, 2002; Platt, 1999). This model implements a post-processing debiasing strategy in which predicted probabilities are recalibrated to reduce miscalibration-induced disparities across threshold-sensitive decision systems.

Evaluation Framework

Model performance was evaluated simultaneously across four fairness-relevant metrics, each encoding a distinct normative commitment to the fairness problem ( 14,15 ). All metrics were computed independently per region on the held-out test set prior to aggregation.

(i) AUC-ROC measures discrimination ability independent of decision threshold. Cross-regional AUC-ROC disparities constitute the primary indicator of differential predictive capacity across geographic groups.

(ii) Equalized Odds ( 16 ) jointly evaluates True Positive Rate (TPR) and False Positive Rate (FPR) parity. A model satisfying equalized odds must produce equal TPR and FPR simultaneously across all regional groups. Violations in either component constitute group-differential error with direct harm-allocation consequences.

(iii) Demographic Parity Gap (DPG) is defined as D P G r = m a x i ( P i ̂ ) − P r ̂ DPGr = maxi\left( \widehat{P_{i}} \right) - \widehat{P_{r}} where P ̂ \hat{P} denotes the regional positive prediction rate. D P G = 0 DPG\ = \ 0 indicates full parity; higher values indicate systematic under-selection relative to the most-favoured region.

(iv) F1 Score is reported as the harmonic mean of precision and recall. Per-region F1 trajectories across the three model conditions quantify the performance cost if any attributable to each debiasing intervention relative to the unmitigated baseline.

This multi-metric framework is motivated by ( 13 ) formal proof that demographic parity, equalized odds, and calibration cannot be simultaneously satisfied when group base rates differ. Reporting a single fairness criterion risks inferring compliance while violating the others a form of measurement artefact with serious policy implications in regulated deployment contexts.

Methodological Limitations

Three limitations bound the generalisability of these findings. First, the synthetic dataset, while parameterised from empirical distributional statistics, cannot replicate the intersectional complexity of real administrative records including correlated effects of gender, ethnicity, and disability documented in real cross-regional deployments.(17,18) Second, the three model variants tested represent a subset of the fairness-aware ML landscape; adversarial debiasing,(19) fair representation learning,(20) and constrained Pareto-optimal optimisation.(21) remain to be evaluated within this pipeline architecture. Third, the binary outcome formulation does not extend to the multi-class and regression settings prevalent in healthcare triage, judicial risk assessment, and credit-scoring applications. These constraints circumscribe the scope of the present claims and define the agenda for subsequent empirical work.

This section reports empirical findings from the evaluation of three model conditions Baseline Logistic Regression (LR), Fairness-Aware Reweighted LR, and Calibrated Gradient Boosting Machine (GBM) on a held-out stratified test set (n = 1,500; 25% of total corpus). Evaluation addresses four axes in sequence: aggregate performance (Section 4.1), cross-regional AUC-ROC (Section 4.2), equalized odds decomposition (Section 4.3), Demographic Parity Gap (Section 4.4), and the joint performance–fairness trajectory per region (Section 4.5).

Aggregate Model Performance

As reported in Table 1, the three models are broadly comparable in aggregate. The Baseline LR achieves the highest accuracy (0.884), F1 (0.938), and AUC-ROC (0.758). The Reweighted LR is virtually indistinguishable across all metrics, with absolute differences below 0.001 on every measure. The Calibrated GBM records the most notable aggregate change: AUC-ROC falls to 0.724 (Δ = −0.034), accuracy to 0.881 (Δ = −0.003), and F1 to 0.936 (Δ = −0.002), while recall remains high at 0.997. These aggregate figures are presented here as a reference baseline; their critical limitation is that they suppress the regional heterogeneity that constitutes the central object of analysis in the sections that follow.

Cross-Regional AUC-ROC Disparities

Figure 2 and Table 2 present AUC-ROC values across the six study regions for the three model conditions. Under the Baseline LR model, AUC-ROC ranged from 0,675 in South Asia to 0,772 in North America, representing an absolute disparity of 0,097 points. Sub-Saharan Africa recorded 0,725, East Asia 0,720, Western Europe 0,716, and Latin America 0,686. The Reweighted LR model produced minimal numerical change relative to the Baseline LR across all regions, with absolute differences below 0,002. The Calibrated GBM model produced higher AUC-ROC in North America (≈ 0,780) but lower values in South Asia (≈ 0,594), Sub-Saharan Africa (≈ 0,667), and Latin America (≈ 0,656). Bootstrap confidence intervals indicated statistically significant reductions in AUC-ROC for South Asia and Sub-Saharan Africa under the Calibrated GBM condition after Bonferroni correction (corrected p < 0,05).

The Calibrated GBM introduces the most consequential pattern. In North America it achieves the highest AUC-ROC of all three models (≈ 0.780), while in South Asia the green bar drops sharply to approximately 0.594 falling 0.081 points below the Baseline LR and approaching the random-classifier floor (AUC = 0.50). Sub-Saharan Africa declines from 0.725 to approximately 0.667 (Δ = −0.058) and Latin America from 0.686 to 0.656 (Δ = −0.030). This pattern calibration improving AUC in high-resource regions while degrading it in low-resource ones is a direct expression of Chouldechova's (2017) recalibration penalty: isotonic calibration matches predicted probabilities to training base rates, and when base rates differ substantially across regions, this redistribution disadvantages low-prevalence regional distributions.

Equalized Odds: TPR and FPR Decomposition

The right panel tells a fundamentally different story. Under the Baseline LR, four regions South Asia, East Asia, Western Europe, and North America record FPR = 1.000, meaning the model classifies every negative-class instance as positive. Sub-Saharan Africa records FPR = 0.936 and Latin America 0.913, both critically elevated. This confirms that the model's near-perfect aggregate recall (0.999) is an artefact of threshold collapse rather than genuine discrimination: the decision boundary has shifted so far toward the positive class that specificity is entirely absent across all regions. The Calibrated GBM produces modest visible reductions in Sub-Saharan Africa (≈ 0.95) and Latin America (≈ 0.90), but FPR remains at or near 1.000 for South Asia and the three highest-resource regions a pattern that neither model variant adequately resolves.

Demographic Parity Gap Across Debiasing Strategies

Under the Baseline LR (top row), Sub-Saharan Africa records DPG = 0.018, the highest value in the matrix, while Latin America records 0.010. All four remaining regions register 0.000. The Reweighted LR (middle row) is identical for Sub-Saharan Africa (0.018) and reduces Latin America only marginally to 0.005 changes so small that the middle row is visually indistinguishable from the top row. The Calibrated GBM (bottom row) introduces a redistribution: Latin America falls to 0.000, but South Asia rises from 0.000 to 0.012 an increase that is an artefact of isotonic recalibration shifting the reference region's probability scores rather than a genuine worsening of South Asia's structural position. Most consequentially, Sub-Saharan Africa's DPG remains fixed at 0.018 across all three rows the single consistently non-zero cell in the left column of Figure 3 demonstrating that no strategy tested in this pipeline closes the demographic parity gap for the most disadvantaged region.

Performance–Fairness Trade-off by Region

Figure 5 tracks F1 trajectories across all three model conditions for each region individually, with DPG annotated beneath each panel. Three distinct patterns emerge.

Cost-bearing: regions Sub-Saharan Africa and South Asia. These are the only regions where the Calibrated GBM produces a measurable F1 decline. Sub-Saharan Africa's F1 rises from 0.876 to 0.878 between the two LR models before falling to 0.862 under calibration (net Δ = −0.014), while DPG reduces only from 0.180 to 0.173 a fairness gain of 0.007 in exchange for a performance loss of 0.014, a trade-off ratio unfavourable to the region already performing worst. South Asia presents the sharpest finding: F1 declines from 0.911 to 0.909 (Δ = −0.002) while DPG simultaneously worsens from 0.103 to 0.110, meaning calibration produces net-negative outcomes on both axes for this region.

Invariant regions: East Asia, Western Europe, North America, Latin America. All four regions record perfectly flat F1 trajectories across all three models: Western Europe 0.970, North America 0.980, East Asia 0.944, Latin America 0.934. These regions absorb no performance cost from either debiasing intervention. Latin America additionally gains a DPG reduction from 0.088 to 0.074 under calibration a genuine Pareto improvement. Western Europe and North America begin at near-zero DPG (0.004 and 0.000 respectively) and remain there throughout.

The structural asymmetry of fairness costs. Reading Figure 4 in its entirety reveals a finding that aggregate statistics cannot expose: the performance costs of fairness intervention fall exclusively on the regions already performing worst. Sub-Saharan Africa lowest F1 at baseline and highest DPG is the only region to sustain F1 losses exceeding 0.010. North America highest F1 at baseline and zero DPG is completely invariant. This asymmetry is not a deficiency of any particular algorithm; it is a mathematical consequence of fairness-constrained optimisation under unequal base-rate distributions ( Chouldechova , 2017; Corbett-Davies & Goel, 2018), and it implicates the need for region-stratified pipeline design rather than globally applied post-hoc correction.

Summary of Key Findings

This study evaluated the effectiveness of cross-regional bias mitigation strategies across six world regions using a synthetic fairness benchmarking framework. Four principal findings emerged. First, pre-processing reweighting produced negligible improvement in regional fairness outcomes relative to the baseline model. Second, all three model conditions recorded extremely elevated False Positive Rates across multiple regions, indicating persistent threshold instability despite high aggregate recall. Third, demographic parity disparities remained concentrated in structurally disadvantaged regions, particularly Sub-Saharan Africa. Fourth, the performance costs associated with fairness intervention were distributed asymmetrically across regions, with the largest reductions in F1 Score occurring in already disadvantaged regional groups.

Interpretation of Findings

The limited effectiveness of reweighting-based mitigation strategies is consistent with prior studies demonstrating that sample-level balancing techniques are insufficient when structural disparities are embedded directly within the feature-generation process rather than arising solely from class imbalance.(6,7) Similar findings were reported by Blow et al., who observed that the effectiveness of reweighting strategies varies substantially across model architectures and protected-group configurations (7).

The persistent elevation of False Positive Rates across regions suggests that aggregate performance metrics alone may obscure substantial classification instability in heterogeneous deployment settings. This finding aligns with fairness literature warning that near-perfect recall may coexist with critically low specificity under unequal threshold distributions (2). The results further support Chouldechova’s impossibility theorem, which demonstrates that calibration, demographic parity, and equalized odds cannot be simultaneously satisfied when subgroup base rates differ (13).

The asymmetric impact of fairness interventions observed in Sub-Saharan Africa and South Asia also corresponds with emerging Global South fairness literature (4,15). (4) similarly reported that calibration strategies improved performance in high-income settings while degrading predictive discrimination in lower-resource populations. The persistence of demographic parity disparities in Sub-Saharan Africa suggests that structural regional disadvantage may be resistant to post-hoc correction approaches once encoded within the data-generation process itself.

Implications

The findings carry important implications for responsible AI governance and cross-regional deployment policy. First, the results demonstrate that aggregate fairness reporting may conceal geographically concentrated harms, particularly in structurally disadvantaged populations. Regulatory frameworks relying exclusively on overall model accuracy or aggregate fairness metrics may therefore underestimate regional inequality. Second, the study suggests that globally standardised fairness interventions may redistribute rather than eliminate algorithmic disparities. This reinforces the need for region-stratified auditing frameworks capable of evaluating fairness outcomes independently within each deployment context. Third, the results highlight the importance of geographically representative benchmarking datasets in fairness-sensitive ML applications. Without regional disaggregation during model evaluation, systems may appear compliant under aggregate metrics while producing unequal error burdens across regions.

Limitations

Several limitations should be acknowledged. First, the study relied on synthetic rather than real administrative datasets. Although the synthetic distributions were parameterised using empirical socioeconomic indicators, they cannot fully reproduce the intersectional complexity and institutional variability present in real-world deployment environments.

Second, only three debiasing strategies were evaluated. Additional fairness-aware approaches, including adversarial debiasing, constrained optimisation, and fair representation learning, may produce different regional trade-off patterns.

Third, the study evaluated binary classification outcomes exclusively. The findings may not generalise directly to multi-class classification, ranking systems, or regression-based decision frameworks commonly used in healthcare and finance.

Finally, the analysis focused primarily on geographic disparity and did not incorporate intersectional subgroup analysis involving gender, ethnicity, disability, or language, which may further compound regional fairness inequalities.

This study demonstrated that globally applied fairness interventions do not produce equitable outcomes across structurally heterogeneous regions. The most important finding was that fairness mitigation strategies imposed disproportionate performance costs on already disadvantaged regions while producing minimal impact in high-resource regions. This finding matters because aggregate fairness metrics can conceal geographically concentrated harms, creating the false appearance of equitable model performance. The study therefore recommends that AI governance frameworks adopt region-stratified auditing and geographically disaggregated fairness evaluation rather than relying solely on aggregate reporting. Future research should validate these findings using real-world administrative datasets and extend the framework to intersectional and multi-class prediction settings. Ultimately, achieving responsible and trustworthy AI requires fairness evaluation systems capable of recognising and responding to the structural inequalities embedded within global data ecosystems, rather than assuming that a single universal mitigation strategy can serve all regions equally.