South Asia State of Minorities Report 2024: Economic, Political and Social Participation and Representation of Minorities
A 420-page report covering seven countries across eight annual editions with no limitations section in any of them. Terms like 'extremist' and 'majoritarian' are used without published criteria for what qualifies. 64% of the report's quantitative claims present percentages without denominators — readers see a number but cannot evaluate what it measures. Expert surveys used in the report do not disclose their instruments or selection criteria. Circular sourcing with USCIRF and Minority Rights Group compounds the independence problem.
Evaluation
CID-0027: South Asia State of Minorities Report 2024
Full Technical Analysis
Document Classification
Document: South Asia State of Minorities Report 2024: Economic, Political and Social Participation and Representation of Minorities Publishing Org: The South Asia Collective (SAC) Year: 2024 (eighth in an annual series beginning 2016) Word Count: 121,796 Estimated Pages: ~420 CID ID: CID-0027
Document Type: TYPE 6 — Advocacy Document
The South Asia Collective describes the report as “planned as a tool for advocacy.” The founding document states: “The South Asia State of Minorities Report is the collective’s principal tool for advocacy.” The introduction opens with a normative position and the executive summary concludes with policy recommendations directed at governments, civil society, and the UN. The report includes expert perception surveys (Afghanistan N=90, Pakistan N=53, Nepal N=63), but these are small convenience samples embedded within an advocacy framework. TYPE 6 is the correct classification.
Applicability under TYPE 6: D1 Adapted, D2 N/A, D3 N/A, D4 Full, D5 Full, D6 Adapted, D7 Full, D8 Adapted.
Weight Redistribution (D2 18% + D3 15% excluded; remaining 67% scaled by ×1.493): D1 17.91%, D4 22.39%, D5 14.93%, D6 26.87%, D7 7.46%, D8 10.45%. D6 carries over a quarter of the effective weight.
D1 — Definitional Precision (Adapted): 4/10
The report operates within an international human rights framework — UDHR, ICCPR, and the UN Declaration on Minorities. “Minority” is defined broadly across religious, linguistic, ethnic, caste, and gender categories, applied across seven countries. The international legal framework provides a definitional ceiling.
The operational gap is where the score drops. “Nationalist” appears 40 times, “extremist” 12 times — without published criteria. BJP appears 98 times in perpetrator-adjacent framing with no codebook. Expert surveys ask about “discrimination” without published definitions. Afghanistan survey reports 95% of respondents feel minority voices are inadequately represented — question framing and response options not published.
Better than documents with no definitional framework (SASAC Field Manual, D1=2). Worse than documents with published codebooks (Pew, D1=9).
D4 — Coverage Symmetry (Full): 5/10
The report’s regional architecture is its strongest feature. Seven countries create natural multi-directionality: Hindu minorities persecuted in Bangladesh/Pakistan/Afghanistan, Muslim minorities discriminated against in India/Myanmar, Tamil minorities excluded in Sri Lanka, Christian minorities facing violence across the region.
The Swap Test partially passes at the regional level but fails within country chapters. India chapter: BJP=98, Bajrang Dal=3, but no systematic coverage of minority-on-minority dynamics. Identity directionality: Muslim target/agent ratio 18.8:1, Hindu 30.0:1, Christian and Dalit infinity. Content directionality: anti-Muslim content at 100% of directional terms in India-specific text.
Highest D4 among TYPE 6 documents. Regional scope earns that. Within-country unidirectionality prevents higher.
D5 — Source Independence (Full): 4/10
Source type split: advocacy/other 1,289 (83.8%), media 193 (12.6%), government 43 (2.8%), academic 13 (0.8%). Top cited: HRW (75 combined), Amnesty (25), USCIRF (16). Self-citation: thesouthasiacollective.org (12), southasiajusticecampaign.org (14).
Provenance Trace: two of three tested claims showed loops of 1-2 back to SAC’s network. The coalition structure is broader than SASAC’s closed loop but the sourcing ecosystem is still dominated by network-adjacent organizations.
D6 — Verification Standards (Adapted): 4/10
Citation infrastructure: 1,538 URLs across 242 unique domains — highest raw count in the CID corpus. Herfindahl Index 0.0229 (low concentration).
Denominator audit: 80 of 125 claims (64%) flagged. URL shorteners: 243 of 1,538 (15.8%). Expert surveys lack published instruments. Data access: Tier 3 — no download, no formal request process.
Volume is a real strength. But volume without methodology is citation theater.
D7 — Transparency & Governance (Full): 5/10
Contributors named. SAC members publicly listed. Corrections policy detected. Funding opaque — MRG pages suggest programme funding but amount/source undisclosed. Conflict of interest statement missing. No external audit. Governance structure unclear.
D8 — Counter-Evidence (Adapted): 3/10
Corrections policy present. Eight editions since 2016. No limitations section in any edition. Counter-evidence cited but instrumentalized — government positions framed as evidence of the problem rather than engaged. No methodology evolution documented.
Score Computation
Standard Weights: D1(4×17.91%) + D4(5×22.39%) + D5(4×14.93%) + D6(4×26.87%) + D7(5×7.46%) + D8(3×10.45%) = 0.716 + 1.120 + 0.597 + 1.075 + 0.373 + 0.314 = 4.19 Deficient
No caps applied. D3 cap N/A for TYPE 6. D6 Research-Grade gate irrelevant at this score.
Sensitivity Analysis:
- Equal weights (6 dims at 16.67%): 4.17 Deficient
- Verification-heavy (D6 at 25%): 4.20 Deficient
Grade stable across all three schemes. No boundary instability.
Calibration
At 4.19, the SASoM report sits among CID-0006 (4.5), CID-0008 (4.5), and the SASAC Reporting Guide (4.3). Its regional scope and citation volume are structural advantages over those documents. Its weaknesses — undocumented survey methodology, missing limitations, advocacy source dominance — are of the same kind.
Against Pew (CID-0003, 8.7): the 4.5-point gap reflects the distance between advocacy compilation and probability-sample primary research. Against USHMM (CID-0009, 6.5): the 2.3-point gap shows what published external methodology and limitations acknowledgment add.
Open Questions
-
The SASoM report series has published eight editions since 2016 with different thematic foci (Mapping the Terrain, Exploring the Roots, Hate Speech, Majoritarianism, etc.). A longitudinal scoring of the series — comparable to the USCIRF longitudinal — could reveal whether methodological infrastructure has evolved.
-
The individual country chapters are written by different contributors from different organizations. Do methodology standards vary between chapters? A chapter-level scoring analysis could reveal internal quality variation masked by the aggregate score.
-
MRG International’s role as simultaneous coalition member, publisher, funder, and cited source creates a structural entanglement worth a dedicated ecosystem investigation.