The headline statistics — a 450% increase and 72% share — describe the makeup of a pre-filtered dataset, not rates measured against all political discourse. Without a baseline of total political content, these figures cannot mean what the report implies.
This evaluation applies the CID Rubric v0.3.2 to Center for Study of Organized Hate (CSOH)'s 2024 report "Islamophobia in the 2024 New York Mayoral Race." The composite score of 5.3/10 (Deficient) reflects significant methodological deficiencies across multiple dimensions.
A full academic narrative for this report is in preparation. The dimensional analysis below is generated from scored data. See the Scoring Data view for the complete evidence trail.
'Islamophobia' defined via example taxonomy without formal criteria
Classification taxonomy is present but criteria for borderline cases are unspecified. Reproduces examples without systematic operationalization.
Reliability testing absent — report acknowledges this explicitly
Two coders classified content but no agreement statistics were calculated to verify that they classified the same posts the same way. Partial credit awarded because the report acknowledges this gap rather than claiming reliability it did not test.
Closed-Universe Percentage Problem — no baseline, no symmetric monitoring
35,522 posts represent the classified dataset, not total discourse. No monitoring of other candidates. No baseline of non-Islamophobic content.
No symmetric monitoring of other mayoral candidates
Monitoring scope limited to Islamophobic content about one candidate. Cannot assess whether observed patterns are unusual for political campaigns.
CSOH is the sole producer. CSOH/IHL shared founder not disclosed in this report.
No raw data access — social media posts not archived with permalinks
Methodology does not document data preservation or access process. Replication not possible from published report.
No funding disclosure — CSOH/IHL founder relationship not disclosed
Organization website does not list funders. IHL relationship not surfaced in this report despite relevance to source independence.
Report acknowledges monitoring limitations at several points and explicitly flags that reliability testing was not conducted. Stronger on self-disclosure than most reports in this score range.
Post-publication citation analysis tracks how this report's findings have been represented in subsequent publications, policy documents, media coverage, and advocacy materials. Entries marked as escalations indicate instances where the report was cited with scope or authority beyond what the original methodology establishes.
Claimed scope: Documented prevalence and escalation of Islamophobia in the 2024 NYC mayoral race
Established scope: Internal composition statistics of pre-classified posts from one candidate's monitoring period
The 450% figure was reported in several outlets as a prevalence increase in political Islamophobia without disclosure that it is an internal ratio within already-classified content, not a rate against total discourse.
Scope: Incident tracker that acknowledges absent reliability testing and provides no baseline comparator
Several subsequent monitoring studies cite this report as establishing methodology. The absence of a discourse baseline and the unverified inter-coder agreement are not noted in these citations.
This evaluation assesses methodological rigor only. It does not evaluate the factual accuracy of individual claims or the existence of the phenomena the report describes. The CID Rubric v0.3.2 is designed for published research reports; application to certain document types requires adapted interpretation of specific dimensions. The CID has not independently investigated the organizations or individuals referenced in the report.