Affected populations in humanitarian settings rarely provide feedback or validate the findings of data collection and analysis processes, despite possessing context-specific knowledge relevant to humanitarian operations. This exploratory study pilots a novel form of collective intelligence (CI) by enabling returnees to Iraq to validate and improve existing data collection processes and analyses related to conditions in their localities. In doing so, the CI methodology allows for more meaningful participation by affected populations than typically afforded and improves accountability and transparency. By collecting data through digital channels, this initiative examines whether a larger and more diverse cross-section of returnees could be engaged to validate findings from key informant data collection. Using GPS technology, location-specific conclusions drawn from existing data collection activities are shared with affected communities to confirm, reject and provide open-ended, qualitative input. The study finds that the demographics of respondents are more diverse than the existing pool of key informants. While the number of respondents in each location prevent attainment of statistically significant results, some indicative findings point to the potential of CI methods for evaluating and improving assessment tools by identifying areas of disagreement between key informants and CI survey participants across different indicators and demographic groups.