Wisdom of the crowd NLP
noun phrase
Definition: The idea that the aggregated judgments, estimates, or annotations of a diverse and relatively independent group can, under appropriate conditions, be more accurate or reliable than the judgment of a single individual, including an expert. In AI-related research, the term is especially common in crowdsourcing, where multiple non-expert responses are combined to approximate a more robust ground truth [Yasmin et al. 2022].
Example in context: “Services such as AMT have made it much easier to seek the wisdom of the crowd by having non-experts (called workers in the remainder of this paper) to provide many noisy annotations at a much lower cost.” [Liu, Wang 2022]
Related terms: collective intelligence, crowd judgment aggregation