One startup’s pitch to provide more reliable AI answers: Crowdsource the chatbots

Editor's take

CollectivIQ has introduced a platform that aggregates responses from multiple large language models, including OpenAI's GPT-4, Google's Gemini, Anthropic's Claude, and xAI's Grok, presenting them in a unified interface for users.

This approach addresses a significant challenge in current LLM deployment: the inherent unreliability and occasional "hallucinations" of single models. By offering a consensus or diverse range of answers, CollectivIQ aims to improve user trust and utility, particularly for knowledge-intensive tasks where accuracy is paramount. This moves beyond simple model switching to a more sophisticated aggregation strategy, potentially benefiting enterprise users and researchers seeking dependable AI outputs.

Future developments to observe include the efficacy of their aggregation algorithms in identifying and highlighting the most accurate responses, and how quickly they can integrate new, emerging LLMs like Meta's Llama 3. The economic viability of such a service, given the API costs of multiple LLM providers, will also be a key indicator of its long-term success.