Mercore has achieved unprecedented hypergrowth, scaling from a $1M to a $400M revenue run rate in just 16 months by creating a marketplace for high-skilled experts to train and evaluate AI models.
The AI industry is entering the "era of evals," where the primary bottleneck to improving model capabilities is the ability to effectively measure performance, making human expertise more valuable than ever.
The market for AI data has shifted from low-skilled crowdsourcing (like data labeling) to sourcing elite professionals (engineers, doctors, writers) who can provide nuanced feedback and training via Reinforcement Learning from Human Feedback (RLHF).
Mercore is deeply embedded in the AI ecosystem, working with six of the "Magnificent Seven" tech companies, all top five AI labs, and is creating a new, lucrative category of jobs with median pay rates of $95/hour.
12 quotes
Concerns Raised
The competitive landscape is growing as other companies recognize the market shift and attempt to replicate Mercore's thesis.
The guest dismisses near-term (3-year) AGI/superintelligence fears as overrated, suggesting a focus on practical, current-generation AI capabilities.
Opportunities Identified
The total addressable market is defined by any task a human can do that a model cannot, representing a near-limitless opportunity.
Creating a global, liquid talent marketplace by automating manual hiring processes for high-skilled AI training roles.
Applying reinforcement learning to the entire economy, with evals serving as the prerequisite for automating every business workflow.