Probably raises $9M to build a more reliable kind of AI
Probably wants to prevent hallucinations and factual errors from reaching users, and achieve accuracy on par with deterministic systems. As LLMs have grown more powerful, hallucinations have proven stubbornly difficult to avoid. Errors pop up in even the smartest models, and while there are ways to catch those errors, the industry is still figuring out the best way to do it.
Key Takeaways
- Probably , which just raised $9 million in seed funding from Andreessen Horowitz, is trying to build a more rigorous way to catch those errors.
As founder Peter Elias (pictured above) puts it, the company's goal is to prevent hallucinations and simple factual errors from ever reaching the user, and achieve the kind of 99.
- Each result comes with a citation and an audit trail for how it was developed, an increasingly common practice among AI tools.
But keeping errors from creeping into those summaries required an elaborate harness system that Elias describes as a "data science mech suit.
- "If you can refine the context enough, the model does not have to work very hard to do the right thing.
- And, Elias' idea doesn't end with data science, as the same engine can be extended to cover use cases like accounting or medical services - as Elias puts it, "any precision-sensitive use case.
" "I think it's really interesting that the big AI labs have not even attempted to do this," Elias says.
- Through candid fireside chats and high-impact networking, you'll walk away with valuable insights and new connections.
Stats & Key Facts
- #Probably , which just raised $9 million in seed funding from Andreessen Horowitz, is trying to build a more rigorous way to catch those errors.
- #As founder Peter Elias (pictured above) puts it, the company's goal is to prevent hallucinations and simple factual errors from ever reaching the user, and achieve the kind of 99.
- #99% accuracy that's common in deterministic systems but much more difficult to reach with AI.
Probably , which just raised $9 million in seed funding from Andreessen Horowitz, is trying to build a more rigorous way to catch those errors. As founder Peter Elias (pictured above) puts it, the company's goal is to prevent hallucinations and simple factual errors from ever reaching the user, and achieve the kind of 99. 99% accuracy that's common in deterministic systems but much more difficult to reach with AI.
As it turns out, bringing LLMs to that level of accuracy requires rethinking many of the basic assumptions of AI engineering. Probably's first product is a data science tool, built to produce quick answers from complex datasets. Each result comes with a citation and an audit trail for how it was developed, an increasingly common practice among AI tools.
But keeping errors from creeping into those summaries required an elaborate harness system that Elias describes as a "data science mech suit. " The LLM's first-pass answers are checked against a deterministic validator system, which bounces back any results that don't match the dataset. Crucially, the LLM has been trained against the validator, and the whole system is optimized for fast and accurate answers, the company said.
For more details please read the original article at TechCrunch AI.
Continue Learning
Comments
Sign in to join the conversation