Large Tabular Models Excel Where LLMs Fail
The large language models (LLMs) that form the basis of generative AI chatbots such as ChatGPT, Claude, and Gemini can generate uncannily human-like text and images. But these models still struggle with a skill that, ironically, looks at face value to be right in their wheelhouse: analyzing structured data. A new type of generative AI is set to change this situation.
Key Takeaways
- Although you can get your favorite chatbot to solve intractable math problems , review dense legal documents, compose a catchy pop song , or put together some slick PowerPoint slides, give it anything more than a small table and it doesn't have a clue what to do.
For most companies and organizations, the most important data sits in spreadsheets.
- Now, the model is being adopted by companies such as Amazon Web Services, while others race to build their own LTMs.
"People like to see images, videos, and ChatGPT responses," he says.
- Additionally, language is sequential by nature (as are music, images, and video).
Changing the order of words in a sentence may change or completely destroy its meaning.
- "With LLMs, even slightly changing the input, you get a different output," says Jeremy Fraenkel , CEO of Fundamental.
"That's fine, and actually often desirable for LLMs, but when you're making a prediction of whether a transaction is fraudulent or not, you want to make sure that the prediction is the same, or deterministic, no matter what.
- They jointly learn from each entry's numerical value, what it represents, and how it relates to other entries.
Stats & Key Facts
- #Fundamental came out of stealth mode on 5 February 2026 with US $275 million in funding and a model called NEXUS , purpose-built for tabular data.
- #" Different tabular datasets are also difficult to compare, explains van Breugel, who co-wrote a prescient position paper on this topic in 2024.
- #" Developing Fundamental's LTM Current tabular data solutions are limited to machine learning algorithms, such as XGBoost , that have been around for more than 15 years and are used by organizations globally.
Although you can get your favorite chatbot to solve intractable math problems , review dense legal documents, compose a catchy pop song , or put together some slick PowerPoint slides, give it anything more than a small table and it doesn't have a clue what to do. For most companies and organizations, the most important data sits in spreadsheets. Whether it's a bank's transaction logs, a marketing agency's website metrics, clinical trial participants' vital signs, or the vast amount of proton collision information produced at atom smashers like the Large Hadron Collider, structured, row-and-column data runs the world, and LLMs can't deal with it.
AI startup Fundamental is pioneering a new type of AI foundation model, known as a large tabular model (LTM), to fill the gap. Fundamental came out of stealth mode on 5 February 2026 with US $275 million in funding and a model called NEXUS , purpose-built for tabular data. Now, the model is being adopted by companies such as Amazon Web Services, while others race to build their own LTMs.
Why LLMs struggle with spreadsheets Part of why structured data has garnered less attention is a very human bias, argues Boris van Breugel , a senior AI researcher based in Amsterdam. "People like to see images, videos, and ChatGPT responses," he says. "But tabular data really lags behind because it's not fun to look at numbers.
For more details please read the original article at IEEE Spectrum AI.
Continue Learning
Comments
Sign in to join the conversation