AI's most important protocol is getting a little bit easier to use
Under the new system, the protocol will take a looser, "stateless" approach to session IDs on the server side, similar to how most ordinary websites already work. The Model Context Protocol (MCP) is one of the basic building blocks of AI interoperability, giving AI models a secure way to access external data sources and services. It's the plumbing that lets a chatbot reach into your calendar, your database, or your internal tools, instead of engineers building custom pipes for every connection.
Key Takeaways
- Next week, that protocol is getting a significant update, and while it might not be noticeable to end users, it could make a big difference in how the ecosystem develops.
- As Arcade founder Nate Barbettini puts it: [Under the current system] The first time an MCP client like Claude connects to a server, it sends a "hello": I'm Claude, here's my version, here are my capabilities.
The server replies with its own capabilities and hands back a session ID...
- Now every one of those machines has to know about a session ID that some other machine handed out.
It's not impossible, but it's a serious pain, and it fights the load balancer instead of working with it.
- Under the new system, the protocol will take a looser, "stateless" approach to session IDs on the server side, similar to how most ordinary websites already work, which should make the whole system a lot easier to maintain and, in theory, cheaper to run at scale.
That's all pretty technical, but it's an important reminder that not every part of AI development is moving at breakneck speeds.
- He previously worked at The Verge and Rest of World, and has written for Wired, The Awl and MIT's Technology Review.
Stats & Key Facts
- #Arcade raised $60 million in June based on the idea that most AI agents don't fail because the underlying models are weak but because the infrastructure around them isn't ready yet, and that's what this update is trying to address.
Next week, that protocol is getting a significant update, and while it might not be noticeable to end users, it could make a big difference in how the ecosystem develops. The official spec for the new version has been public since May, but we got an unusually clear explanation of the changes Monday morning from the folks at Arcade - a two-year-old startup that's built its entire business around the work of getting AI agents to actually function inside real companies, letting them securely connect to and act on tools like Gmail, Slack, and Salesforce. Arcade raised $60 million in June based on the idea that most AI agents don't fail because the underlying models are weak but because the infrastructure around them isn't ready yet, and that's what this update is trying to address.
Essentially, MCP is changing the way it handles session IDs - the little tokens that servers use to remember "ah, this is the same conversation as five seconds ago" - so servers can operate more easily at a larger scale. As Arcade founder Nate Barbettini puts it: [Under the current system] The first time an MCP client like Claude connects to a server, it sends a "hello": I'm Claude, here's my version, here are my capabilities. The server replies with its own capabilities and hands back a session ID...
From then on, the client sends that session ID on every request so the server knows it's the same conversation. Sometimes the ID expires, so the client has to notice, request a new one, and carry on.... You're running a server for millions of users, behind a load balancer whose entire job is to route each request to whatever server in the farm is free, sometimes in a different region.
For more details please read the original article at TechCrunch AI.
Continue Learning
Comments
Sign in to join the conversation