A satellite just learned to find things on its own - here's what that means
In April, for the first time ever, an Earth observation satellite found what it was looking for, all on its own. For the first time, an Earth observation satellite has found what it was looking for - on its own, without human analysts on the ground. The milestone, which occurred in April, marks the first reported use of a vision-language model in orbit, and offers a glimpse of how AI could fundamentally change what space-based sensors are capable of - and how much they're worth.
Key Takeaways
- Typically, satellites download large chunks of data to analysts on the Earth below, who use machine learning algorithms or their own eyes to figure out what's going on.
But onboard Yam-9, a spacecraft built by space infrastructure company Loft Orbital , a software package built by NASA's Jet Propulsion Laboratory identified areas of interest in response to natural language queries.
- In the near term, it could make space sensors far more useful by doing initial data triage on orbit, reducing the flood of raw data that analysts currently have to wade through.
Longer term, it's a proof point toward running larger-scale AI infrastructure in space.
- The business model is closer to infrastructure-as-a-service than traditional satellite manufacturing.
One recent deal saw it build, launch and operate six new satellites for EarthDaily, which will analyze and market the data collected onboard the spacecraft.
- While this is the first reported use of a VLM on orbit, we can expect other companies to follow suit.
Planet Labs flies satellites with Jetson Orin processors; for now, it is using them for simpler object detection tasks, but a spokesperson says research is underway on other AI applications, including VLMs.
- ) Lessons learned deploying these smaller models on orbit will inform how companies attempt to deploy larger-scale compute infrastructure in space, particularly in the prosaic-but-vital areas of power and memory management.
Typically, satellites download large chunks of data to analysts on the Earth below, who use machine learning algorithms or their own eyes to figure out what's going on. But onboard Yam-9, a spacecraft built by space infrastructure company Loft Orbital , a software package built by NASA's Jet Propulsion Laboratory identified areas of interest in response to natural language queries. Google DeepMind's Gemma 3 - the vision-language model, or VLM, that powered the demonstration - is purpose-built for edge applications, meaning it is designed to run on limited hardware far from a data center.
VLMs combine the contextual understanding of large language models with the ability to analyze imagery: researchers asked the model to classify sensor data where natural environment meets human development, for example, or to identify infrastructure around railway hubs - and it did. The demonstration is significant for two reasons. In the near term, it could make space sensors far more useful by doing initial data triage on orbit, reducing the flood of raw data that analysts currently have to wade through.
Longer term, it's a proof point toward running larger-scale AI infrastructure in space. "It opens the door to always-on, patrol layers in space," Loft's head of AI, Paul Lasserre, told TechCrunch. "If you have a VLM, you can have logic-like 'monitor this border for me, and let me know when something is suspicious,' and interact back and forth with the satellites.
For more details please read the original article at TechCrunch AI.
Continue Learning
Comments
Sign in to join the conversation