Key Points
- 1.Mira Murati founded Thinking Machines after leaving OpenAI, securing $2 billion from A16Z.
- 2.Their new model, Inkling, prioritizes efficiency over raw intelligence with innovative features.
- 3.Inkling's unique architecture allows it to process raw inputs directly and self-modify its behavior.
Summary
Mira Murati's Departure from OpenAI
Mira Murati left her position as CTO of OpenAI, bringing along key co-founders to establish Thinking Machines. This decision was backed by a significant investment from A16Z, amounts totaling $2 billion.
Introduction of Inkling
Inkling, the latest offering from Thinking Machines, features a mixture of experts model that uses only a subset of its 970 billion parameters for each token processed. This approach enhances computational efficiency while managing to pre-train on an extensive dataset of 45 trillion tokens.
Unique Features of Inkling
Inkling incorporates a 'thinking effort' dial, allowing users to control the depth of responses based on their needs. Additionally, its direct processing of audio and image data without separate encoders sets it apart from traditional models.
Focus on Transparency and Model Admittance
One of Inkling's standout traits is its ability to recognize its limitations, which enhances its forecasting capabilities. This 'epistemics' approach rewards the model for acknowledging uncertainty, improving overall user confidence in its outputs.
Worth watching for
This video is aimed at tech enthusiasts, machine learning researchers, and startup founders interested in innovations in AI and model efficiencies.