Osaurus, meanwhile, presents an easy-to-use interface that consumers can use, and addresses security concerns by running things in a hardware-isolated, virtual sandbox. This limits the AI to a certain scope, keeping your computer and data safe.
Of course, the practice of running AI models on your machine is still in its early days, given that it’s heavily resource-intensive and hardware-dependent. To run local models, your system will need at least 64 GB of RAM. For running larger models, like DeepSeek v4, Pae recommends systems with about 128 GB of RAM.
But Pae believes local AI’s needs will come down in time.
“I can see the potential of it, because the intelligence per wattage — which is like the metric for local AI — has been going up significantly. It’s on its own curve of innovation. Last year, local AI could barely finish sentences, but today it can actually run tools, write code, access your browser, and order stuff from Amazon […] it’s just getting better and better,” he said.
Osaurus today can run MiniMax M2.5, Gemma 4, Qwen3.6, GPT-OSS, Llama, DeepSeek V4, and other models. It also supports Apple’s on-device foundation models, Liquid AI’s LFM family of on-device models, and in the cloud, it can connect to OpenAI, Anthropic, Gemini, xAI/Grok, Venice AI, OpenRouter, Ollama, and LM Studio.
As a full MCP (Model Context Protocol) server, you can give any MCP-compatible client access to your tools as well. Plus, it ships with over 20 native plugins for Mail, Calendar, Vision, macOS Use, XLSX, PPTX, Browser, Music, Git, Filesystem, Search, Fetch, and more.
- YouTube viewers watch 2 billion hours of Shorts on TVs each month
According to YouTube, viewers watched over 700 million hours of podcasts each month on living room devices…
- Clawdmeter turns your Claude Code usage stats into a tiny desktop dashboard
Sure, you can track Claude Code usage directly in the terminal using commands or other…
- OpenAI is reportedly preparing legal action against Apple; it wouldn’t be the first partner to feel burned
OpenAI is so frustrated with Apple over a ChatGPT integration that failed to deliver the…
- A hotel check-in system left a million passports and driver’s licenses open for anyone to see
A hotel check-in system left more than one million customer passports, driver’s licenses, and selfie…
- What happens when AI starts building itself?
Richard Socher has been a major figure in AI for some time, best known for…
- Cerebras IPO makes billions for Benchmark but VC Eric Vishria almost didn’t take the meeting
“You don't have a lot of traction on the company yet, so yeah, that was…
More recently, Osaurus was updated to include voice capabilities as well.
Since the project went live nearly a year ago, it has been downloaded north of 112,000 times, according to its website. The app competes with other tools that let you run models locally, like Ollama, Msty, LM Studio, and others, but offers a differentiated feature set and presents itself as a more user-friendly option for non-developers, too.
Currently, Osaurus’ founders (who include co-founder Sam Yoo) are participating in the New York-based startup accelerator Alliance. They’re also thinking about next steps, which could see Osaurus being offered to businesses, like those in the legal space or in healthcare, where running local LLMs could address privacy concerns.
As the power of local AI models grows, the team believes it could lower the demand for AI data centers.
“We’re seeing this explosive growth in the AI space where have to scale up using data centers and infrastructure, but we feel like people haven’t really seen the value of the local AI yet,” Pae said. “Instead of relying on the cloud, they can actually deploy a Mac Studio on-prem, and it should use substantially less power. You still have the capabilities of the cloud, but you will not be dependent on a data center to be able to run that AI,” he added.