Olla v0.1.0
The latest stable build of our open-source LLM proxy and load balancer.
Deploy LLMs on Your Own Infrastructure.
From Lab to Enterprise.
We build the foundational tools and platforms that empower organisations to deploy, manage and scale AI applications with confidence on their own terms.
LATEST FROM THE FOUNDRY
What's new
Fresh releases, announcements and writing from the workshop.
Olla v0.1.0: Text Embeddings Inference, a Reworked Dashboard & Behaviour Changes
Olla v0.1.0 adds a Text Embeddings Inference backend, a reworked dashboard, retry controls and corrected request stats. Several behaviour changes affect existing setups, so check them before you upgrade.
MCP Goes Stateless: What 2026-07-28 Changes
MCP 2026-07-28 drops sessions, the initialize handshake and server-initiated requests. What changed, how to port a server across, and what we get now.
PRODUCT ECOSYSTEM
From user to backend - every layer
TensorFoundry covers the full LLM stack. Pick the layers you need.
FEATURED PRODUCTS
Start with what you need
From open-source tools to enterprise platforms
OUR JOURNEY
Building Data-led AI Innovation for 5+ Years
From ML pipelines to enterprise orchestration - a snapshot of our team's journey.
Why Local AI?
Deploy AI where it matters most - at the edge or closer to you, on your own terms.
Privacy First
Keep sensitive data on-premises. Finely tune models and maintain complete sovereignty without Cloud.
Low Latency
Sub-millisecond response times with edge deployment. Eliminate network overhead for real-time AI.
Cost Effective
Reduce cloud API costs by 90%. Pay once for hardware, run inference & training indefinitely.
Optimised Performance
Hardware-accelerated inference with support for CUDA, Metal and custom accelerators.
OPEN SOURCE
Join the Olla Community
Open-source AI inference proxy perfect for small businesses and development teams. Unified interface for Ollama, LM Studio, vLLM and others with load balancing and failover.
86.4K+
Container Pulls
300+
GitHub Stars
Apache 2.0
Open Source
EARLY ACCESS
Get Early Access to the Full Stack
Join the waitlist for priority access to Alloy, FoundryOS, Kaizen, Pivotal and Forge as they launch from late 2026 into 2027.
Get exclusive updates, beta access and founding member pricing.
Priority Beta Access
Up to 50% Off Licensing
Direct Engineering Access
Now Olla, Alloy, FoundryOS, Kaizen + Pivotal
Late 2026 Alloy public release
Early 2027 FoundryOS, Kaizen, AgentOS + Pivotal 5
Ready to deploy AI at the edge?
Let TensorFoundry build your AI Inference & Training Lab for you.