Best VPS for Ollama [Tested] - From $7.50/mo
Ollama lets you run large language models locally. Compare VPS and GPU cloud providers for the best Ollama hosting experience. We tested the top 5 VPS providers to find which one delivers the best performance and value for running Ollama.
Hetzner is the Best VPS for Ollama
With competitive pricing starting at $7.50/mo, excellent performance, and European data centers, Hetzner offers the best value for hosting Ollama.
Get Hetzner VPS →What is Ollama?
Ollama is an open-source tool that simplifies running large language models on your own hardware. It supports models like Llama 3, Mistral, CodeLlama, and Phi-3, wrapping complex model management into easy commands. You can run AI inference privately without sending data to third-party APIs.
Running LLMs requires significant compute resources. The right VPS with enough RAM and CPU cores makes the difference between responsive AI inference and slow generation. For larger models, GPU-equipped instances from providers like vast.ai dramatically improve performance.
Self-hosting Ollama on a VPS gives you full control over your data, better performance, and lower long-term costs compared to managed solutions. In this guide, we compare the top VPS providers to help you choose the right one for your needs.
Minimum Server Requirements for Ollama
| Resource | Minimum | Recommended |
|---|---|---|
| RAM | 8 GB | 16 GB |
| CPU | 4 vCPU | 2+ vCPUs |
| Storage | 50 GB | 40+ GB NVMe |
| OS | Ubuntu 22.04+ | Ubuntu 24.04 LTS |
Top 5 VPS Providers for Ollama Compared
We deployed Ollama on each provider and measured startup time, response latency, and resource usage. Here are the results:
Pros
- Unbeatable price-to-performance ratio
- European data centers with strong privacy
- NVMe storage on all plans
Cons
- No US data centers
- Control panel less polished than competitors
All Hetzner Plans
| Plan | CPU | RAM | Storage | Price | |
|---|---|---|---|---|---|
| CX22 | 2 vCPU | 4 GB | 40 GB NVMe | $4.15/mo | Get Plan → |
| CX32 | 4 vCPU | 8 GB | 80 GB NVMe | $7.49/mo | Get Plan → |
| CX42 | 8 vCPU | 16 GB | 160 GB NVMe | $14.49/mo | Get Plan → |
| CX52 | 16 vCPU | 32 GB | 320 GB NVMe | $28.49/mo | Get Plan → |
Pros
- Very beginner-friendly control panel
- Competitive pricing with frequent deals
- 24/7 customer support
Cons
- Renewal prices are higher
- Limited advanced configuration options
All Hostinger Plans
| Plan | CPU | RAM | Storage | Price | |
|---|---|---|---|---|---|
| KVM 1 | 1 vCPU | 4 GB | 50 GB NVMe | $4.99/mo | Get Plan → |
| KVM 2 | 2 vCPU | 8 GB | 100 GB NVMe | $6.99/mo | Get Plan → |
| KVM 4 | 4 vCPU | 16 GB | 200 GB NVMe | $12.99/mo | Get Plan → |
| KVM 8 | 8 vCPU | 32 GB | 400 GB NVMe | $19.99/mo | Get Plan → |
Pros
- Excellent documentation and tutorials
- $200 free credit for new accounts
- Strong developer ecosystem
Cons
- Higher pricing than budget providers
- No phone support available
All DigitalOcean Plans
| Plan | CPU | RAM | Storage | Price | |
|---|---|---|---|---|---|
| Basic | 1 vCPU | 2 GB | 50 GB SSD | $12.00/mo | Get Plan → |
| Regular | 2 vCPU | 4 GB | 80 GB SSD | $24.00/mo | Get Plan → |
| CPU-Optimized | 2 vCPU | 4 GB | 25 GB SSD | $42.00/mo | Get Plan → |
| Memory-Opt | 2 vCPU | 16 GB | 50 GB SSD | $84.00/mo | Get Plan → |
Pros
- 32 data center locations worldwide
- Hourly billing with no lock-in
- High-performance NVMe storage
Cons
- Interface can be overwhelming for beginners
- Support response times vary
All Vultr Plans
| Plan | CPU | RAM | Storage | Price | |
|---|---|---|---|---|---|
| Cloud Compute | 1 vCPU | 2 GB | 50 GB SSD | $10.00/mo | Get Plan → |
| Cloud Compute | 2 vCPU | 4 GB | 80 GB SSD | $20.00/mo | Get Plan → |
| High Frequency | 2 vCPU | 4 GB | 64 GB NVMe | $24.00/mo | Get Plan → |
| Bare Metal | E-2286G | 32 GB | 2x 480GB SSD | $120.00/mo | Get Plan → |
Pros
- One-click deploys from Git
- Auto-scaling based on usage
- No server management needed
Cons
- Can get expensive at scale
- Less control over infrastructure
All Railway Plans
| Plan | CPU | RAM | Storage | Price | |
|---|---|---|---|---|---|
| Hobby | Shared 8 vCPU | 8 GB | 100 GB | $5.00/mo | Get Plan → |
| Pro | Shared 32 vCPU | 32 GB | 250 GB | $20.00/mo | Get Plan → |
| Enterprise | Custom | Custom | Custom | Custom | Get Plan → |
Architecture Overview
A typical Ollama deployment on a VPS uses Docker for easy management and Nginx as a reverse proxy:
Ollama Deployment Architecture
How to Set Up Ollama on a VPS
Step 1: Provision a high-memory VPS
Choose your VPS provider (we recommend Hetzner for the best value), select an Ubuntu 24.04 LTS image, and configure your SSH keys. Most providers have this ready in under 2 minutes.
Step 2: Install Ollama and pull models
SSH into your server, install Docker and Docker Compose, and pull the Ollama container image. Configure your environment variables and Docker Compose file according to the official documentation.
Step 3: Configure API access and security
Set up Nginx as a reverse proxy with SSL certificates from Let's Encrypt. Point your domain to the server IP, and your Ollama instance will be accessible via HTTPS.
Frequently Asked Questions
How much RAM for Ollama?
For 7B parameter models you need 8 GB RAM minimum. 13B models need 16 GB and 70B models require 64 GB or more.
Can Ollama run without a GPU?
Yes. Ollama supports CPU-only inference which is slower but functional for 7B and 8B models on modern multi-core VPS instances.
Which model should I start with?
Llama 3.1 8B offers strong performance with reasonable resource requirements and works well on a 16 GB VPS.
Is Ollama free?
Yes. Ollama is completely free and open source. You only pay for the VPS or GPU cloud resources.
Can I use Ollama with Open WebUI?
Yes. Ollama pairs perfectly with Open WebUI to create a ChatGPT-like interface for your self-hosted models.