Hardware
LLM hardware guides
Browse practical hardware profiles for GPUs, Apple Silicon, and CPU-only setups, then check what each machine can realistically handle.
NVIDIA
RTX 3060 12GB
- Memory
- 12 GB VRAM
- Bandwidth
- 360 GB/s
- Form factor
- desktop
NVIDIA
RTX 4060 Ti 16GB
- Memory
- 16 GB VRAM
- Bandwidth
- 288 GB/s
- Form factor
- desktop
NVIDIA
RTX 4090 24GB
- Memory
- 24 GB VRAM
- Bandwidth
- 1008 GB/s
- Form factor
- desktop
NVIDIA
A100 80GB
- Memory
- 80 GB VRAM
- Bandwidth
- 1935 GB/s
- Form factor
- server
Apple
Apple M2 16GB
- Memory
- 16 GB unified/RAM
- Bandwidth
- 100 GB/s
- Form factor
- laptop
Apple
Apple M3 Max 64GB
- Memory
- 64 GB unified/RAM
- Bandwidth
- 400 GB/s
- Form factor
- laptop
Generic x86
CPU Workstation 64GB RAM
- Memory
- 64 GB unified/RAM
- Bandwidth
- 70 GB/s
- Form factor
- desktop