System Requirements

Minimum Requirements: 16GB RAM, NVIDIA 2060 6GB minimum, CUDA version 12.4 or greater.

Recommendations: 32GB RAM, 12GB NVIDIA GPU or greater, CUDA 12.8 or greater.

PC desktops generally perform better than laptops with the same amount of VRAM.

Benchmarks

Compatible computer systems include, but are not limited to:

(Swipe or scroll right to view all table columns)

Computer Specifications
Performance
Brand iBuyPower MSI ASUS HP Victus Gaming Laptop Legion Desktop iBuyPower MSI (laptop, below recommended specifications)
CPU Intel Core i9, 14900KF Intel Core Ultra 9 285HX AMD Ryzen 9 5900X 12-Core Processor, 3701 Mhz, 12 Core(s), 24 Logical Processor(s) AMD Ryzen 7 7000 series Intel Core i5, 13400F AMD Ryzen 5 3600 6-core Intel Core i7-9750H
RAM 96 96 32 16 32 16 32
GPU NVIDIA GeForce RTX 5090 NVIDIA GeForce RTX 5090 NVIDIA GeForce
RTX 4080
NVIDIA GeForce RTX 4050 Laptop GPU NVIDIA GeForce RTX 3060 NVIDIA GeForce RTX 2060 NVIDIA GeForce
TX 1660 TI
VRAM 32 24 16 6 12 6 6
Initial Load 25s 25s 29s 52s 54s 1m21s 3m17s
First Image (@30 steps) / (when loading AI model) 12s 23s 1m23s 1m30s 1m51s 1m48s 3m42s
Second Image (@30 steps) 4s 21s 29s 1m31s 1m11s 1m29s 3m48s
Third Image (@30 steps) 4s 13s 29s 1m32s 49s 1m31s 4m2s
Chat Initial Response Start (@10 GPU layers, 32000 CTX, pre load Granite model) <5s 8s 12s 1m3s 12s 26s 29s
Second Response Start <1s 1s <1s <1s <5s <5s 6s

*Initial load times of Magan on SSD drives tested considerably faster, usually within 8 to 15 seconds. However, once inside the program, the results are about the same as a USB drive. Magan's performance is most dependent on the machine running it.

Follow MAGĀN.AI

No spam, only important stuff