这张显卡能跑多大的本地大模型？

每个型号单独列出，标称容量按规格换算成字节。

8 GB 4

8GB 显存

GeForce RTX 3060 8GB (desktop)8 GB GDDR6净预算: 7 GiBGeForce RTX 3070 8GB (desktop)8 GB GDDR6净预算: 7 GiBGeForce RTX 4060 8GB (desktop)8 GB GDDR6净预算: 7 GiBGeForce RTX 5060 Ti 8GB (desktop)8 GB GDDR7净预算: 7 GiB

10–12 GB 6

12GB 显存

GeForce RTX 3080 10GB (desktop)10 GB GDDR6X净预算: 9 GiBGeForce RTX 3060 12GB (desktop)12 GB GDDR6净预算: 11 GiBGeForce RTX 3080 12GB (desktop)12 GB GDDR6X净预算: 11 GiBGeForce RTX 4070 12GB (desktop, GDDR6X)12 GB GDDR6X净预算: 11 GiBGeForce RTX 4070 SUPER 12GB (desktop)12 GB GDDR6X净预算: 11 GiBGeForce RTX 5070 12GB (desktop)12 GB GDDR7净预算: 11 GiB

16 GB 10

16GB 显存

GeForce RTX 4060 Ti 16GB (desktop)16 GB GDDR6净预算: 15 GiBGeForce RTX 4070 Ti SUPER 16GB (desktop)16 GB GDDR6X净预算: 15 GiBGeForce RTX 4080 16GB (desktop)16 GB GDDR6X净预算: 14 GiBGeForce RTX 4080 SUPER 16GB (desktop)16 GB GDDR6X净预算: 14 GiBGeForce RTX 5060 Ti 16GB (desktop)16 GB GDDR7净预算: 14 GiBGeForce RTX 5070 Ti 16GB (desktop)16 GB GDDR7净预算: 14 GiBGeForce RTX 5080 16GB (desktop)16 GB GDDR7净预算: 14 GiBRadeon RX 7800 XT 16GB (desktop)16 GB GDDR6净预算: 14 GiBRadeon RX 9070 16GB (desktop)16 GB GDDR6净预算: 14 GiBRadeon RX 9070 XT 16GB (desktop)16 GB GDDR6净预算: 14 GiB

20–24 GB 4

24GB 显存

Radeon RX 7900 XT 20GB (desktop)20 GB GDDR6净预算: 18 GiBGeForce RTX 3090 24GB (desktop)24 GB GDDR6X净预算: 22 GiBGeForce RTX 4090 24GB (desktop)24 GB GDDR6X净预算: 22 GiBRadeon RX 7900 XTX 24GB (desktop)24 GB GDDR6净预算: 22 GiB

32–80 GB 4

32GB 显存 · 48GB 显存

GeForce RTX 5090 32GB (desktop)32 GB GDDR7净预算: 30 GiBNVIDIA L40S 48GB48GB GDDR6 with ECC净预算: 46 GiBNVIDIA A100 80GB SXM80GB HBM2e净预算: 78 GiBNVIDIA H100 80GB SXM80GB净预算: 78 GiB

统一内存 4

Apple M2 Max 64GB unified (MacBook Pro / Mac Studio)64 GB unified memory净预算: 54 GiBApple M4 Max 128GB unified (MacBook Pro)128 GB unified memory净预算: 116 GiBNVIDIA DGX Spark (GB10, 128 GB unified)128 GB LPDDR5x coherent unified system memory净预算: 112 GiBRyzen AI Max+ 395128 GB LPDDR5x-8000 unified memory净预算: 96 GiB