Skip to content
Local AI Wizard
Your machine
Theme

RTX 4090 vs Radeon RX 7900 XTX

RTX 4090 · 24 GB VRAM and Radeon RX 7900 XTX · 24 GB VRAM side by side for local AI.

Facts from both hardware pages

RTX 4090 vs Radeon RX 7900 XTX: memory, bandwidth, models and prices
SpecificationRTX 4090Radeon RX 7900 XTX
Memory24 GB VRAMDedicated · system RAM does not add · source24 GB VRAMDedicated · system RAM does not add · source
Memory bandwidth1,008 GB/sManufacturer spec · not model speed · source960 GB/sManufacturer spec · not model speed · source
Text · run well129+7 tight fit · 25 run slowly · within 24 GB129+7 tight fit · 25 run slowly · within 24 GB
Vision · run well126+7 tight fit · within 24 GB126+7 tight fit · within 24 GB
Image · within memory53within 24 GB · documented paths and minimums53within 24 GB · documented paths and minimums
Video · within memory30within 24 GB · documented paths and minimums29within 24 GB · documented paths and minimums
Audio · within memory128within 24 GB · documented paths and minimums128within 24 GB · documented paths and minimums
Embeddings · within memory90within 24 GB · 8-bit estimate90within 24 GB · 8-bit estimate
Published speed runs1313 on this machine11 on this machine
Launch price (MSRP)USD 1,599US · dated 2022-10-12 · not a tracked offer · sourceUSD 999US · dated 2022-12-13 · not a tracked offer · source
Where to buyNo manufacturer store link on fileAMD Shop (retailer list)choose the configuration there · US · recorded 2026-10-18 · store link

Counts use the same memory estimate as each hardware page: text and vision run well within the fast memory (tight fits counted apart); image, video and audio use documented paths and publisher minimums. Formulas

Top text models each runs well

The first 5 rows of each hardware page's Text list, in its order: LiveBench score, then reviewed models, then Hub downloads. Memory is the planning estimate on that machine.

RTX 4090 vs Radeon RX 7900 XTX: top text models that run well
RankRTX 4090Radeon RX 7900 XTX
#1Smaug MiniAbacus AI · LiveBench 76.9 · ~23 GBSmaug MiniAbacus AI · LiveBench 76.9 · ~23 GB
#2Qwen3.8 27BAlibaba · LiveBench 75.3 · ~23 GBQwen3.8 27BAlibaba · LiveBench 75.3 · ~23 GB
#3Qwen3.6 27BAlibaba · LiveBench 64 · ~23 GBQwen3.6 27BAlibaba · LiveBench 64 · ~23 GB
#4Qwen3 14BAlibaba · ~14 GBQwen3 14BAlibaba · ~14 GB
#5Gemma 4 26B A4BGoogle · ~21 GBGemma 4 26B A4BGoogle · ~21 GB

Measured speed

Published output tokens per second, as measured. A speed is compared only when the same checkpoint, quantization, runtime and lengths ran on both machines themselves; same-chip references are not compared.

No published test ran the same model and settings on both machines.

All published measurements · RTX 409013 on this machine
Published measurements on this hardware
gpt-oss 20B Q4_K_Munsloth/gpt-oss-20b-GGUF/gpt-oss-20b-Q4_K_M…NVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)277.95 ± 1.50Q4_K_M
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
Qwen3-Coder 30B-A3B Q4_K_Munsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF/Q…NVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)265.96 ± 2.53Q4_K_M
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
gpt-oss 20B Q8_0unsloth/gpt-oss-20b-GGUF/gpt-oss-20b-Q8_0.g…NVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)258.4 ± 1.92Q8_0
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
gpt-oss-20b MXFP4gpt-oss-20b-mxfp4.gguf (ggml-org/gpt-oss-20…NVIDIA GeForce RTX 4090 · 24 GB221.95 ± 6.34MXFP4 (native gpt-oss weights)
0 / 128 · Single llama-bench process;…
llama.cpp CUDA
llama.cpp commit a094f38 (6210)
Flash Attention enabled
llama.cpp gpt-oss guide · maintainer result
2026-10-20
Llama 2 7B Q4_0TheBloke/Llama-2-7B-GGUF · llama-2-7b.Q4_0.…NVIDIA GeForce RTX 4090 · 24 GB GDDR6X188.96 ± 0.05Q4_0
0 / 128 · Not reported by llama-bench
CUDA
llama.cpp commit 2241453
Flash Attention enabled
llama.cpp CUDA scoreboard · community result
2026-09-25
Gemma 4 26B-A4B UD-Q4_K_Munsloth/gemma-4-26B-A4B-it-GGUF/gemma-4-26B…NVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)169.27 ± 1.61UD-Q4_K_M
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
Qwen3.5 9B Q4_K_Munsloth/Qwen3.5-9B-GGUF/Qwen3.5-9B-Q4_K_M.g…NVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)141.55 ± 0.58Q4_K_M
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
Gemma 4 12B Q4_K_Munsloth/gemma-4-12b-it-GGUF/gemma-4-12b-it-…NVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)101.95 ± 0.08Q4_K_M
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
Qwen3.5 9B Q8_0unsloth/Qwen3.5-9B-GGUF/Qwen3.5-9B-Q8_0.ggufNVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)95.08 ± 0.13Q8_0
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
Gemma 4 12B Q8_0unsloth/gemma-4-12b-it-GGUF/gemma-4-12b-it-…NVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)64.22 ± 0.09Q8_0
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
Mistral Small 3.2 24B Q4_K_Munsloth/Mistral-Small-3.2-24B-Instruct-2506…NVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)61.56 ± 0.07Q4_K_M
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
Qwen3.6 27B Q4_K_Munsloth/Qwen3.6-27B-GGUF/Qwen3.6-27B-Q4_K_M…NVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)48.38 ± 0.04Q4_K_M
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
Gemma 4 31B Q4_K_Munsloth/gemma-4-31B-it-GGUF/gemma-4-31B-it-…NVIDIA GeForce RTX 4090 · 24 GB (the card's only memory size; rented host)44.42 ± 0.04Q4_K_M
0 / 128 · Single llama-bench process
llama.cpp CUDA
llama.cpp commit 3e4dfa8f3 (b11658)
Flash Attention enabled
Data: Local LLM Advisor (localllmadvisor.com) · CC BY 4.0
2026-10-25
All published measurements · Radeon RX 7900 XTX1 on this machine
Published measurements on this hardware
Llama 2 7B Q4_0Llama 2 7B Q4_0 (scoreboard model; the scor…AMD Radeon RX 7900 XTX · 24 GB GDDR6170.12 ± 0.56Q4_0
0 / 128 · Single llama-bench process;…
ROCm (HIP)
llama.cpp commit 2f0c2db
Flash Attention enabled
llama.cpp ROCm scoreboard · community result
2026-10-25

Verdict

Both have 24 GB VRAM. By the memory estimate, 129 text models run well on each. RTX 4090 lists 1,008 GB/s of memory bandwidth, 1.1× the 960 GB/s of Radeon RX 7900 XTX (a manufacturer spec, not a measured speed). No published test ran the same model and settings on both, so their speeds are not compared here. Launch prices on file: RTX 4090 USD 1,599 (2022-10-12) and Radeon RX 7900 XTX USD 999 (2022-12-13). On these facts neither leads: the same number of text models run well and no shared measurement compares their speed.

Limits and dates

Model counts are memory estimates, not speed measurements or guaranteed fits; verify runtime and checkpoint support. Bandwidth is the manufacturer's figure. Prices are launch or list prices with their dates, not current offers.

Page updated · Model catalog checked · LiveBench 2026-06-25