rawmark — real hardware benchmarks

BIFROST GPU AMD Radeon RX 9070 XT 16GB RDNA4 · OS Windows 11 Pro · ROCm 7.1 gfx1201

MODEL	BACKEND	PROMPT	OUTPUT	TOK/S	HARDWARE
qwen3:14b	ollama	25	256	23.5	bifrost
qwen3:14b	ollama	25	256	52.7	bifrost

UNKNOWN GPU AMD Radeon RX 9070 XT 16GB RDNA4 · OS Windows 11 Pro · ROCm 7.1 gfx1201 (HIP SDK 7.1.1)

MODEL	PROMPT	OUTPUT	TOK/S
qwen3:14b	47	256	55.4
qwen3:14b	47	256	8.5
gemma4:e4b	47	256	31.3
gemma4:e4b	47	256	16.6

FORGE-NPU GPU XDNA2 NPU � 0W GPU draw · OS Ubuntu 24.04 · ROCm FLM NPU

MODEL	BACKEND	PROMPT	OUTPUT	TOK/S	HARDWARE
qwen3:1.7b	ollama	28	256	35.9	forge-npu
qwen3:1.7b	ollama	28	256	36.9	forge-npu

192.168.2.50 GPU 7.2 gfx1151 · OS Ubuntu 24.04 · ROCm 7.2 gfx1151

MODEL	BACKEND	PROMPT	OUTPUT	TOK/S
bifrost-t2-qwen3	ollama	47	2012	63.1
bifrost-t2-qwen3	ollama	154	4501	60.3
bifrost-t2-qwen3	ollama	47	2094	62.8
bifrost-t2p5-r1	ollama	36	961	5.0
bifrost-t2p5-r1	timed out
bifrost-t2p5-r1	timed out
Qwen3-1.7B-GGUF	lemonade	19	512	131.8
Qwen3-1.7B-GGUF	lemonade	126	512	128.4