Apple Silicon MLX Studio • Official Evaluation

DiffusionBear v0.4.1 vs Baseline Benchmark

Comprehensive comparative benchmark measuring step latency, JIT-compiled scheduler throughput (@mx.compile), Fast compiled VAE decoders, and Metal memory efficiency on Apple Silicon (M1 16GB).

Average Latency Speedup
+12.2%
Peak: +59.4% (Krea 2 Turbo 13B (4s))
Total Computation Time
11h 11m 36s
40,296.53s across 187 runs • avg 215.5s
Completed Generations
187 / 187
100% benchmark suite finished
Evaluated Configurations
17
Across FLUX, Krea, DiT, and SDXL families
Unified Memory Bound
10.88 GB
Zero host swap • Clean daemon lifecycle
⚡ Computational Time by Model Architecture Total Suite Compute: 11h 11m 36s (40,296.5s • 11.19 hours)
DiT / Next-Gen (44) 62.6%
7h 00m 28s
25,228.9s • MOSS (25s), Qwen 2.1, Z-Image
FLUX Family (77) 18.7%
2h 05m 20s
7,520.8s • FLUX.1, FLUX.2, FLUX.3
Krea 2 Turbo (22) 13.3%
1h 29m 10s
5,351.0s • Wan2.1 4-step & 8-step
SDXL Family (44) 5.4%
36m 35s
2,195.9s • Lightning, Hyper-SD, Pony
187/187 Complete (100%)
Model & Engine Scene / Prompt Res & Steps Sept Baseline v0.4.1 Latency Speedup Delta Visual Parity
FLUX.1-schnell mflux FlowMatch (12B)
🏔️ 1. Scandinavian Fjord
 512×768 4s — 82.36s v0.4.1 Baseline
FLUX.1-schnell mflux FlowMatch (12B)
🕰️ 2. Master Watchmaker
 512×768 4s — 79.77s v0.4.1 Baseline
FLUX.1-schnell mflux FlowMatch (12B)
🏡 3. Modern Glass Villa
 512×768 4s — 79.64s v0.4.1 Baseline
FLUX.1-schnell mflux FlowMatch (12B)
🐆 4. Snow Leopard
 512×768 4s — 79.91s v0.4.1 Baseline
FLUX.1-schnell mflux FlowMatch (12B)
🏍️ 5. Vintage Cafe Racer
 512×768 4s — 79.85s v0.4.1 Baseline
FLUX.1-schnell mflux FlowMatch (12B)
🐝 6. Honeybee Macro
 512×768 4s — 80.07s v0.4.1 Baseline
FLUX.1-schnell mflux FlowMatch (12B)
🌕 7. Lunar Biodome
 512×768 4s — 79.79s v0.4.1 Baseline
FLUX.1-schnell mflux FlowMatch (12B)
🗿 8. Moss Stone Golem
 512×768 4s — 79.99s v0.4.1 Baseline
FLUX.1-schnell mflux FlowMatch (12B)
🥖 9. Rustic Sourdough
 512×768 4s — 79.89s v0.4.1 Baseline
FLUX.1-schnell mflux FlowMatch (12B)
🪐 10. Saturn from Enceladus
 512×768 4s — 79.92s v0.4.1 Baseline
FLUX.1-schnell mflux FlowMatch (12B)
🐻 11. Modern macOS Bear App Icon
 512×512 4s — 55.78s v0.4.1 Baseline
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🏔️ 1. Scandinavian Fjord
 512×768 4s 53.78s 49.21s ↑ +8.5%
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🕰️ 2. Master Watchmaker
 512×768 4s 52.34s 48.69s ↑ +7.0%
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🏡 3. Modern Glass Villa
 512×768 4s 56.07s 48.74s ↑ +13.1%
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🐆 4. Snow Leopard
 512×768 4s 55.21s 48.21s ↑ +12.7%
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🏍️ 5. Vintage Cafe Racer
 512×768 4s 52.41s 48.25s ↑ +7.9%
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🐝 6. Honeybee Macro
 512×768 4s 51.96s 48.27s ↑ +7.1%
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🌕 7. Lunar Biodome
 512×768 4s 52.84s 48.24s ↑ +8.7%
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🗿 8. Moss Stone Golem
 512×768 4s 52.64s 48.52s ↑ +7.8%
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🥖 9. Rustic Sourdough
 512×768 4s 54.65s 47.75s ↑ +12.6%
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🪐 10. Saturn from Enceladus
 512×768 4s 50.89s 47.81s ↑ +6.1%
FLUX.2-klein 4B (4s) mflux FlowMatch (4B)
🐻 11. Modern macOS Bear App Icon
 512×512 4s — 35.10s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🏔️ 1. Scandinavian Fjord
 512×768 8s — 96.26s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🕰️ 2. Master Watchmaker
 512×768 8s — 96.09s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🏡 3. Modern Glass Villa
 512×768 8s — 95.86s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🐆 4. Snow Leopard
 512×768 8s — 95.79s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🏍️ 5. Vintage Cafe Racer
 512×768 8s — 95.83s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🐝 6. Honeybee Macro
 512×768 8s — 95.97s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🌕 7. Lunar Biodome
 512×768 8s — 96.05s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🗿 8. Moss Stone Golem
 512×768 8s — 96.02s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🥖 9. Rustic Sourdough
 512×768 8s — 96.28s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🪐 10. Saturn from Enceladus
 512×768 8s — 96.57s v0.4.1 Baseline
FLUX.2-klein 4B (8s) mflux FlowMatch (4B)
🐻 11. Modern macOS Bear App Icon
 512×512 8s — 70.85s v0.4.1 Baseline
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🏔️ 1. Scandinavian Fjord
 512×768 4s 98.42s 104.49s -6.2%
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🕰️ 2. Master Watchmaker
 512×768 4s 100.59s 104.69s -4.1%
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🏡 3. Modern Glass Villa
 512×768 4s 109.87s 105.20s ↑ +4.3%
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🐆 4. Snow Leopard
 512×768 4s 110.11s 107.01s ↑ +2.8%
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🏍️ 5. Vintage Cafe Racer
 512×768 4s 108.80s 116.75s -7.3%
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🐝 6. Honeybee Macro
 512×768 4s 113.69s 104.76s ↑ +7.9%
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🌕 7. Lunar Biodome
 512×768 4s 109.36s 104.91s ↑ +4.1%
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🗿 8. Moss Stone Golem
 512×768 4s 106.14s 104.71s ↑ +1.3%
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🥖 9. Rustic Sourdough
 512×768 4s 107.82s 104.84s ↑ +2.8%
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🪐 10. Saturn from Enceladus
 512×768 4s 105.62s 105.02s ↑ +0.6%
FLUX.2-klein 9B (4s) mflux FlowMatch (9B)
🐻 11. Modern macOS Bear App Icon
 512×512 4s — 76.78s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🏔️ 1. Scandinavian Fjord
 512×768 8s — 209.71s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🕰️ 2. Master Watchmaker
 512×768 8s — 209.39s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🏡 3. Modern Glass Villa
 512×768 8s — 209.16s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🐆 4. Snow Leopard
 512×768 8s — 209.08s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🏍️ 5. Vintage Cafe Racer
 512×768 8s — 209.04s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🐝 6. Honeybee Macro
 512×768 8s — 208.89s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🌕 7. Lunar Biodome
 512×768 8s — 208.88s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🗿 8. Moss Stone Golem
 512×768 8s — 208.93s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🥖 9. Rustic Sourdough
 512×768 8s — 208.97s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🪐 10. Saturn from Enceladus
 512×768 8s — 208.91s v0.4.1 Baseline
FLUX.2-klein 9B (8s) mflux FlowMatch (9B)
🐻 11. Modern macOS Bear App Icon
 512×512 8s — 154.56s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🏔️ 1. Scandinavian Fjord
 512×768 4s — 56.41s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🕰️ 2. Master Watchmaker
 512×768 4s — 54.62s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🏡 3. Modern Glass Villa
 512×768 4s — 54.53s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🐆 4. Snow Leopard
 512×768 4s — 54.70s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🏍️ 5. Vintage Cafe Racer
 512×768 4s — 54.88s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🐝 6. Honeybee Macro
 512×768 4s — 54.79s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🌕 7. Lunar Biodome
 512×768 4s — 54.88s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🗿 8. Moss Stone Golem
 512×768 4s — 55.22s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🥖 9. Rustic Sourdough
 512×768 4s — 56.80s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🪐 10. Saturn from Enceladus
 512×768 4s — 54.73s v0.4.1 Baseline
FLUX.3-klein 5.6B (4s) mflux FlowMatch (5.6B)
🐻 11. Modern macOS Bear App Icon
 512×512 4s — 35.45s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🏔️ 1. Scandinavian Fjord
 512×768 8s — 106.46s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🕰️ 2. Master Watchmaker
 512×768 8s — 106.12s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🏡 3. Modern Glass Villa
 512×768 8s — 106.14s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🐆 4. Snow Leopard
 512×768 8s — 106.31s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🏍️ 5. Vintage Cafe Racer
 512×768 8s — 106.50s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🐝 6. Honeybee Macro
 512×768 8s — 106.32s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🌕 7. Lunar Biodome
 512×768 8s — 106.10s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🗿 8. Moss Stone Golem
 512×768 8s — 106.88s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🥖 9. Rustic Sourdough
 512×768 8s — 109.81s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🪐 10. Saturn from Enceladus
 512×768 8s — 110.45s v0.4.1 Baseline
FLUX.3-klein 5.6B (8s) mflux FlowMatch (5.6B)
🐻 11. Modern macOS Bear App Icon
 512×512 8s — 70.64s v0.4.1 Baseline
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🏔️ 1. Scandinavian Fjord
 512×768 4s 376.21s 152.57s ↑ +59.4%
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🕰️ 2. Master Watchmaker
 512×768 4s 390.52s 163.34s ↑ +58.2%
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🏡 3. Modern Glass Villa
 512×768 4s 243.79s 174.67s ↑ +28.4%
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🐆 4. Snow Leopard
 512×768 4s 193.29s 180.31s ↑ +6.7%
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🏍️ 5. Vintage Cafe Racer
 512×768 4s 213.71s 178.64s ↑ +16.4%
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🐝 6. Honeybee Macro
 512×768 4s 229.51s 175.25s ↑ +23.6%
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🌕 7. Lunar Biodome
 512×768 4s 207.75s 196.45s ↑ +5.4%
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🗿 8. Moss Stone Golem
 512×768 4s 220.88s 164.54s ↑ +25.5%
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🥖 9. Rustic Sourdough
 512×768 4s 208.70s 187.42s ↑ +10.2%
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🪐 10. Saturn from Enceladus
 512×768 4s 223.94s 186.44s ↑ +16.7%
Krea 2 Turbo 13B (4s) Wan2.1 Distilled (13B)
🐻 11. Modern macOS Bear App Icon
 512×512 4s — 166.79s v0.4.1 Baseline
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🏔️ 1. Scandinavian Fjord
 512×768 8s 423.90s 309.81s ↑ +26.9%
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🕰️ 2. Master Watchmaker
 512×768 8s 398.30s 321.07s ↑ +19.4%
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🏡 3. Modern Glass Villa
 512×768 8s 400.20s 324.88s ↑ +18.8%
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🐆 4. Snow Leopard
 512×768 8s 414.20s 340.60s ↑ +17.8%
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🏍️ 5. Vintage Cafe Racer
 512×768 8s 444.90s 313.67s ↑ +29.5%
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🐝 6. Honeybee Macro
 512×768 8s 391.00s 355.31s ↑ +9.1%
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🌕 7. Lunar Biodome
 512×768 8s 318.50s 309.17s ↑ +2.9%
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🗿 8. Moss Stone Golem
 512×768 8s 306.60s 313.49s -2.2%
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🥖 9. Rustic Sourdough
 512×768 8s 313.20s 314.78s -0.5%
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🪐 10. Saturn from Enceladus
 512×768 8s 278.20s 303.91s -9.2%
Krea 2 Turbo 13B (8s) Wan2.1 Native (13B)
🐻 11. Modern macOS Bear App Icon
 512×512 8s — 217.87s v0.4.1 Baseline
Z-Image Turbo 6B mflux FlowMatch (6B)
🏔️ 1. Scandinavian Fjord
 512×768 8s 189.13s 125.07s ↑ +33.9%
Z-Image Turbo 6B mflux FlowMatch (6B)
🕰️ 2. Master Watchmaker
 512×768 8s 196.02s 124.50s ↑ +36.5%
Z-Image Turbo 6B mflux FlowMatch (6B)
🏡 3. Modern Glass Villa
 512×768 8s 176.01s 126.86s ↑ +27.9%
Z-Image Turbo 6B mflux FlowMatch (6B)
🐆 4. Snow Leopard
 512×768 8s 164.91s 126.05s ↑ +23.6%
Z-Image Turbo 6B mflux FlowMatch (6B)
🏍️ 5. Vintage Cafe Racer
 512×768 8s 161.73s 124.21s ↑ +23.2%
Z-Image Turbo 6B mflux FlowMatch (6B)
🐝 6. Honeybee Macro
 512×768 8s 166.74s 124.60s ↑ +25.3%
Z-Image Turbo 6B mflux FlowMatch (6B)
🌕 7. Lunar Biodome
 512×768 8s 160.21s 124.17s ↑ +22.5%
Z-Image Turbo 6B mflux FlowMatch (6B)
🗿 8. Moss Stone Golem
 512×768 8s 161.22s 124.63s ↑ +22.7%
Z-Image Turbo 6B mflux FlowMatch (6B)
🥖 9. Rustic Sourdough
 512×768 8s 165.33s 123.63s ↑ +25.2%
Z-Image Turbo 6B mflux FlowMatch (6B)
🪐 10. Saturn from Enceladus
 512×768 8s 163.12s 124.04s ↑ +24.0%
Z-Image Turbo 6B mflux FlowMatch (6B)
🐻 11. Modern macOS Bear App Icon
 512×512 8s — 77.42s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🏔️ 1. Scandinavian Fjord
 512×768 25s — 1219.30s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🕰️ 2. Master Watchmaker
 512×768 25s — 1620.89s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🏡 3. Modern Glass Villa
 512×768 25s — 1565.73s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🐆 4. Snow Leopard
 512×768 25s — 1588.73s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🏍️ 5. Vintage Cafe Racer
 512×768 25s — 1585.18s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🐝 6. Honeybee Macro
 512×768 25s — 1665.50s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🌕 7. Lunar Biodome
 512×768 25s — 1638.90s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🗿 8. Moss Stone Golem
 512×768 25s — 1516.00s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🥖 9. Rustic Sourdough
 512×768 25s — 1642.88s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🪐 10. Saturn from Enceladus
 512×768 25s — 1660.11s v0.4.1 Baseline
MOSS-Image SFT 5B DiT FlowMatch (5B)
🐻 11. Modern macOS Bear App Icon
 512×512 25s — 1242.81s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🏔️ 1. Scandinavian Fjord
 512×768 8s — 174.18s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🕰️ 2. Master Watchmaker
 512×768 8s — 227.26s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🏡 3. Modern Glass Villa
 512×768 8s — 212.71s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🐆 4. Snow Leopard
 512×768 8s — 211.02s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🏍️ 5. Vintage Cafe Racer
 512×768 8s — 200.32s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🐝 6. Honeybee Macro
 512×768 8s — 195.64s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🌕 7. Lunar Biodome
 512×768 8s — 213.85s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🗿 8. Moss Stone Golem
 512×768 8s — 205.32s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🥖 9. Rustic Sourdough
 512×768 8s — 197.77s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🪐 10. Saturn from Enceladus
 512×768 8s — 194.61s v0.4.1 Baseline
Qwen-Image 2.1 Turbo mflux Qwen Turbo (q4)
🐻 11. Modern macOS Bear App Icon
 512×512 8s — 143.63s v0.4.1 Baseline
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🏔️ 1. Scandinavian Fjord
 512×768 20s 457.90s 422.64s ↑ +7.7%
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🕰️ 2. Master Watchmaker
 512×768 20s 454.20s 438.72s ↑ +3.4%
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🏡 3. Modern Glass Villa
 512×768 20s 430.20s 457.68s -6.4%
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🐆 4. Snow Leopard
 512×768 20s 440.30s 452.56s -2.8%
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🏍️ 5. Vintage Cafe Racer
 512×768 20s 459.00s 445.77s ↑ +2.9%
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🐝 6. Honeybee Macro
 512×768 20s 475.30s 446.30s ↑ +6.1%
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🌕 7. Lunar Biodome
 512×768 20s 484.90s 449.33s ↑ +7.3%
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🗿 8. Moss Stone Golem
 512×768 20s 452.20s 440.53s ↑ +2.6%
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🥖 9. Rustic Sourdough
 512×768 20s 477.20s 451.52s ↑ +5.4%
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🪐 10. Saturn from Enceladus
 512×768 20s 446.40s 464.45s -4.0%
Qwen-Image 2.1 (20s) mflux Qwen (q4)
🐻 11. Modern macOS Bear App Icon
 512×512 20s — 311.90s v0.4.1 Baseline
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🏔️ 1. Scandinavian Fjord
 512×768 4s 11.25s 10.56s ↑ +6.1%
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🕰️ 2. Master Watchmaker
 512×768 4s 9.35s 9.30s ↑ +0.5%
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🏡 3. Modern Glass Villa
 512×768 4s 9.39s 9.20s ↑ +2.0%
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🐆 4. Snow Leopard
 512×768 4s 9.29s 9.19s ↑ +1.1%
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🏍️ 5. Vintage Cafe Racer
 512×768 4s 9.79s 9.17s ↑ +6.3%
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🐝 6. Honeybee Macro
 512×768 4s 9.51s 9.15s ↑ +3.8%
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🌕 7. Lunar Biodome
 512×768 4s 9.48s 9.20s ↑ +3.0%
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🗿 8. Moss Stone Golem
 512×768 4s 9.43s 9.17s ↑ +2.8%
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🥖 9. Rustic Sourdough
 512×768 4s 9.66s 9.18s ↑ +5.0%
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🪐 10. Saturn from Enceladus
 512×768 4s 10.18s 9.15s ↑ +10.1%
Juggernaut XL Lightning SDXL Lightning (MLX 4s)
🐻 11. Modern macOS Bear App Icon
 512×512 4s — 6.37s v0.4.1 Baseline
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🏔️ 1. Scandinavian Fjord
 512×768 8s 45.91s 44.36s ↑ +3.4%
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🕰️ 2. Master Watchmaker
 512×768 8s 44.12s 44.02s ↑ +0.2%
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🏡 3. Modern Glass Villa
 512×768 8s 43.82s 44.14s -0.7%
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🐆 4. Snow Leopard
 512×768 8s 43.38s 42.51s ↑ +2.0%
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🏍️ 5. Vintage Cafe Racer
 512×768 8s 44.29s 46.87s -5.8%
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🐝 6. Honeybee Macro
 512×768 8s 45.57s 43.77s ↑ +3.9%
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🌕 7. Lunar Biodome
 512×768 8s 43.73s 40.90s ↑ +6.5%
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🗿 8. Moss Stone Golem
 512×768 8s 41.10s 40.91s ↑ +0.5%
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🥖 9. Rustic Sourdough
 512×768 8s 38.94s 41.89s -7.6%
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🪐 10. Saturn from Enceladus
 512×768 8s 38.43s 41.72s -8.6%
Juggernaut XI v11 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🐻 11. Modern macOS Bear App Icon
 512×512 8s — 29.66s v0.4.1 Baseline
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🏔️ 1. Scandinavian Fjord
 512×768 8s 39.29s 48.05s -22.3%
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🕰️ 2. Master Watchmaker
 512×768 8s 38.33s 42.16s -10.0%
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🏡 3. Modern Glass Villa
 512×768 8s 38.23s 45.31s -18.5%
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🐆 4. Snow Leopard
 512×768 8s 38.62s 49.99s -29.4%
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🏍️ 5. Vintage Cafe Racer
 512×768 8s 39.69s 43.55s -9.7%
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🐝 6. Honeybee Macro
 512×768 8s 41.14s 43.15s -4.9%
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🌕 7. Lunar Biodome
 512×768 8s 46.74s 43.00s ↑ +8.0%
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🗿 8. Moss Stone Golem
 512×768 8s 44.42s 43.25s ↑ +2.6%
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🥖 9. Rustic Sourdough
 512×768 8s 45.05s 43.38s ↑ +3.7%
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🪐 10. Saturn from Enceladus
 512×768 8s 44.88s 41.40s ↑ +7.8%
RealVisXL V5.0 (Hyper-SD) SDXL Hyper-SD (MLX 8s)
🐻 11. Modern macOS Bear App Icon
 512×512 8s — 27.55s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🏔️ 1. Scandinavian Fjord
 512×768 25s — 111.61s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🕰️ 2. Master Watchmaker
 512×768 25s — 109.81s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🏡 3. Modern Glass Villa
 512×768 25s — 118.54s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🐆 4. Snow Leopard
 512×768 25s — 114.59s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🏍️ 5. Vintage Cafe Racer
 512×768 25s — 115.51s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🐝 6. Honeybee Macro
 512×768 25s — 111.31s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🌕 7. Lunar Biodome
 512×768 25s — 105.86s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🗿 8. Moss Stone Golem
 512×768 25s — 103.07s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🥖 9. Rustic Sourdough
 512×768 25s — 103.26s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🪐 10. Saturn from Enceladus
 512×768 25s — 102.83s v0.4.1 Baseline
Pony Diffusion V6 XL SDXL Astralite (MLX 25s)
🐻 11. Modern macOS Bear App Icon
 512×512 25s — 68.31s v0.4.1 Baseline
TOTAL (ALL 17 CONFIGS) 187 Benchmark Generations 512×768 / 512 4h 10m 25s 11h 11m 36s ↑ +12.2% —