Issues

• Windows (CUDA) build available: prebuilt zip and launchers

  enhancement
  freriadoc/Avalon#42 · Filter by author newmilltechnology opened on Nov 8, 2026

• Eval bug: MTP: first verification pass after a short first prompt hangs in moe_hosted_plan's defer wait

  freriadoc/Avalon#40 · Filter by author newmilltechnology opened on Nov 7, 2026

• Windows + CUDA: server hangs at the first graph execution with the MoE expert cache on (GPU 100 %, /health 503); MOE_CACHE_MODE=off serves at 4.4 t/s

  freriadoc/Avalon#37 · Filter by author rueyke-lang opened on Nov 7, 2026
  2

• Misc. bug: general report on difficulties running on dual xtx 7900

  freriadoc/Avalon#36 · Filter by author kylebakerio opened on Nov 6, 2026
  1

• Misc. bug: Please consider to add support for Ivy Bridge / AVX | error: the CPU has no AVX2: the experts computed on the CPU need it

  freriadoc/Avalon#35 · Filter by author CycleAndCode opened on Nov 5, 2026

• Windows 11, RX 7900 XTX, 48 GB RAM: first request very slow, long prompts page heavily

  freriadoc/Avalon#34 · Filter by author The-Dude-2020 opened on Nov 5, 2026

• Windows HIP build fails: close() undeclared in moe-cache.cu (arena is Linux-only)

  freriadoc/Avalon#33 · Filter by author The-Dude-2020 opened on Nov 5, 2026
  1

• CUDA build fails for Pascal (sm_61): __nanosleep is undefined in moe-cache.cu

  freriadoc/Avalon#28 · Filter by author bugsysBugs opened on Nov 5, 2026

• gfx1030 (RX 6800 XT): hard system reset right after moe-cache borrow when a new, shorter prompt follows a ~23k one

  freriadoc/Avalon#27 · Filter by author bilboquet opened on Nov 4, 2026
  8

• Misc. bug: Two RX 7900 XT without P2P: crash found and fixed, speed limited by host syncs

  freriadoc/Avalon#26 · Filter by author NaifuKishi opened on Nov 4, 2026

• Benchmark: 5900X + 7900 XTX, PCIe 3.0, 64 GB DDR4 3600, on ROCm 10.1

  freriadoc/Avalon#25 · Filter by author sa20001 opened on Nov 3, 2026
  5

• Feature Request: n-gram table residency (disk vs RAM) for the ngram-* speculative types

  enhancement
  freriadoc/Avalon#24 · Filter by author Creazy-chen opened on Nov 3, 2026

• Eval bug: gfx1030 (V620), ROCm 7.1, third-party GSQ-RCO quant

  freriadoc/Avalon#23 · Filter by author Cukrus-directive opened on Nov 3, 2026
  1

• Misc. bug: --fit and default load mode assert on an APU (gfx1151) because the ROCm device reports no mmap_support

  freriadoc/Avalon#22 · Filter by author pato6013 opened on Nov 3, 2026

• Eval bug: abort on NVIDIA 3090: GGML_ASSERT(!mask_tiles || tile_shape) failed

  freriadoc/Avalon#21 · Filter by author ping235 opened on Nov 3, 2026
  4

• Two RX 7900 XTX: GPU page fault (PERMISSION_FAULTS) on the first GPU at load in every multi-GPU mode, a91372e and c24c03d

  freriadoc/Avalon#20 · Filter by author matthewlenz opened on Nov 3, 2026
  4

• CUDA abort: too many resources requested for launch on RTX 3090 with the README launch line and the MTP draft

  freriadoc/Avalon#19 · Filter by author mrq1911 opened on Nov 2, 2026
  1

• Research: AValon withspeculative decoding

  freriadoc/Avalon#18 · Filter by author rocktboy1982 opened on Nov 2, 2026
  1

• llama-imatrix on a >RAM-experts model: livelock with the expert cache (any budget), segfault with --moe-cache off

  freriadoc/Avalon#17 · Filter by author yar3333 opened on Nov 2, 2026
  2

• Hosted MoE on multiple GPUs aborts (illegal memory access) on 9617344db, livelocks in cache-fill on a91372eb6

  freriadoc/Avalon#16 · Filter by author yar3333 opened on Nov 2, 2026
  2

• gfx1201 (RX 9070 XT, 16 GB): default flags OOM during prefill; 128k works with a reserve, decode stays at ~40 t/s with the GPU at 100%

  enhancement
  freriadoc/Avalon#14 · Filter by author Thxeverybody opened on Nov 1, 2026
  2

• MTP draft head with ~4 bpw targets: acceptance drops to ~0.59; third-party heads abort in graph capture

  freriadoc/Avalon#11 · Filter by author yar3333 opened on Nov 1, 2026
  5

• gfx1201 (R9700 / RDNA4, native Windows): benchmark data + kernel-tuning request

  freriadoc/Avalon#10 · Filter by author paq85 opened on Nov 1, 2026

• Eval bug: ROCm error: invalid device function

  freriadoc/Avalon#9 · Filter by author runningman84 opened on Oct 31, 2026
  4

• Windows port merged (thanks @ppkrol), a few tests on the current main

  freriadoc/Avalon#6 · Filter by author freriadoc opened on Oct 31, 2026