11 July 2026 · Tel Aviv
What is actually on the bench.
A hand-curated record of the current focus and public open loops. This is intentionally dated; it is a working state, not a claim of permanent priority.
Make the MTP drafter smaller than the overhead it is meant to remove.
The primary study is StudentSV: a half-width MTP block with its own 32,768-token output head, trained for the real speculative-decoding path instead of inheriting the target model's full 248,320-row projection.
The current run retains 78% of the windowed teacher's code acceptance at roughly 13% of its estimated draft FLOPs. That is a reason to scale the experiment, not yet a speedup claim. The next gate is recursive acceptance and measured end-to-end wall time.
- Subject
- Qwen3.5-9B · co-trained MTP → StudentSV
- Methods
- Small-vocabulary head · half-width block · replay acceptance
- Standard
- Separate training signal, acceptance, FLOPs, and measured wall time.
- Working paper
- Version 0.2 · experiments active ↗
The studies and systems that keep touching each other.
The model experiments need a runtime, and the runtime keeps generating better research questions. These are the nearest active loops.
The Rust + CUDA inference engine that exposes the real costs of MTP drafting, verification, quantization, expert spill, and Blackwell kernel choices.
public · active B / compression REAP × quantMoving from a validated prune-heal-NVFP4 sequence toward physical REAP50 artifacts and multiple precision tiers for surviving experts.
working paper 02 C / review revutoA local PR reviewer that learns from maintainer feedback, with the model supplier and repository kept replaceable.
updated 09 Jul D / maintain Valkey GLIDEReview, API and reliability work across a large multi-language client, plus the support and release details that never appear in feature lists.
maintainerFinished work, waiting on maintainers.
Authored changes that are complete and sitting in review at the projects they target—not an activity feed.
Issues that are really research prompts.
The issue tracker is often where a vague irritation becomes a falsifiable question.