Dust publishes a minimal transformer training implementation without backprop, but remains orders of magnitude from production efficiency.
Next stepWithin one day, run the public single-GPU two-step smoke test, then compare Dust and SGD on the same 1M-token data for loss, memory and forward-pass compute.