ReplaySSM
Building on our earlier blog post, Ze-Wei and NVIDIA collaborators released ReplaySSM. This makes inference optimizations like speculative decoding and cache quantization more efficient for hybrid models.
Building on our earlier blog post, Ze-Wei and NVIDIA collaborators released ReplaySSM. This makes inference optimizations like speculative decoding and cache quantization more efficient for hybrid models.