Gemma 4 runs on the cheapest GPU SageMaker sells, an NVIDIA T4, but only after a Triton patch works around a shared-memory limit that stops vLLM 0.30.0 cold. Decoding lands at 0.77x to 0.82x of an L4, with identical answers and a 12B ceiling on model size.

— via dev.to, xbill