
Sweet Spot on a Cheap Cloud GPU: MoE, Vision Ceilings, and VRAM Budgeting
117 tokens per second from a “35-billion-parameter” model on a $0.27/hr GPU. The counterintuitive part: a smaller 27B model on the same GPU manages 33 tok/s — about 3.5× slower. The difference is not the parameter count on the spec sheet. It is how many of those parameters actually fire on every token.
This is the story of an afternoon spent learning to read a VRAM budget — and why “it fits” is the wrong question to ask.






