Situation
Want To Deploy vLLM On Cloud Run To Serve An LLM. Two Paths: GPU Mode (For Real Service) Or CPU Mode (For Tiny Model / Architecture Test Only). Both Fully Tested End To End.
Result First:
| GPU Mode | CPU Mode | |
|---|---|---|
| Support Level | GA | Experimental |
| Tested Model | Gemma-4-E2B-it (L4) | Qwen2.5-0.5B-Instruct |
| Response Time | 6.1s | 114s |
| Build Effort | Low, Use Official Image | High, ~56 Min Multi-Stage Build |
| Use Case | Real Service, Demo | Architecture Test Only |
GPU Is About 19x Faster Than CPU. CPU Mode Works, But Don’t Expect Speed.