Situation

Want To Deploy vLLM On Cloud Run To Serve An LLM. Two Paths: GPU Mode (For Real Service) Or CPU Mode (For Tiny Model / Architecture Test Only). Both Fully Tested End To End.

Result First:

GPU Mode CPU Mode
Support Level GA Experimental
Tested Model Gemma-4-E2B-it (L4) Qwen2.5-0.5B-Instruct
Response Time 6.1s 114s
Build Effort Low, Use Official Image High, ~56 Min Multi-Stage Build
Use Case Real Service, Demo Architecture Test Only

GPU Is About 19x Faster Than CPU. CPU Mode Works, But Don’t Expect Speed.

Continue reading

Situation

Was Adding An HTTPS Listener To The PRD GKE Gateway. helm upgrade Got Stuck On A Field Manager Conflict, So I Threw --server-side --force-conflicts At It To Push Through — And It Wiped The Entire myApp Namespace (Deployment / Pod / Service / HPA / Secret, All Gone). Recovery Worked, No Data Lost, But The Mechanism Is Worth Understanding Properly, Or I’ll Walk Into It Again.

Continue reading

Author's picture

Gordon wei

Stay Hungry Stay Foolish

iKala Cloud Solution Engineer | AWS Community Builders

Taiwan