Overview
The paper is a practical review with vendor data and multiple industry case studies, so recommendations are directly actionable but rely on vendor-reported numbers and market snapshots.
Citations4
Evidence Strength0.75
Confidence0.85
Risk Signals9
Trust Signals
Findings with numeric evidence: 7/7
Findings with evidence refs: 7/7
Results with explicit delta: 5/5
Reproducibility
Status: No open assets linked
Open source: Unknown
At A Glance
Cost impact: 90%
Production readiness: 80%
Novelty: 40%
Why It Matters For Business
Cloud and AI costs can be the largest operational line items; small architecture and model choices can cut spend by tens to hundreds of percent while preserving user experience.
Who Should Care
Summary TLDR
This review maps concrete techniques to lower cloud and AI infrastructure spend. Key levers: pick the right instance types (ARM/Graviton vs x86), use reserved/spot commitments, apply model quantization and mixed-precision, route queries to smaller models, batch and cache inference, and apply FinOps practices. Case studies (Prime Video, Pinterest, Baselime, Netflix) show real savings from ~28% up to 90% depending on the change. The paper bundles vendor pricing snapshots, quantization gains, and practical trade-offs.
Problem Statement
Cloud and AI workloads are expensive and fast-changing. Organizations struggle to predict and control bills because GPU costs, data egress, and model inference scale differently than typical web services. The paper collects proven tactics and industry examples to help teams reduce spend while keeping performance.
Main Contribution
Catalog of cloud pricing models and when to use them (on-demand, reserved, spot, savings plans, hybrid, tiered)
Practical AI cost levers: GPU instance selection, quantization, batching, model routing, caching, and FinOps practices
Key Findings
GPU compute often dominates early AI budgets.
LLM inference cost fell dramatically since 2021.
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| Prime Video audio-video monitoring cost | 90% reduction | prior microservices + S3 + Step Functions costs | 90% lower | Prime Video case study | Sec 5.1 describes monolith re-architecture and cost drop to 10% of prior | Sec 5.1 |
| Baselime total cloud cost | >80% reduction | AWS-based stack | >80% lower after migration | Baselime→Cloudflare case study | Sec 5.3 migration replaced Lambda+Kinesis+EC2 with Cloudflare Workers and analytics engine | Sec 5.3 |
What To Try In 7 Days
Measure GPU utilization and tag spend by model and team
Run a quick A/B: route simple queries to a cheaper model for 1 service
Enable batching and a short-term cache for repetitive inference calls
Optimization Features
Token Efficiency
Infra Optimization
Model Optimization
System Optimization
Training Optimization
Inference Optimization
Reproducibility
Risks & Boundaries
Limitations
Review relies on vendor/industry reports and pricing snapshots that change frequently
Savings depend heavily on workload patterns; quoted percentages are case-specific
When Not To Use
When exact current billing or compliance proofs are required (pricing is time-sensitive)
For mission-critical low-latency paths where spot interruptions or quantization risk are unacceptable
Failure Modes
Spot instance interruption causing job restarts without checkpointing
Quantization or smaller models producing unacceptable accuracy loss