Capacity Forecasting

Why this drives the biggest decisions

At a multi-billion-dollar neocloud, capacity decisions are the largest single decisions the company makes:

• Buying 10,000 H200s at $25k each is a $250M decision.
• Building a new datacenter site is a $500M+ decision.
• Locking a power-purchase agreement at a site is a multi-year financial commitment.
• Reserving NVIDIA allocation requires forecasting demand 12-24 months out.

Every one of these decisions rests on a forecast. The DS function that produces credible forecasts is the function that justifies cap-ex spending.

Demand forecasting

Inputs to demand forecasting:

• Existing customer growth. Trajectory of current accounts' usage.
• Sales pipeline. Expected new commitments with probability weights.
• Renewal probabilities. Risk-adjusted continuation of existing contracts.
• Market signals. Industry-level AI demand indicators.
• Seasonality. Conference deadlines, holidays, fiscal cycles.
• SKU mix shifts. Customer migration from H100 to Blackwell, etc.

Output: expected GPU demand by SKU by region by month over a 12-24 month horizon, with confidence intervals.

Supply planning

Supply side considers:

• NVIDIA allocation timing for new generations.
• Datacenter capacity coming online.
• Power and cooling capacity at each site.
• Lead times for new equipment.
• Provider partner capacity (for hybrid models).
• Existing fleet retirement schedule.

The supply-side modeling is more deterministic than demand but with its own uncertainties (delivery delays, datacenter buildout pace, etc.).

Buy-vs-build decisions

Faced with forecast demand exceeding existing supply, the company has options:

• Buy more GPUs into existing capacity. Quickest but constrained by existing power and cooling.
• Build new datacenter capacity. Slowest but most strategic.
• Partner / lease capacity. Faster but less margin.
• Decline incremental customers. Walk away from demand the company can't profitably serve.

The DS-supported decision matrix takes forecasts, cost data, and strategic priorities and produces recommended actions. Leadership decides; DS quantifies the tradeoffs.

Uncertainty quantification

Forecasts that don't quantify uncertainty mislead. Methods:

• Bayesian forecasting with explicit posterior distributions.
• Scenario modeling (bull / base / bear cases).
• Monte Carlo simulation across assumption ranges.
• Confidence intervals on point forecasts.
• Stress testing against adverse scenarios.

The DS communication to leadership emphasizes the uncertainty as much as the central estimate. Decisions are made under uncertainty; pretending otherwise is harmful.

Methods used

The forecasting toolkit:

• Time-series methods (ARIMA, Prophet, neural-forecasting) for established trend extrapolation.
• Hierarchical Bayesian models for borrowing strength across segments.
• Pipeline-stage models for sales-pipeline forecasting.
• Survival analysis for renewal probability.
• Causal models when interventions (pricing changes, marketing pushes) interact with forecasts.
• Ensemble methods to combine the above.

Takeaway

Capacity forecasting is one of the most consequential DS investments at any neocloud. The forecasts drive billions in cap-ex. The DS function that does this well shapes the company's strategic trajectory. The next chapter examines marketplace ranking and matching — different scale but high impact for marketplace neoclouds specifically.