Interactive controls are loading. Phone and email links are available.

Skip to main content

AI demand forecasting

Test demand forecasts before changing replenishment

Define the purchasing or planning decision first, then compare candidate forecasts with the current method on later, unseen periods. Keep order changes under staff review until the data, evaluation and operational controls are accepted.

30-minute consultation: free for businesses with 20+ full-time staff; otherwise AUD200 including GST.

What the workflow can include

01

Define the decision and horizon

Choose the item, location, time interval and decision the forecast may inform. Match the forecast horizon to the real lead time and review cycle instead of producing a score that staff cannot use.

02

Audit demand and availability data

Check dates, item and location identifiers, sales, returns, stock availability, closures, promotions, price changes and range changes. Record missing periods and distinguish recorded sales from unconstrained demand.

03

Freeze a baseline and holdout

Document the current forecast or replenishment method. Fit candidate methods only on earlier data, reserve later periods for evaluation and prevent future prices, promotions, weather or stock information leaking into past predictions.

04

Score the decisions that matter

Compare baseline and candidate errors at the real horizon, then inspect bias and results by item, location, volume and intermittency. Pre-agree how zero actuals, new items, missing records and business-critical products are treated.

05

Apply replenishment constraints

Test lead times, supplier calendars, pack sizes, minimum quantities, available stock, open orders, shelf life, substitution and service targets. A forecast remains an input to a reviewed ordering rule.

06

Pilot with owners and fallbacks

Start with recommendations, staff approval and an audit trail. Monitor data freshness, overrides, late suppliers and exceptions. Define a fallback to the approved baseline if data, a provider or a connected system is unavailable.

A fictional holdout review record

All names and numbers in this example are invented to show how one baseline and one candidate can be reviewed on the same later periods. No model ran, no stock system is connected and the figures do not predict accuracy, inventory, sales or savings.

Decision
Weekly purchase review for fictional SKU RIVER-12 at one location
Training window
Dates fixed before the holdout period; no later records included
Holdout window
Four invented weeks shown below to demonstrate the review layout
Forecast horizon
One week ahead, aligned to the fictional order decision
Baseline
A documented current method, retained for comparison
Candidate
A proposed method evaluated on the same inputs and dates
Constraints
Lead time, pack size, minimum order, available stock and staff approval still apply
Release status
Example only; no forecast, order, saving or availability result has been produced
Invented one-week-ahead values for layout testing
Holdout periodActual unitsBaselineCandidateReview note
Week 1118121116Candidate closer by 1 unit
Week 29591101Baseline closer by 2 units
Week 3134130130Equal absolute error
Week 4808486Baseline closer by 2 units

Evaluation questions

  • Was every candidate prediction created without seeing the holdout actual?
  • Was the same item, location, horizon and data cutoff used for the baseline?
  • Do aggregate scores hide bias or weak results in important segments?
  • Were stockouts, range changes, promotions and missing records reviewed?

For a concise explanation of time-ordered test sets, benchmark methods and why percentage errors are undefined when actual demand is zero, see Forecasting: Principles and Practice (3rd edition).

Replenishment questions

  • Which lead time, open order, pack size and minimum quantity apply?
  • Who can approve, edit or reject a proposed quantity?
  • How are duplicate orders, stale inputs and supplier exceptions blocked?
  • Which baseline runs when the forecast or connected system is unavailable?

Agree the scope before connecting data

Start with a defined workflow and representative examples. The proposal should identify the software, responsibilities, access and acceptance checks. Delivery time and price depend on that scope.

  • Name the decision, horizon, item and location grain, owner and current baseline.
  • Record data sources, permitted uses, quality checks, exclusions and refresh timing.
  • Freeze training and holdout dates plus metrics before comparing candidate methods.
  • Test replenishment constraints, approval thresholds, duplicate protection and fallback behaviour.

Questions about ai demand forecasting

What data is needed to test a demand forecast?

Start with dated sales or usage at the level where a decision will be made, then add stock availability, returns, cancellations, prices, promotions, locations and product changes where they affect the history. Supplier lead times, order packs, minimum quantities and current replenishment rules are also needed if the forecast will inform purchasing. The useful history length depends on the forecast horizon, seasonality and data quality; this page does not assume a universal minimum.

How should a candidate forecast be evaluated?

Keep later periods out of model fitting and compare the candidate with an agreed baseline on those holdout periods. Score the forecast at the actual decision horizon and by relevant item, location and demand segment. Review absolute error, percentage-based measures where valid, bias and operational exceptions. One average score can hide systematic over-ordering, stockout periods or poor results for important products.

Does a better error score prove better inventory results?

No. A statistical score does not include every purchasing constraint, supplier delay, minimum order, expiry risk, substitution or service target. Test how forecast outputs pass through the proposed replenishment rules, and compare the resulting recommendations with the current process before changing orders. Savings, availability and waste must be measured separately using agreed business data.

How are stockouts and zero-sales periods handled?

Zero recorded sales may mean zero demand, unavailable stock, a closed location or missing data. Mark known stockouts and availability gaps before training or evaluation so sold units are not automatically treated as unconstrained demand. Agree how intermittent items, long runs of zero demand and new items will be segmented, scored and handled when evidence is weak.

Can weather, events or promotions be included?

They can be considered when the data is licensed, consistently available and known at the time each forecast would have been produced. Historical evaluation must prevent future information leaking into earlier predictions. Compare the added signal against a baseline and keep it only when it improves the relevant holdout result without creating unacceptable cost, delay or dependency risk.

How do new products or locations get forecast?

A new item or location has limited direct history, so any estimate depends on explicit assumptions or a reviewed comparison group. Document the chosen analogue, launch plan, range, price, channel and uncertainty. Use conservative ordering rules, staff approval and frequent review rather than presenting an untested estimate as measured demand.

Will the system place purchase orders automatically?

That is a separate scope decision. Start with read-only data and recommendations that staff can review. Define supplier constraints, approval thresholds, duplicate-order protection, rollback, audit records and behaviour when data or a connected system is late or unavailable. Enable write actions only after representative testing and named business owners approve them.

How do we start and what does a consultation cost?

Bring one replenishment decision, representative history, the current baseline method and the constraints staff apply today. The 30-minute consultation is free for businesses with 20+ full-time staff; otherwise it is AUD200 including GST. Data preparation, evaluation, implementation, provider usage and ongoing review are scoped and priced after the systems, data and acceptance criteria are understood.