Read the calibration results

How to tell whether the calibrated model is accurate enough, using its goodness of fit.

Where: Home › Baseline Controller › Stats and the top of the Benchmark page

Goodness of fit

If a model is calibrated within the threshold limits, it is considered sufficiently accurate in simulating the physical reality it is intended to represent. These thresholds are a preliminary guide for the building calibration and should not be treated as absolute values. The statistical indices here relate only to the predicted building energy consumption.

  • CV(RMSE) - How much the model’s hourly or monthly values scatter around the measured values.
  • NMBE - Whether the model uses more or less energy than measured, on average.

Hourly calibration

Threshold limits of statistical criteria for calibration:

Statistical IndicesASHRAE Guideline 14IPMVPFEMP
NMBE [%]±10±5±10
CV(RMSE) [%]302030
CV(RMSE)Less than 20%Between 20% and 30%Greater than 30%
CalibrationGood-fittingAcceptableNot acceptable
Required procedureNot requiredNot requiredDouble-check meter data and user inputs and then rerun a calibration

Monthly calibration

Threshold limits of statistical criteria for calibration:

Statistical IndicesASHRAE Guideline 14IPMVPFEMP
NMBE [%]±5±20±5
CV(RMSE) [%]15-15
CV(RMSE)Less than 8%Between 8% and 15%Greater than 15%
CalibrationGood-fittingAcceptableNot acceptable
Required procedureNot requiredNot requiredDouble-check meter data and user inputs and then rerun a calibration

On the Benchmark page

The Benchmark page shows the same two values as bars. The dark mark is the ASHRAE Guideline 14 limit, and the bar turns orange when the value goes past it. The label next to the bars shows whether the calibrated model meets the guideline.