Skip to page content
USDA Forest Service

Research & Development Treesearch

Treesearch Home
About Treesearch
Contact Us
Research & Development
Forest Products Lab
International Institute of Tropical Forestry
Pacific Northwest
Pacific Southwest
Rocky Mountain
Southern Research Station
Help - We Participate  Government Made Easy

Global Forest Information Service

US Forest Service
P.O. Box 96090
Washington, D.C.

(202) 205-8333

You are here: Home / Search / Publication Information
Bookmark and Share

Publication Information

View PDF (1.1 MB)

Title: Metrics for evaluating performance and uncertainty of Bayesian network models

Author: Marcot, Bruce G.;

Date: 2012

Source: Ecological Modeling. 230: 50-62

Publication Series: Scientific Journal (JRNL)

Description: This paper presents a selected set of existing and new metrics for gauging Bayesian network model performance and uncertainty. Selected existing and new metrics are discussed for conducting model sensitivity analysis (variance reduction, entropy reduction, case file simulation); evaluating scenarios (influence analysis); depicting model complexity (numbers of model variables, links, node states, conditional probabilities, and node cliques); assessing prediction performance (confusion tables, covariate and conditional probability-weighted confusion error rates, area under receiver operating characteristic curves, k-fold cross-validation, spherical payoff. Schwarz' Bayesian information criterion, true skill statistic, Cohen's kappa); and evaluating uncertainty of model posterior probability distributions (Bayesian credible interval, posterior probability certainty index, certainty envelope, Gini coefficient). Examples are presented of applying the metrics to 3 real-world models of wildlife population analysis and management. Using such metrics can vitally bolster model credibility, acceptance, and appropriate application, particularly when informing management decisions.

Keywords: Bayesian network model, uncertainty, model performance, model validation, sensitivity analysis, error rates, probability analysis

Publication Notes:

  • We recommend that you also print this page and attach it to the printout of the article, to retain the full citation information.
  • This article was written and prepared by U.S. Government employees on official time, and is therefore in the public domain.



Marcot, Bruce G. 2012. Metrics for evaluating performance and uncertainty of Bayesian network models. Ecological Modeling. 230: 50-62.


 [ Get Acrobat ]  Get the latest version of the Adobe Acrobat reader or Acrobat Reader for Windows with Search and Accessibility

USDA logo which links to the department's national site. Forest Service logo which links to the agency's national site.