Comparison of risk-based optimization models for reservoir management

M. Mahootchi, K. Ponnambalam, H. R. Tizhoosh

Research output: Contribution to journalArticlepeer-review


Risk minimization in stochastic systems is a challenging problem and this paper compares results of three different techniques in reservoir management. Two-stage stochastic programming (TSP) for maximizing expected benefits is a well-known method, Fletcher and Ponnambalam (FP) and Q-Learning are the two new methods in reservoir management, all of which can include risk minimization in the objective function. The water price uncertainties caused by deregulated markets are considered in addition to random inflows in optimization and simulation is used to compare the results and to develop a risk versus return trade-off curve. One of the contributions of this paper is to consider risk in the Q-Learning algorithm.

Original languageEnglish (US)
Pages (from-to)112-124
Number of pages13
JournalCanadian Journal of Civil Engineering
Issue number1
StatePublished - Jan 2010


  • Q-learning
  • Risk
  • Stochastic dynamic programming
  • Stochastic programming
  • Water reservoirs

ASJC Scopus subject areas

  • Civil and Structural Engineering
  • Environmental Science(all)


Dive into the research topics of 'Comparison of risk-based optimization models for reservoir management'. Together they form a unique fingerprint.

Cite this