Modeling and forecasting electricity prices with input/output hidden Markov models | IEEE Journals & Magazine | IEEE Xplore

Modeling and forecasting electricity prices with input/output hidden Markov models


Abstract:

In competitive electricity markets, in addition to the uncertainty of exogenous variables such as energy demand, water inflows, and availability of generation units and f...Show More

Abstract:

In competitive electricity markets, in addition to the uncertainty of exogenous variables such as energy demand, water inflows, and availability of generation units and fuel costs, participants are faced with the uncertainty of their competitors' behavior. The analysis of electricity price time series reflects a switching nature, related to discrete changes in competitors' strategies, which can be represented by a set of dynamic models sequenced together by a Markov chain. An input-output hidden Markov model (IOHMM) is proposed for analyzing and forecasting electricity spot prices. The model provides both good predictions in terms of accuracy as well as dynamic information about the market. In this way, different market states are identified and characterized by their more relevant explanatory variables. Moreover, a conditional probability transition matrix governs the probabilities of remaining in the same state, or changing to another, whenever a new market session is opened. The model has been successfully applied to real clearing prices in the Spanish electricity market.
Published in: IEEE Transactions on Power Systems ( Volume: 20, Issue: 1, February 2005)
Page(s): 13 - 24
Date of Publication: 28 February 2005

ISSN Information:

References is not available for this document.

I. Introduction

During the last decade, the electric industries of many countries all around the world have suffered profound regulatory changes, which gave rise to many international experiences. In Spain, the overall electricity business is organized as a sequence of markets. The day-ahead spot market consists of 24 hourly auctions that take place simultaneously one day in advance. The clearing of this market provides the provisional energy schedule of each bidding unit, and the hourly marginal price is found as the intersection of supply and demand curves. After the spot market, where the major part of the total energy is traded, subsequent short-term market mechanisms (intraday markets, ancillary reserves, and real-time markets) are available in order to guarantee the final balance between power generation and consumers' demand.

Select All
1.
J. Bengio and P. Frasconi, "Input-output HMMs for sequence processing", IEEE Trans. Neural Netw., vol. 7, no. 5, pp. 1231-1249, Sep. 1996.
2.
L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition", Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
3.
A. Pentland and A. Liu, "Modeling and prediction of human behavior", Neural Comput., vol. 11, pp. 229-242, 1999.
4.
C. Batlle, "A model for electricity generation risk analysis", 2002.
5.
M. Ventosa, A. Baíllo, A. Ramos and M. Rivier, "Electricity market modeling trends", Energy Policy, Mar. 2004.
6.
R. S. Tsay, Analysis if Financial Time Series, New York:Wiley, 2002.
7.
S. Vucetic, K. Tomsovic and Z. Obradovic, "Discovering price-load relationships in California's electricity market", IEEE Trans. Power Syst., vol. 16, no. 2, pp. 280-286, May 2001.
8.
F. J. Nogales, J. Contreras, A. J. Conejo and R. Espinola, "Forecasting next-day electricity prices by time series models", IEEE Trans. Power Syst., vol. 17, no. 2, pp. 342-348, May 2002.
9.
J. D. Hamilton, Time Series Analysis, Princeton, NJ:Princeton Univ. Press, 1994.
10.
C. R. Knittel and M. R. Roberts, An Empirical Examination of Deregulated Electricity Prices, Berkeley, CA:Univ. of California Press, 2001.
11.
E. Schwartz and J. E. Smith, "Short-term variations and long-term dynamics in commodity prices", Manage. Sci., vol. 46, pp. 893-911, 2000.
12.
J. J. Lucia and E. Schwartz, Electricity Prices and Power Derivatives: Evidence From the Nordic Power Exchange Finance. Paper 16_00, Mar. 2001, [online] Available: repositories.cdlib.org/anderson/fin/16_00.
13.
D. Duffie, S. Gray and P. Hoang, "Volatility in energy prices" in Managing Energy Price Risk, London, U.K.:Risk Books, pp. 273-290, 1999.
14.
T. Bollerslev, "Generalized autoregressive conditional heteroskedasticity", J. Econometric, vol. 31, no. 3, pp. 307-327, Apr. 1986.
15.
C. Batlle and J. Barquín, "Fuel prices scenario generation based in a multivariate GARCH model for risk analysis in a wholesale electricity market", Proc. 7th Int. Conf. Probabilistic Methods Applied Power Syst., 2002.
16.
S. Deng, "Pricing electricity derivatives under alternative stochastic spot price models", Proc. 33rd Hawaii Int. Conf. Syst. Sci., 2000.
17.
K. Hornik, "Multilayer feedforward networks are universal approximators", Neural Netw., vol. 2, pp. 259-266, 1989.
18.
B. R. Szkuta, L. A. Sanabria and T. S. Dillon, "Electricity price short-term forecasting using artificial neural networks", IEEE Trans. Power Syst., vol. 14, no. 3, pp. 851-857, Aug. 1999.
19.
A. S. Weigend and M. Mangeas, "Nonlinear gated experts for time series: discovering regimes and avoiding overfitting", Int. J. Neural Syst., vol. 6, pp. 373-399, 1995.
20.
J. D. Hamilton, "Analysis of time series subject to change in regime", J. Econometr., vol. 45, pp. 39-70, 1990.
21.
N. Fabra and J. Toro, Price Wars and Collusion in the Spanish Electricity Market, Madrid, Spain:Fundación Empresa Públlica, 2002.
22.
S. Shanming, "Modeling temporal structure of time series with hidden Markov experts", 1998.
23.
J. Bengio and P. Frasconi, "An input-output HMM architecture", Advances Neural Inf. Process. Syst., vol. 7, pp. 427-434, 1995.
24.
L. E. Baum and T. Petrie, "Statistical inference for probabilistic functions of finite states Markov chain", Ann. Math. Stat., vol. 37, pp. 1554-1563, 1966.
25.
M. A. Berger, An Introduction to Probability and Stochastic Processes, New York:Springer-Verlag, 1993.
26.
A. P. Dempster, N. M. Laird and D. B. Rubin, "Maximum likelihood from incomplete data via EM algorithm", J. Roy. Stat. Soc., vol. 39, pp. 1-38, 1977.
27.
G. J. McLachlan and T. Krishnan, The EM Algorithm and Extensions, New York:Wiley, 1997.
28.
Y. Bengio, V.-P. Lauzon and R. Ducharme, "Experiments on the application of IOHMMs to model financial returns series", IEEE Trans. Neural Netw., vol. 12, no. 1, pp. 113-123, Jan. 2001.
29.
J. Bengio, Y. LeCun, C. Nohl and C. Burges, "A NN/HMM hybrid for on-line hadwriting recognition", Neural Comput., vol. 7, pp. 1289-1303, 1995.
30.
C. M. Bishop, Neural Networks for Pattern Recognition, London, U.K.:Oxford Univ. Press, 1995.
Contact IEEE to Subscribe

References

References is not available for this document.