×

Time (in)consistency of multistage distributionally robust inventory models with moment constraints. (English) Zbl 1487.90060

Summary: Recently, there has been a growing interest in developing inventory control policies which are robust to model misspecification. One approach is to posit that nature selects a worst-case distribution for any relevant stochastic primitives from some pre-specified family. Several communities have observed that a subtle phenomena known as time inconsistency can arise in this framework. In particular, it becomes possible that a policy which is optimal at time zero may not be optimal for the associated optimization problem in which the decision-maker recomputes her policy at each point in time, which has implications for implementability. If there exists a policy which is optimal for both formulations, we say that the policy is time consistent, and the problem is weakly time consistent. If every optimal policy is time consistent, we say that the problem is strongly time consistent. We study these phenomena in the context of managing an inventory over time, when only the mean, variance, and support are known for the demand at each stage. We provide several illustrative examples showing that here the question of time consistency can be quite subtle. We complement these observations by providing simple sufficient conditions for weak and strong time consistency. Although a similar phenomena was previously identified by Shapiro for the setting in which only the mean and support of the demand are known, here our model is rich enough to exhibit a variety of additional interesting behaviors.

MSC:

90B05 Inventory, storage, reservoirs
90C15 Stochastic programming
90C17 Robustness in mathematical programming
90C39 Dynamic programming

References:

[1] Ahmed, S.; Cakmak, U.; Shapiro, A., Coherent risk measures in inventory problems, European Journal of Operational Research, 182, 226-238 (2007) · Zbl 1128.90002
[2] Arreola-Risa, A.; DeCroix, G. A., Make-to-order versus make-to-stock in a production-inventory system with general production times, IIE Transactions, 30, 8, 705-713 (1998)
[3] Artzner, P.; Delbaen, F.; Eber, J. M.; Heath, D.; Ku, H., Coherent multiperiod risk adjusted values and Bellmans principle, Annals of Operations Research, 152, 5-22 (2007) · Zbl 1132.91484
[4] Asamov, T.; Ruszczyński, A., Time-consistent approximations of risk-averse multistage stochastic optimization problems, Mathematical Programming, 153, 2, 459-493 (2015) · Zbl 1327.90147
[5] Bellman, R. E., Dynamic programming (1957), Princeton University Press: Princeton University Press Princeton, NJ. · Zbl 0077.13605
[6] Ben-Tal, A.; Boaz, G.; Shimrit, S., Robust multi-echelon multi-period inventory control, European Journal of Operational Research, 199, 3, 922-935 (2009) · Zbl 1176.90008
[7] Ben-Tal, A.; Golany, B.; Nemirovski, A.; Vial, J. P., Retailer-supplier flexible commitments contracts: A robust optimization approach, Manufacturing & Service Operations Management, 7, 248-271 (2005)
[8] Ben-Tal, A.; Goryashko, A.; Guslitzer, A.; Nemirovski, A., Adjustable robust solutions of uncertain linear programs, Mathematical Programming, 99, 351-376 (2004) · Zbl 1089.90037
[9] Bertsekas, D. P.; Shreve, S. E., Stochastic optimal control: The discrete time case (1978), Academic Press: Academic Press NY · Zbl 0471.93002
[10] Bertsimas, D.; Iancu, D. A.; Parrilo, P. A., Optimality of affine policies in multistage robust optimization, Mathematics of Operations Research, 35, 2, 363-394 (2010) · Zbl 1218.90216
[11] Bertsimas, D.; Popescu, I., Optimal inequalities in probability theory: A convex optimization approach, SIAM Journal on Optimization, 15, 3, 780-804 (2005) · Zbl 1077.60020
[12] Bertsimas, D.; Thiele, A., A robust optimization approach to inventory theory, Operations Research, 54, 1, 150-168 (2006) · Zbl 1167.90314
[13] Bielecki, T. R.; Cialenco, I.; Pitera, M., A unified approach to time consistency of dynamic risk measures and dynamic performance measures in discrete time, Mathematics of Operations Research, 43, 1, 204-221 (2018) · Zbl 1443.91099
[14] Boda, K.; Filar, J. A., Time consistent dynamic risk measures, Mathematical Methods in Operations Research, 63, 169-186 (2006) · Zbl 1136.91471
[15] Carpentier, P.; Chancelier, J. P.; Cohen, G.; De Lara, M.; Girardeau, P., Dynamic consistency for stochastic optimal control problems, Annals of Operations Research, 200, 247-263 (2012) · Zbl 1255.90124
[16] Carrizosaa, E.; Olivares-Nadal, A.; Ramirez-Cobob, P., Robust news vendor problem with autoregressive demand, Computers & Operations Research, 68, 123-133 (2016) · Zbl 1349.90013
[17] Chen, W.; Sim, M., Goal-driven optimization, Operations Research, 57, 2, 342-357 (2009) · Zbl 1181.90203
[18] Chen, X.; Sim, M.; Simchi-Levi, D.; Sun, P., Risk aversion in inventory management, Operations Research, 55, 5, 828-842 (2007) · Zbl 1167.90317
[19] Chen, X.; Sun, P., Optimal structural policies for ambiguity and risk averse inventory and pricing models, SIAM Journal on Control and Optimization, 50, 1, 133-146 (2012) · Zbl 1238.90007
[20] Cheridito, P.; Kupper, M., Recursiveness of indifference prices and translation invariant preferences, Mathematics and Financial Economics, 2, 173-188 (2009) · Zbl 1255.91397
[21] Choi, S.; Ruszczynski, A., A risk-averse news vendor with law invariant coherent measures of risk, Operations Research Letters, 36, 1, 77-82 (2008) · Zbl 1152.91572
[22] Choi, S.; Ruszczyński, A.; Zhao, Y., A multiproduct risk-averse newswendor with law-invariant coherent measures of risk, Operations Research, 59, 346-354 (2011) · Zbl 1233.90016
[23] De Lara, M.; Leclère, V., Building up time-consistency for risk measures and dynamic optimization, European Journal of Operational Research, 249, 1, 177-187 (2016) · Zbl 1346.90795
[24] Delage, E.; Iancu, D., Robust multistage decision making, INFORMS Tutorials in Operations Research (2015)
[25] Edgeworth, F., The mathematical theory of banking, Royal Statistical Society, 51, 113-127 (1888)
[26] Epstein, L. G.; Schneider, M., Recursive multiple-priors, Journal of Economic Theory, 113, 1, 1-31 (2003) · Zbl 1107.91360
[27] Etner, J.; Jeleva, M.; Tallon, J. M., Decision theory under ambiguity, Journal of Economic Surveys, 26, 2, 234-270 (2012)
[28] Federgruen, A.; Katalan, Z., The impact of adding a make to-order item to a make-to-stock production system, Management Science, 45, 7, 980-994 (1999) · Zbl 1231.90189
[29] Gabrel, V.; Murat, C.; Thiele, A., Recent advances in robust optimization: An overview, European Journal of Operational Research, 235, 3, 471-483 (2014) · Zbl 1305.90390
[30] Gallego, G., New bounds and heuristics for (q, r) policies, Management Science, 44, 2, 219-233 (1998) · Zbl 0989.90003
[31] Gallego, G., Minimax analysis for finite-horizon inventory models, IIE Transactions, 33, 10, 861-874 (2001)
[32] Gallego, G.; Katircioglu, K.; Ramachandran, B., Inventory management under highly uncertain demand, Operations Research Letters, 35, 3, 281-289 (2007) · Zbl 1180.90011
[33] Gallego, G.; Moon, I., The distribution free newsboy problem: review and extensions, Journal of the Operational Research Society, 44, 8, 825-834 (1993) · Zbl 0781.90029
[34] Gallego, G.; Moon, I., Distribution free procedures for some inventory models, Journal of the Operational research Society, 651-658 (1994) · Zbl 0920.90050
[35] Gérard, H.; De Lara, M.; Chancelier, J.-P., Equivalence between time consistency and nested formula, Annals of Operations Research, 1-21 (2019)
[36] Grunwald, P. D.; Halpern, J. Y., Making decisions using sets of probabilities: Updating, time consistency, and calibration, Journal of Artificial Intelligence Research, 42, 1, 393-426 (2011) · Zbl 1234.68386
[37] Hanasusanto, G.; Grani, A.; Kuhn, D.; Wallace, W.; Zymler, S., Distributionally robust multi-item newsvendor problems with multimodal demand distributions, Mathematical Programming, 152, 1, 1-32 (2015) · Zbl 1327.90153
[38] Hansen, L. P.; Sargent, T. J., Robust control and model uncertainty, American Economic Review, 91, 2, 60-66 (2001)
[39] Huang, P., Iancu, D., Petrik, M., & Subramanian, D. (2011). The price of dynamic inconsistency for distortion risk measures. Technical Report.
[40] Iancu, D. A.; Petrik, M.; Subramanian, D., Tight approximations of dynamic risk measures, Mathematics of Operations Research, 40, 3, 655-682 (2015) · Zbl 1410.91269
[41] Iancu, D. A.; Trichakis, N., Pareto efficiency in robust optimization, Management Science, 60, 1, 130-147 (2014)
[42] Ignall, E.; Veinott, A., Optimality of myopic inventory policies for several substitute products, Management Science, 15, 5, 284-304 (1969) · Zbl 0172.44101
[43] Iyengar, G. N., Robust dynamic programming, Mathematics of Operations Research, 30, 257-280 (2005) · Zbl 1082.90123
[44] Jagannathan, R., A minimax ordering policy for the infinite stage dynamic inventory problem, Management Science, 24, 1138-1149 (1978) · Zbl 0386.90024
[45] Kaminsky, P.; Kaya, O., Combined make-to-order/make-to-stock supply chains, IIE Transactions, 41, 2, 103-119 (2009)
[46] Kasugai, H.; Kasegai, T., Note on minimax regret ordering policy-static and dynamic solutions and a comparison to maximin policy, Journal of the Operations Research Society of Japan, 3, 4, 155-169 (1961) · Zbl 0119.36301
[47] Klabjan, D.; Simchi-Levi, D.; Song, M., Robust stochastic lot-sizing by means of histograms, Production and Operations Management, 22, 691-710 (2013)
[48] Lam, H.; Ghosh, S., Iterative methods for robust estimation under bivariate distributional uncertainty, Proceedings of the Winter Simulation Conference (2013)
[49] Landau, H. J., Moments in mathematics, Proceedings of symposium in applied mathematics, 37 (1987), American Mathematics Society: American Mathematics Society Providence, RI · Zbl 0621.00005
[50] Levi, R.; Perakis, G.; Uichanco, J., The data-driven newsvendor problem: new bounds and insights, Operations Research, 63, 6, 1294-1306 (2015) · Zbl 1333.90010
[51] Lovejoy, W., Stopped myopic policies for some inventory models with uncertain demand distributions, Management Science, 38, 5, 688-707 (1992) · Zbl 0757.90018
[52] Homem-de Mello, T.; Pagnoncelli, B., Risk aversion in multistage stochastic programming: A modeling and algorithmic perspective, European Journal of Operational Research, 249, 1, 188-199 (2016) · Zbl 1346.90639
[53] Natarajan, K.; Zhou, L., A mean-variance bound for a three-piece linear function, Probability in the Engineering and Informational Sciences, 21, 4, 611-621 (2007) · Zbl 1129.60018
[54] Nilim, A.; Ghaoui, L. E., Robust control of Markov decision processes with uncertain transition matrices, Operations Research, 53, 780-798 (2005) · Zbl 1165.90674
[55] Osogami, T.; Morimura, T., Time-consistency of optimization problems, Proceedings of the 26th AAAI conference on artificial intelligence (2012)
[56] Perakis, G.; Roels, G., Regret in the newsvendor model with partial information, Operations Research, 56, 1, 188-203 (2008) · Zbl 1167.90350
[57] Pflug, G. C.; Pichler, A., Time consistency, pp. 175-208, Chapter 5 in multistage stochastic optimization (2014), Springer
[58] Popescu, I., A semi definite programming approach to optimal moment bounds for convex classes of distributions, Mathematics of Operations Research, 50, 3, 632-657 (2005) · Zbl 1082.60011
[59] Rajagopalan, S., Make-to-order or make-to-stock: Model and application, Management Science, 48, 2, 241-256 (2002) · Zbl 1232.90194
[60] Roorda, B.; Schumacher, J. M., Time consistency conditions for acceptability measures, with an applications to tail value at risk, Insurance: Mathematics and Economics, 40, 209-230 (2007) · Zbl 1141.91547
[61] Ruszczyński, A., Risk-averse dynamic programming for Markov decision processes, Mathematical Programming, Series B, 125, 235-261 (2010) · Zbl 1207.49032
[62] Scarf, H., A min-max solution of an inventory problem, (Arrow, K., Studies in the mathematical theory of inventory and production (1958), Stanford University Press: Stanford University Press Stanford, CA), 201-209
[63] Scarf, H., Bayes solution of the statistical inventory problem, The Annals of Mathematical Statistics, 490-508 (1959) · Zbl 0089.36801
[64] Scarf, H., Some remarks on Bayes solutions to the inventory problem, Naval Research Logistics Quarterly, 7, 4, 591-596 (1960) · Zbl 0104.14103
[65] Schmüdgen, K., The moment problem (2017), Springer International Publishing AG: Springer International Publishing AG Switzerland · Zbl 1383.44004
[66] See, C. T.; Sim, M., Robust approximation to multiperiod inventory management, Operations Research, 58, 3, 583-594 (2010) · Zbl 1231.90059
[67] Shapiro, A., On a time consistency concept in risk averse multistage stochastic programming, Operations Research Letters, 37, 143-147 (2009) · Zbl 1167.90613
[68] Shapiro, A., A dynamic programming approach to adjustable robust optimization, Operations Research Letters, 39, 2, 83-87 (2011) · Zbl 1218.90186
[69] Shapiro, A., Minimax and risk averse multistage stochastic programming, European Journal of Operational Research, 219, 719-726 (2012) · Zbl 1253.90181
[70] Shapiro, A., Rectangular sets of probability measures, Operations Research, 64, 2, 528-541 (2016) · Zbl 1342.90118
[71] Shapiro, A., Interchangeability principle and dynamic equations in risk averse stochastic programming, Operations Research Letters, 45, 4, 377-381 (2017) · Zbl 1409.90125
[72] Shapiro, A.; Dentcheva, D.; Ruszczyński, A., Lectures on stochastic programming: Modeling and theory (2009), SIAM: SIAM Philadelphia · Zbl 1183.90005
[73] Shapiro, A., & Pichler, A. (2016a). Time and dynamic consistency of risk averse stochastic programs. Published electronically in Optimization Online.
[74] Shapiro, A.; Ugurlu, K., Decomposability and time consistency of risk averse multistage programs, Operations Research Letters, 44, 5, 663-665 (2016) · Zbl 1408.90215
[75] Forthcoming
[76] Strotz, R. H., Myopia and inconsistency in dynamic utility maximization, The Review of Economic Studies, 23, 3, 165-180 (1955)
[77] Veinott, F. A., Optimal policy for a multi-product, dynamic, nonstationary inventory problem, Management Science, 12, 3, 206-222 (1965) · Zbl 0143.21703
[78] Wang, T. (1999). A class of dynamic risk measure. Working paperUniversity of British Columbia.
[79] Wiesemann, W.; Kuhn, D.; Rustem, B., Robust Markov decision processes, Mathematics of Operations Research, 38, 1, 153-183 (2013) · Zbl 1291.90295
[80] Williams, T. M., Special products and uncertainty in production/inventory systems, European Journal of Operations Research, 15, 46-54 (1984) · Zbl 0525.90056
[81] Xin, L., Goldberg, D., & Shapiro, A. (2013). Time (in) consistency of multistage distributionally robust inventory models with moment constraints. arXiv:1304.3074.
[82] Yang, J. (2013). Inventory and price control under time-consistent coherent and Markov risk measure. Preprint.
[83] Yue, J.; Chen, B.; Wang, M., Expected value of distribution information for the news vendor problem, Operations Research, 54, 6, 1128-1136 (2006) · Zbl 1167.90364
[84] Zhu, Z.; Zhang, J.; Ye, Y., News vendor optimization with limited distribution information, Optimization methods and software, 28, 3, 640-667 (2013) · Zbl 1266.90031
[85] Zipkin, P. H., Foundations of inventory management (2000), McGraw-Hill: McGraw-Hill Boston · Zbl 1370.90005
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.