Skip to main navigation Skip to search Skip to main content

On the average-cost optimality equations and convergence of discounted-cost relative value functions for inventory control problems with quasiconvex cost functions

  • Stony Brook University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Average-cost optimality inequalities imply the existence of stationary optimal policies for Markov Decision Processes with average costs per unit time, and these inequalities hold under broad natural conditions. Additional conditions are required for the validity of the average-cost optimality equations. Recently Feinberg and Liang [10, Theorem 3.2] showed that the equicontinuity of value functions for discounted costs is sufficient additional condition for the validity of average-cost optimality equations for problems with weakly continuous transition probabilities and with possibly unbounded one-step costs, and this condition holds for setup-cost inventory control problems with backorders and convex holding/backlog costs. This paper studies periodic-review setup-cost inventory control problem with backorders and with quasiconvex cost functions and general demands. It is shown that such problems satisfy the equicontinuity condition. Therefore, optimality inequalities hold in the form of equalities with a continuous average-cost relative value function for this problem. In addition, this implies that average-cost optimal (s, S) policies for the inventory control problem can be derived from the average-cost optimality equation. With the additional assumption on the monotonicity of the cost function, we establish the convergence of discounted-cost optimal ordering threshold sa and convergence of discounted-cost relative value functions, when the discount factor converges to 1, to the corresponding optimal threshold and optimal relative value function for the average-cost problem.

Original languageEnglish
Title of host publication2017 IEEE 56th Annual Conference on Decision and Control, CDC 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages641-646
Number of pages6
ISBN (Electronic)9781509028733
DOIs
StatePublished - Jun 28 2017
Event56th IEEE Annual Conference on Decision and Control, CDC 2017 - Melbourne, Australia
Duration: Dec 12 2017Dec 15 2017

Publication series

Name2017 IEEE 56th Annual Conference on Decision and Control, CDC 2017
Volume2018-January

Conference

Conference56th IEEE Annual Conference on Decision and Control, CDC 2017
Country/TerritoryAustralia
CityMelbourne
Period12/12/1712/15/17

Keywords

  • Markov processes
  • Optimal control
  • Stochastic systems

Fingerprint

Dive into the research topics of 'On the average-cost optimality equations and convergence of discounted-cost relative value functions for inventory control problems with quasiconvex cost functions'. Together they form a unique fingerprint.

Cite this