节点文献

半Markov控制过程在折扣代价准则下的最优平稳策略

Optimal stationary policies for semi-Markov control processes with discounted-cost criteria

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 殷保群李衍杰周亚平奚宏生

【Author】 YIN Bao-qun, LI Yan-jie, ZHOU Ya-ping, XI Hong-sheng(Department of Automation, University of Science and Technology of China, Hefei 230027, China.)

【机构】 中国科学技术大学自动化系中国科学技术大学自动化系 安徽合肥230027安徽合肥230027安徽合肥230027

【摘要】 讨论一类半Markov控制过程(SMCP)的折扣代价性能优化问题.通过引入一个矩阵,该矩阵可作为一个Markov过程的无穷小矩阵,对一个SMCP定义了折扣Poisson方程,并由这个方程定义了α 势.基于α 势,给出了由最优平稳策略所满足的最优性方程.最后给出一个求解最优平稳策略的迭代算法,并提供一个数值例子以表明该算法的应用.

【Abstract】 The problems of discounted-cost performance optimization are discussed for a class of semi-Markov (control) processes (SMCP). A matrix is (defined,) which can be as the infinitesimal generator of a Markov process. The discounted Poisson equation is proposed for an SMCP by using this matrix, from which the α-potential is (defined.) Based on the α-potential, the optimality equation satisfied by the optimal stationary policy is given. Finally an iteration algorithm to find an optimal stationary policy is proposed, and an numerical example is provided to (illustrate) the application of the algorithm.

【基金】 国家自然科学基金资助项目(60274012);安徽省自然科学基金资助项目(01042308).
  • 【文献出处】 控制与决策 ,Control and Decision , 编辑部邮箱 ,2004年06期
  • 【分类号】O232
  • 【被引频次】1
  • 【下载频次】101
节点文献中: 

本文链接的文献网络图示:

本文的引文网络