节点文献

双马尔可夫决策过程联合模型

Associated Model of Bi-Markov Decision Processes

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 王蓁蓁邢汉承

【Author】 WANG Zhen-zhen1 XING Han-cheng2(Department of Computer Science & Technology,Nanjing University,Nanjing 210093,China)1(School of Computer Science & Engineering,Southeast University,Nanjing 210096,China)2

【机构】 南京大学计算机科学与技术系东南大学计算机科学与工程学院

【摘要】 人类在处理问题中往往分为两个层次,首先在整体上把握问题,即提出大体方案,然后再具体实施。也就是说人类就是具有多分辨率智能系统的极好例子,他能够在多个层次上从底向上泛化(即看问题角度粒度变"粗",它类似于抽象),并且又能从顶向下进行实例化(即看问题角度变"细",它类似于具体化)。由此构造了由在双层(理想空间即泛化和实际空间即实例化)上各自运行的马尔可夫决策过程组成的半马尔可夫决策过程,称之为双马尔可夫决策过程联合模型。然后讨论该联合模型的最优策略算法,最后给出一个实例说明双马尔可夫决策联合模型能够经济地节约"思想",是运算有效性和可行性的一个很好的折中。

【Abstract】 Human thought is often divided two levels while dealing with problems.First people always treat problems from a whole perspective,i.e.,they have a general plan,then they specifically deal with details.The human itself is a good example for having a multi-resolutional characteristic.It can not only generalize bottom-up among multi-levels(the granule of viewpoint about problem becomes "rough",analogous to abstract),but also instantiate top-down(the granule of viewpoint becomes "thin",analogous to specification).So we constructed a semi-Markov decision process consisting of two Markov decision processes running respectively on two levels—the ideal space(generalization) and the actual space(instantiation).It is called an associated bi-Markov decision model.Then we discussed how to find optimal policy under this associated model.Finally an example was given to show that the associated bi-Markov decision process model can economically economize "mind" and is a good tradeoff between the computational validity and computational feasibility.

【基金】 国家自然科学基金(90412014,60803061);江苏省自然科学基金(BK2008293)资助
  • 【文献出处】 计算机科学 ,Computer Science , 编辑部邮箱 ,2009年09期
  • 【分类号】TP18
  • 【被引频次】2
  • 【下载频次】201
节点文献中: