节点文献

一个针对多种问题的磁盘故障预测模型(英文)

A disk failure prediction model for multiple issues

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 关云川刘渝周可李强王团结李辉

【Author】 Yunchuan GUAN;Yu LIU;Ke ZHOU;Qiang LI;Tuanjie WANG;Hui LI;Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology;School of Computer Science and Technology, Huazhong University of Science and Technology;Inspur Electronic Informantion Industry Co., Ltd.;

【通讯作者】 刘渝;

【机构】 华中科技大学武汉光电国家研究中心华中科技大学计算机科学与技术学院浪潮电子信息产业股份有限公司

【摘要】 磁盘故障预测方法在单一问题上的解决方案十分成熟,例如磁盘异构问题、模型老化问题和小样本问题。然而,由于这些问题经常同时存在,只能处理其中一个问题的模型在实际预测中存在偏差。目前针对不同问题的解决方案经常相互冲突,然而现有磁盘故障预测方法通常简单地融合各种模型,缺乏在面对多个问题时对训练数据准备和学习模式的讨论。为此,提出一种多属性数据划分方法(MDP),来探索针对多个问题的训练数据准备。引入与模型无关的元学习算法(MAML),对被划分的多个数据子集进行多任务学习。基于这些改进,提出一种名为MDP-MAML的磁盘故障预测模型。MDP解决了数据不均匀划分和按时间划分的挑战,而MAML解决了针对多个问题小样本学习的问题。此外,MDP-MAML能够适应新出现的问题并进行学习和预测。在两个实际数据中心的数据集上,与最先进方法相比,MDP-MAML将曲线下面积(AUC)从0.85提升至0.89,将误检率(FDR)从0.85提升至0.91,将误报率(FAR)从4.88%降低至2.85%。

【Abstract】 Disk failure prediction methods have been useful in handing a single issue, e.g., heterogeneous disks,model aging, and minority samples. However, because these issues often exist simultaneously, prediction models that can handle only one will result in prediction bias in reality. Existing disk failure prediction methods simply fuse various models, lacking discussion of training data preparation and learning patterns when facing multiple issues, although the solutions to different issues often conflict with each other. As a result, we first explore the training data preparation for multiple issues via a data partitioning pattern, i.e., our proposed multi-property data partitioning(MDP). Then, we consider learning with the partitioned data for multiple issues as learning multiple tasks, and introduce the model-agnostic meta-learning(MAML) framework to achieve the learning. Based on these improvements, we propose a novel disk failure prediction model named MDP-MAML. MDP addresses the challenges of uneven partitioning and difficulty in partitioning by time, and MAML addresses the challenge of learning with multiple domains and minor samples for multiple issues. In addition, MDP-MAML can assimilate emerging issues for learning and prediction. On the datasets reported by two real-world data centers, compared to state-of-the-art methods, MDP-MAML can improve the area under the curve(AUC) and false detection rate(FDR) from 0.85 to0.89 and from 0.85 to 0.91, respectively, while reducing the false alarm rate(FAR) from 4.88% to 2.85%.

【基金】 Project supported by the National Natural Science Foundation of China (No. 61902135);the Shandong Provincial Natural Science Foundation,China (No. ZR2019LZH003)
  • 【文献出处】 Frontiers of Information Technology & Electronic Engineering ,信息与电子工程前沿(英文) , 编辑部邮箱 ,2023年07期
  • 【分类号】TP333
  • 【下载频次】7
节点文献中: 

本文链接的文献网络图示:

本文的引文网络