节点文献

面向查询式实体解析的多属性数据索引技术

Multi-attribute Data Indexing for Query Based Entity Resolution

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 孙琛琛申德荣肖迎元李玉坤

【Author】 SUN Chen-Chen;SHEN De-Rong;XIAO Ying-Yuan;LI Yu-Kun;Key Laboratory of Computer Vision and System of Ministry of Education (Tianjin University of Technology);School of Computer Science and Engineering, Northeastern University;

【通讯作者】 孙琛琛;

【机构】 计算机视觉与系统省部共建教育部重点实验室(天津理工大学)东北大学计算机科学与工程学院

【摘要】 实体解析是数据集成的关键方面,也是大数据分析与挖掘的必要预处理步骤.大数据时代,随着查询驱动的数据应用需求的不断增长,查询式实体解析成为热点问题.为了提升查询-解析效率,研究了面向实体缓存的多属性数据索引技术.涉及两个核心问题:(1)如何设计多属性数据索引?设计了基于R-树的多属性索引结构.为了满足实体缓存在线生成需求,提出了基于空间聚类的在线索引构建方法.提出了基于“过滤-验证”的多维查询方法,利用多属性索引有效地过滤掉不可能命中的记录,然后采用相似性函数或距离函数逐一验证候选记录.(2)如何将不同的字符串属性插入到树形索引中?解决思路是,将字符串映射到数值空间.针对Jaccard相似性和编辑相似性,提出了基于q-gram的映射方法,并提出了基于向量降维的优化和基于z-order的优化,实现高质量的“字符串→数值”映射.最后,在两个数据集上进行实验评估,验证多属性索引的有效性,并测试其各个方面.

【Abstract】 Entity resolution is a key aspect of data integration, and also is a necessary preprocessing step of big data analytics and mining.In big data era, more and more query-driven data analytics applications come out, and query-based entity resolution becomes a hot topic.This work studies multi-attribute data indexing technology for entity cache in order to promote query-resolution efficiency. There are two core problems. One is how to design the multi-attributeindex. An R-tree based multi-attributeindex is designed. Entity cache is produced online, so an online index construction method is proposed based on spatial clustering. A filter-verify based multi-dimensional query method is proposed. It filters impossible records by the multi-attributeindex, and then verifies each candidate record with similarity functions or distance functions. The other ishow to insert different string attributes into the tree index. The basic solution is mapping strings into integer spaces. For Jaccard similarity and edit similarity, a q-gram based mapping method is proposed, and is improved by vector dimension reduction and z-order, which achieves high mapping qualities. Finally, the proposed hybrid index is experimentally evaluated on two datasets. Its effectiveness is validated, and moreover, different aspects of the multi-attribute index are also tested.

【基金】 国家自然科学基金(62002262,61672142,61602103,62072086,62072084);国家重点研发计划(2018YFB1003404)
  • 【文献出处】 软件学报 ,Journal of Software , 编辑部邮箱 ,2022年06期
  • 【分类号】TP311.13
  • 【下载频次】134
节点文献中: 

本文链接的文献网络图示:

本文的引文网络