【摘要】 针对处理相似重复数据时,没有充分考虑影响相似度计算的相关因素导致检测准确度不高、数据清洗不干净以及因为某些汉明距离计算没有意义,导致指纹签名匹配速度不快等问题,提出一种基于Simhash算法的相似重复数据的检测方法,该方法能够提高相似重复数据检测的正确率和速度。更多还原

【Abstract】 When dealing with similar duplicate data, the factors that affect the similarity calculation are not fully considered, resulting in low detectionaccuracy, unclean data cleaning, and some meanings of Hamming distance calculation, resulting in low fingerprint signature matchingspeed. Proposes a method for detecting similar repeated data based on Simhash algorithm, which can improve the accuracy and speed ofsimilar duplicate data detection.更多还原