【摘要】 概率生成模型LDA(Latent Dirichlet allocation)是对文本进行主题挖掘的重要手段,在近几年有着广泛的应用。对于论坛文本,因为其本身具有一些结构特性,单纯使用LDA并不能够最大限度地利用文本信息挖掘主题,水帖、大量的短回复以及同一版块帖子的背景词也极大地影响了其主题挖掘的效果。针对论坛文本的特点,提出了基于改进LDA的BBS-LDA模型,并使用Collapsed gibbs sampling对模型进行推导。由于该模型利用了论坛的用户信息,故在挖掘主题的同时能够识别论坛的水贴和背景词。在天涯论坛语料上进行的实验表明,BBS-LDA可以有效地对论坛进行主题挖掘。更多还原

【Abstract】 In recent years, the LDA topic model is an important means of mining topics for texts and has been widely used. For the forum text, because of its own structural characteristics, simply using LDA can not make full use of textual information to mine the topic. The meaningless posts and the background words which are very common in the forum may always bring huge noises and cause bad results. We proposed the BBS-LDA which combined LDA with the structural characteristics of forum and the user information. In this method, the collapsed gibbs sampling is used to derive the model. Since the model utilizes the user information of the forum, it can identify the meaningless post and background words while mining the theme. Experiments on Tianya forum corpus demonstrate that BBS-LDA will effectively mine the topics.更多还原