For Full-Text PDF, please login, if you are a member of IEICE,|
or go to Pay Per View on menu list, if you are a nonmember of IEICE.
Efficient Algorithm for Sentence Information Content Computing in Semantic Hierarchical Network
Hao WU Heyan HUANG
IEICE TRANSACTIONS on Information and Systems
Publication Date: 2017/01/01
Online ISSN: 1745-1361
Type of Manuscript: LETTER
Category: Natural Language Processing
information content, sentence IC, inclusion-exclusion principle, difference set, hierarchical network,
Full Text: PDF(95.8KB)>>
We previously proposed an unsupervised model using the inclusion-exclusion principle to compute sentence information content. Though it can achieve desirable experimental results in sentence semantic similarity, the computational complexity is more than O(2n). In this paper, we propose an efficient method to calculate sentence information content, which employs the thinking of the difference set in hierarchical network. Impressively, experimental results show that the computational complexity decreases to O(n). We prove the algorithm in the form of theorems. Performance analysis and experiments are also provided.