Subjects: Information Science and Systems Science >> Systematic Application of Information Technology submitted time 2022-10-26 Cooperative journals: 《桂林电子科技大学学报》
Abstract： The rise of a new generation of information technology and the rapid development of the internet industry have led
to an explosive growth in the amount of data. In order to meet the needs of billions of users to obtain effective information
from massive data quickly, it is of great significance to improve the retrieval quality and query efficiency of search engines,
but it also faces challenges. On the one hand, the query words of users are becoming more and more complex, and the characteristics
of the morphological variation of language vocabulary lead to the diversification of search words, while existing
stemming algorithms generally suffer from under stemming and unsatisfactory stemming accuracy; On the other hand, it is
a very time-consuming task to retrieve document results that meet user query requirements from massive data, and existing
methods of dividing documents into multiple servers to handle query latency often suffer from tail latency problems. In view
of the above problems, in the text preprocessing stage, the word form normalization algorithm APS (advanced porter stemmer)
is designed, the rule function is recoded, and the feature word extraction is optimized; In the related ranking stage, the
anytime ranking algorithm SAR (SAAT anytime ranking) is designed based on the score-at-a-Time query processing strategy,
which can terminate the query process in advance after a given time budget or processing a specified number of inverted
segments and control the query delay effectively. Experiments are carried out on multiple real datasets to verify the effectiveness of the APS algorithm in improving the accuracy of stemming and the authenticity of the SAR algorithm in controlling
query latency.
Hits
Hits
Downloads
Comment