Title: Research on link blocks recognition of web pages

Authors: Qiong Gu; Zhao Wu; Bing Ning; Xianming Wang; Chunsheng Xin

Addresses: School of Mathematics and Computer Science, Hubei University of Arts and Science, Xiangyang, 441053, China ' School of Mathematics and Computer Science, Hubei University of Arts and Science, Xiangyang, 441053, China ' School of Mathematics and Computer Science, Hubei University of Arts and Science, Xiangyang, 441053, China ' Oujiang College, Wenzhou University, Wenzhou, 325035, China ' Department of Electrical and Computer Engineering, Old Dominion University, Norfolk, VA 23529, USA

Abstract: The link block is a typical type of block structure of web pages; it is an important research object in the fields of web data mining. Firstly, block and block tree are proposed as the basic concepts of subsequent explorations, and then an approach of building block trees is put forward. Secondly, four rules for link block discrimination and two indicators for recognition results evaluation are put forward based on the concept of block. Finally, a strategy named forward algorithm for discovery of link block (FAD) is proposed and a corresponding experiment with different parameters is performed to verify the strategy. The results show that the FAD can be flexible to achieve recognition of link blocks under different granularity conditions. Concepts and approaches presented in this paper have a good prospect in the fields of web data processing such as advertising block recognition and web content extraction.

Keywords: web; block trees; link blocks; discrimination; recognition.

DOI: 10.1504/IJHPCN.2019.098574

International Journal of High Performance Computing and Networking, 2019 Vol.13 No.3, pp.331 - 339

Received: 11 Jun 2016
Accepted: 21 Sep 2016
Published online: 28 Mar 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article