White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Information extraction from template-generated hidden web documents

Hedley, Y., Younas, M., James, A. and Sanderson, M. (2004) Information extraction from template-generated hidden web documents. In: Isaías, P.T., Karmakar, N., Rodrigues, L. and Barbosa, P., (eds.) Proceedings of the IADIS International Conference WWW/Internet 2004, Madrid, Spain, 2 Volumes. IADIS 2004, 6-9 October 2004, Madrid, Spain. , pp. 627-634. ISBN 972-99353-0-0


Download (127Kb)


The larger amount of information on the Web is stored in document databases and is not indexed by general-purpose search engines (such as Google and Yahoo). Databases dynamically generate a list of documents in response to a user query – which are referred to as Hidden Web databases. Such documents are typically presented to users as templategenerated Web pages. This paper presents a new approach that identifies Web page templates in order to extract queryrelated information from documents. We propose two forms of representation to analyse the content of a document – Text with Immediate Adjacent Tag Segments (TIATS) and Text with Neighbouring Adjacent Tag Segments (TNATS). Our techniques exploit tag structures that surround the textual contents of documents in order to detect Web page templates thereby extracting query-related information. Experimental results demonstrate that TNATS detects Web page templates most effectively and extracts information with high recall and precision.

Item Type: Proceedings Paper
Keywords: hidden web databases, information extraction
Institution: The University of Sheffield
Academic Units: The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield)
Depositing User: Repository Officer
Date Deposited: 22 Sep 2008 18:12
Last Modified: 08 Feb 2013 16:56
Status: Published
URI: http://eprints.whiterose.ac.uk/id/eprint/4544

Actions (repository staff only: login required)