Learning the process of World Wide Web data retrieval

Abstract

We develop a method for extracting and internalizing web site form submissions which we refer to as web operations. To begin the process, a user performs a sample submission of the form. From that submission, our system determines all of the necessary information to store the web operation. Through a simple user interface the user can view and modify the web operation to the extent that he wants or needs to. With the operation now stored, the user can invoke the operation without browsing to the web site on which the operation was originally contained. By utilizing the web site information extraction techniques contained in the Haystack information management system, we give the user the option to extract information off of web operation results pages. Thus, when using our system to the fullest extent, a user can invoke web operations and view and make use of the results without viewing any web pages.