An intelligent personal spider (agent) for dynamic Internet/Intranet searching

Persistent Link:
http://hdl.handle.net/10150/105238
Title:
An intelligent personal spider (agent) for dynamic Internet/Intranet searching
Author:
Chen, Hsinchun; Chung, Yi-Ming; Ramsey, Marshall C.; Yang, Christopher C.
Citation:
An intelligent personal spider (agent) for dynamic Internet/Intranet searching 1998-05, 23(1):41-58 Decision Support Systems
Publisher:
Science Direct
Journal:
Decision Support Systems
Issue Date:
May-1998
Description:
Artificial Intelligence Lab, Department of MIS, University of Arizona
URI:
http://hdl.handle.net/10150/105238
Submitted date:
2004-09-04
Abstract:
As Internet services based on the World-Wide Web become more popular, information overload has become a pressing research problem. Difficulties with search on Internet will worsen as the amount of on-line information increases. A scalable approach to Internet search is critical to the success of Internet services and other current and future National Information Infrastructure (NII) applications. As part of the ongoing Illinois Digital Library Initiative project, this research proposes an intelligent personal spider (agent) approach to Internet searching. The approach, which is grounded on automatic textual analysis and general-purpose search algorithms, is expected to be an improvement over the current static and inefficient Internet searches. In this experiment, we implemented Internet personal spiders based on best first search and genetic algorithm techniques. These personal spiders can dynamically take a user's selected starting homepages and search for the most closely related homepages in the web, based on the links and keyword indexing. A plain, static CGI/HTML-based interface was developed earlier, followed by a recent enhancement of a graphical, dynamic Java-based interface. Preliminary evaluation results and two working prototypes (available for Web access) are presented. Although the examples and evaluations presented are mainly based on Internet applications, the applicability of the proposed techniques to the potentially more rewarding Intranet applications should be obvious. In particular, we believe the proposed agent design can be used to locate organization-wide information, to gather new, time-critical organizational information, and to support team-building and communication in Intranets.
Type:
Journal Article (Paginated)
Language:
en
Keywords:
Internet; World Wide Web; Information Extraction
Local subject classification:
National Science Digital Library; NSDL; Artificial intelligence lab; AI lab; Agents; Machine learning; Spider; Evolutionary programming; Information retrieval; Semantic retrieval; Java; Intranet

Full metadata record

DC FieldValue Language
dc.contributor.authorChen, Hsinchunen_US
dc.contributor.authorChung, Yi-Mingen_US
dc.contributor.authorRamsey, Marshall C.en_US
dc.contributor.authorYang, Christopher C.en_US
dc.date.accessioned2004-09-04T00:00:01Z-
dc.date.available2010-06-18T23:22:01Z-
dc.date.issued1998-05en_US
dc.date.submitted2004-09-04en_US
dc.identifier.citationAn intelligent personal spider (agent) for dynamic Internet/Intranet searching 1998-05, 23(1):41-58 Decision Support Systemsen_US
dc.identifier.urihttp://hdl.handle.net/10150/105238-
dc.descriptionArtificial Intelligence Lab, Department of MIS, University of Arizonaen_US
dc.description.abstractAs Internet services based on the World-Wide Web become more popular, information overload has become a pressing research problem. Difficulties with search on Internet will worsen as the amount of on-line information increases. A scalable approach to Internet search is critical to the success of Internet services and other current and future National Information Infrastructure (NII) applications. As part of the ongoing Illinois Digital Library Initiative project, this research proposes an intelligent personal spider (agent) approach to Internet searching. The approach, which is grounded on automatic textual analysis and general-purpose search algorithms, is expected to be an improvement over the current static and inefficient Internet searches. In this experiment, we implemented Internet personal spiders based on best first search and genetic algorithm techniques. These personal spiders can dynamically take a user's selected starting homepages and search for the most closely related homepages in the web, based on the links and keyword indexing. A plain, static CGI/HTML-based interface was developed earlier, followed by a recent enhancement of a graphical, dynamic Java-based interface. Preliminary evaluation results and two working prototypes (available for Web access) are presented. Although the examples and evaluations presented are mainly based on Internet applications, the applicability of the proposed techniques to the potentially more rewarding Intranet applications should be obvious. In particular, we believe the proposed agent design can be used to locate organization-wide information, to gather new, time-critical organizational information, and to support team-building and communication in Intranets.en_US
dc.format.mimetypetext/htmlen_US
dc.language.isoenen_US
dc.publisherScience Directen_US
dc.subjectInterneten_US
dc.subjectWorld Wide Weben_US
dc.subjectInformation Extractionen_US
dc.subject.otherNational Science Digital Libraryen_US
dc.subject.otherNSDLen_US
dc.subject.otherArtificial intelligence laben_US
dc.subject.otherAI laben_US
dc.subject.otherAgentsen_US
dc.subject.otherMachine learningen_US
dc.subject.otherSpideren_US
dc.subject.otherEvolutionary programmingen_US
dc.subject.otherInformation retrievalen_US
dc.subject.otherSemantic retrievalen_US
dc.subject.otherJavaen_US
dc.subject.otherIntraneten_US
dc.titleAn intelligent personal spider (agent) for dynamic Internet/Intranet searchingen_US
dc.typeJournal Article (Paginated)en_US
dc.identifier.journalDecision Support Systemsen_US
All Items in UA Campus Repository are protected by copyright, with all rights reserved, unless otherwise indicated.