Programming Spiders Bots and Aggregators in Java 2002.pdf

Programming Spiders, Bots, and Aggregators in Java

Jeff Heaton

Publisher: Sybex

February 2002

ISBN: 0782140408, 512 pages

Spiders, bots, and aggregators are all so-called intelligent agents, which execute tasks on

the Web without the intervention of a human being. Spiders go out on the Web and identify

multiple sites with information on a chosen topic and retrieve the information. Bots find

information within one site by cataloging and retrieving it. Aggregrators gather data from

multiple sites and consolidate it on one page, such as credit card, bank account, and

investment account data. This book offer offers a complete toolkit for the Java programmer

who wants to build bots, spiders, and aggregrators. It teaches the basic low-level

HTTP/network programming Java programmers need to get going and then dives into how to

create useful intelligent agent applications. It is aimed not just at Java programmers but JSP

programmers as well. The CD-ROM includes all the source code for the author's intelligent

agent platform, which readers can use to build their own spiders, bots, and aggregators.

Programming Spiders, Bots, and Aggregators in Java

Jeff Heaton

Associate Publisher: Richard Mills

Acquisitions and Developmental Editor: Diane Lowery

Editor: Rebecca C. Rider

Production Editor: Dennis Fitzgerald

Technical Editor: Marc Goldford

Graphic Illustrator: Tony Jonick

Electronic Publishing Specialists: Jill Niles, Judy Fung

Proofreaders: Emily Hsuan, Laurie O’Connell, Nancy Riddiough

Indexer: Ted Laux

CD Coordinator: Dan Mummert

CD Technician: Kevin Ly

Cover Designer: Carol Gorska, Gorska Design

Cover Illustrator/Photographer: Akira Kaede, PhotoDisc

rights reserved. The author(s) created reusable code in this publication expressly for reuse by

readers. Sybex grants readers limited permission to reuse the code found in this publication or

its accompanying CD-ROM so long as (author(s)) are attributed in any application containing

the reusabe code and the code itself is never distributed, posted online by electronic

transmission, sold, or commercially exploited as a stand-alone product. Aside from this

specific exception concerning reusable code, no part of this publication may be stored in a

retrieval system, transmitted, or reproduced in any way, including but not limited to

photocopy, photograph, magnetic, or other record, without the prior agreement and written

permission of the publisher.

Library of Congress Card Number: 2001096980

ISBN: 0-7821-4040-8

SYBEX and the SYBEX logo are either registered trademarks or trademarks of SYBEX Inc.

in the United States and/or other countries.

Macromedia Inc. For more information on Macromedia and Macromedia Director, visit

http://www.macromedia.com/ .

Internet screen shot(s) using Microsoft Internet Explorer reprinted by permission from

Microsoft Corporation.

TRADEMARKS: SYBEX has attempted throughout this book to distinguish proprietary

trademarks from descriptive terms by following the capitalization style used by the

manufacturer.

The author and publisher have made their best efforts to prepare this book, and the content is

based upon final release software whenever possible. Portions of the manuscript may be based

upon pre-release versions supplied by software manufacturer(s). The author and the publisher

make no representation or warranties of any kind with regard to the completeness or accuracy

of the contents herein and accept no liability of any kind including but not limited to

performance, merchantability, fitness for any particular purpose, or any losses or damages of

any kind caused or alleged to be caused directly or indirectly from this book.

10 9 8 7 6 5 4 3 2 1

Software License Agreement: Terms and Conditions

The media and/or any online materials accompanying this book that are available now or in

the future contain programs and/or text files (the “Software”) to be used in connection with

the book. SYBEX hereby grants to you a license to use the Software, subject to the terms that

follow. Your purchase, acceptance, or use of the Software will constitute your acceptance of

such terms.

The Software compilation is the property of SYBEX unless otherwise indicated and is

protected by copyright to SYBEX or other copyright owner(s) as indicated in the media files

(the “Owner(s)”). You are hereby granted a single-user license to use the Software for your

personal, noncommercial use only. You may not reproduce, sell, distribute, publish, circulate,

or commercially exploit the Software, or any portion thereof, without the written consent of

SYBEX and the specific copyright owner(s) of any component software included on this

media.

In the event that the Software or components include specific license requirements or end-user

agreements, statements of condition, disclaimers, limitations or warranties (“End-User

License”), those End-User Licenses supersede the terms and conditions herein as to that

particular Software component. Your purchase, acceptance, or use of the Software will

constitute your acceptance of such End-User Licenses.

By purchase, use or acceptance of the Software you further agree to comply with all export

laws and regulations of the United States as such laws and regulations may exist from time to

time.

Reusable Code in This Book

The authors created reusable code in this publication expressly for reuse for readers. Sybex

grants readers permission to reuse for any purpose the code found in this publication or its

accompanying CD-ROM so long as all of the authors are attributed in any application

containing the reusable code, and the code itself is never sold or commercially exploited as a

stand-alone product.

Software Support

Components of the supplemental Software and any offers associated with them may be

supported by the specific Owner(s) of that material, but they are not supported by SYBEX.

Information regarding any available support may be obtained from the Owner(s) using the

information provided in the appropriate read.me files or listed elsewhere on the media.

Should the manufacturer(s) or other Owner(s) cease to offer support or decline to honor any

offer, SYBEX bears no responsibility. This notice concerning support for the Software is

provided for your information only. SYBEX is not the agent or principal of the Owner(s), and

SYBEX is in no way responsible for providing any support for the Software, nor is it liable or

responsible for any support provided, or not provided, by the Owner(s).

Warranty

SYBEX warrants the enclosed media to be free of physical defects for a period of ninety (90)

days after purchase. The Software is not available from SYBEX in any other form or media

than that enclosed herein or posted to http://www.sybex.com/ If you discover a defect in the

media during this warranty period, you may obtain a replacement of identical format at no

charge by sending the defective media, postage prepaid, with proof of purchase to:

SYBEX Inc.

Product Support Department

1151 Marina Village Parkway

Alameda, CA 94501

Web: http://www.sybex.com/

After the 90-day period, you can obtain replacement media of identical format by sending us

the defective disk, proof of purchase, and a check or money order for $10, payable to

SYBEX.

Disclaimer

SYBEX makes no warranty or representation, either expressed or implied, with respect to the

Software or its contents, quality, performance, merchantability, or fitness for a particular

purpose. In no event will SYBEX, its distributors, or dealers be liable to you or any other

party for direct, indirect, special, incidental, consequential, or other damages arising out of the

use of or inability to use the Software or its contents even if advised of the possibility of such

damage. In the event that the Software includes an online update feature, SYBEX further

disclaims any obligation to provide this feature for any specific duration other than the initial

posting.

The exclusion of implied warranties is not permitted by some states. Therefore, the above

exclusion may not apply to you. This warranty provides you with specific legal rights; there

may be other rights that you may have that vary from state to state. The pricing of the book

with the Software by SYBEX reflects the allocation of risk and limitations on liability

contained in this agreement of Terms and Conditions.

Shareware Distribution

This Software may contain various programs that are distributed as shareware. Copyright laws

apply to both shareware and ordinary commercial software, and the copyright Owner(s)

retains all rights. If you try a shareware program and continue using it, you are expected to

iii

Plik z chomika:

Inne pliki z tego folderu:

Inne foldery tego chomika: