Spidering Hacks

Perl Cookbook, Second Edition

Perl & XML (O'Reilly Perl)

Learning Perl Objects, References, and Modules

Perl Best Practices

Perl Books

Perl & LWP

Format: Paperback
Author: Sean M. Burke
ReleaseDate: 26 June, 2002
Publisher: O'Reilly Media
Rating:

This book can teach you expert-level web scraping/munging.
If you're comfortable learning how to do something without knowing exactly why it works, then the author's clear step-by-step explantions and numerous progressively more powerful examples should make this book accessible even to relatively innexperienced Perl programmers. If you aren't yet comfortable using object-oriented Perl modules, the multitude of examples will at least allow you see how it's done even if you're a bit fuzzy on what's happening 'underneath' when you call object methods.

More experienced programmers will understand better why things work, but any Perl programmer will set this book down feeling empowered to turn the web into their own valet. No longer do you need to check multiple sites looking for interesting information. Instead, you can readily author code to do that for you and alert you when items of interest are found. You can use these tools to free up personal time, to harvest information to inform business decisions, to automate tedious web application testing, and a zillion other things.

The author's clear exploration of the relevant Perl modules leaves the reader with a good depth of understanding of what these modules do, when you might want to use which module, and how to use them for real world tasks. Before reading the book, I knew of these modules, but they were a rather intimidating pile. I'd used a few of them on occasion for rather limited projects, but was reluctant to invest the time required to read all of the documentation from the whole collection. Mountains of method-level documentation do not a tutorial make. This book takes all of that information, selects the most important parts, and ensures that those parts are covered in progressively more powerful and/or flexible examples.

If you know Perl and you're sick of 'working the web' to get information and you want the web to work for you instead, then you need this book. I had a personal project that was on the back burner for a couple of years because it just sounded too hard. The weekend after I finished this book, I wrote what I had previously thought to be the hard part of that project and it was both easy and fun. This book makes hard things not just possible, but actually easy.

-matt.

Great book!
It's the best *introduction* to these topics I've been able to find. If you are unfamiliar with LWP and web scraping, or HTML parsing using tokens and trees, I strongly recommend this book. Sean's style is clear and concise-just what I expect from an O'Reilly book.

To get the most out of this book, you'll want to be familiar with Object Oriented programming in Perl, because (with the exception of LWP::Simple) all the modules discussed in this book use objects.

Also, don't expect the LWP sample code in the book to work correctly. Many of the sites that the scripts try to "scrape" have changed their layout since this book was published, braking the scripts. This isn't a problem though, because the samples Sean provides are very short and clear, so it's not necessary to run them in order to figure out how they work.

Terrible, bug-infested book...
I was really excited about this book when I first read the reviews, and now here I am only a few chapters in and already thinking about dumping it altogether. I really don't know how the previous 5 reviews gave this book 5 stars. This book has so many flaws for its size, the biggest of which was the codes. I am no Perl expert, but could find my way around in a decent size program. However, no examples I have tried so far in the book actually worked, and some of these are just 10-20 lines long. I am completely new to LWP, I guess like anyone who would buy this book, so it's hard for me to see what the author is doing. The explanation of the code didn't help much either. As oppose to explaining the steps, he just said "the code below does this". And it's pretty obvious little or no editing has gone into this book. If you do buy this book, you'll probably want to make a trip to the Errata page at the Oreilly website. The amount of typos, printing errors, warnings and grammatical mistakes found by readers and editors listed on this page rivals the usuable content of the book itself. You know what, I have spent way too much on this book already.