Modern web scraping

Modern web scraping

By Sawyer X (‎Sawyer X‎)
Date: Monday, 8 June 2015 16:00
Duration: 20 minutes
Target audience: Any
Language: English
Tags: web


Web scraping is fun. It makes data accessible, works around API limits, and makes us feel like gods.

I'll show Web::Query, a module I joyfully started using recently in my scraping, and few examples on stuff I've scraped with it.


Attended by: Brad Lhotsky, Marcus Del Greco, Lonny Jepson, John Karr, Garth Hill, Tony Chambers, Sean Quinlan (‎spq_easy‎), Adam Dutko (‎StylusEater‎), Joseph Hall, Jared Miller, Graham TerMarsch, Ben Wasley, Jeremy Holland, Jan Peterson (‎jlp‎), David Oswald (‎davido‎), Joe Kline (‎gizmo‎), Arthur Schmidt (‎fREW‎), Wes Malone (‎wesm‎), Robert Threet (‎RAT‎), Mike Weisenborn, Karl Williamson, Drew Taylor (‎drewbie‎), Thomas Stanton (‎tstanton‎), Patrick Cronin, Joelle Maslak, Jason McIntosh (‎jmac‎), vroom, Chas. Owens (‎cowens‎), Adam Rich, Joseph Alsop, D Ruth Bavousett (‎druthb‎), Peter Sandin, Geoffrey Darling (‎Geoff‎), Weldon Whipple, Jason Terry, Eric Ellis, Philip Rhinelander, Josh Lavin (‎digory‎), Samuel Smith (‎esaym‎), Julian Brown, Don Silvia, Dillan Hildebrand, Irina Todeva, Ben Grimm, Jack Killilea (‎jrK‎), morgan jones, Louis Erickson, David Hand (‎Ptolemarch‎), Andrew Baerg, Sean Murphy, Mark Wells, Justin Wheeler (‎dnm‎), matt minkin, Daina Pettit, Mike Greb (‎mikegrb‎), Dan Muey, Gary Norton, Tim Bunce, Jason Fuller, Jeremy Koch, Scott Gustafson, Daya Nune, J. Nick Koston (‎bdraco‎), Christopher Eades (‎Chro‎),