Please log in to watch this conference skillscast.
You will learn about the problems with real-world sites and the solutions Daniel had implemented in Skyscraper to overcome them, including lessons learned from his biggest scraping project to date, a scraper of 500K+ pages of the Polish parliament.
You will also explore the realm of data structures: how the output of Skyscraper fits the definition of a data table and how to represent these in Clojure.
The Call for Papers is now open for Clojure eXchange 2017! Submit your talk for the chance to join a stellar line-up of experts on stage. Find out more.
YOU MAY ALSO LIKE:
- Real-time Stream Processing in Spring Made Easy (in London on 25th August 2022)
- Answering Cloud Security Questions of all the Stakeholders (Online Meetup on 13th September 2022)
- Getting Geospatial Data on The Web (SkillsCast recorded in February 2022)
- An Evening with TimClicks (SkillsCast recorded in September 2021)
Skyscraper: Restructuring the Web
Daniel has been in love with functional programming languages ever since being exposed to OCaml in his freshman year at Warsaw University in 2000. He has since worked with Standard ML, Haskell, Scheme, Common Lisp and Clojure, which is now his preferred way of expressing thoughts as code. He writes Ruby for a living, and hacks on Clojure in his spare time. When not coding, he can be found playing Scrabble, cycling or petting cats.