Data Deduplication in Haskell: An Experience Report

8th October 2015 in London at CodeNode

There are 34 other SkillsCasts available from Haskell eXchange 2015

Please log in to watch this conference skillscast.

538925119 640

Infinipool produces software to make the process of transporting and storing data more efficient. We exploit the fact that a lot of real-world data is highly redundant. By finding these redundancies explicitly, we are able to avoid transporting and storing a large portion of the data. For our latest program, we chose to use Haskell as the implementation language. So far, the experience has been great. A particularly nice aspect was the abundance of fresh ideas and interesting libraries in the community. Libraries such as Haxl or servant are not only solving concrete problems that we had, but do so in a way that reading the actual papers and understanding the design and implementation is an intellectually rewarding experience. The mathematical feel of the language itself adds to that.

Join us at the Haskell eXchange in 2016!

Want to learn about the latest innovations in Haskell? Join 200+ Haskell and functional programmers to learn and share skills with some of the world's top Haskell experts at the Haskell eXchange 2016 in London. Find out all about Haskell's infrastructure roadmap, learn how Haskell is used in academia and enterprise and discover how Haskell is changing the way our industry tackles complex engineering problems. Early bird tickets already available!


Thanks to our sponsors

Data Deduplication in Haskell: An Experience Report

Philipp Kant

As a theoretical physicist, I spent the better part of the last decade calculating predictions for properties of the Higgs Boson. After it was actually discovered, I decided it was time to do something new. I had already used Haskell for a few years, so I decided to join infinipool, a Berlin software company that had advertised on 'functional jobs'. I am working there since early 2014. My (physics) publications are at http://inspirehep.net/author/profile/P.Kant.2