In this talk, Tom Wilkie looks at Castle, an open-source project, is a ground-up overhauling of RAID, file systems, and the POSIX interface
The standard Linux storage stack wasn’t designed for write-heavy big data workloads, nor is it well-suited to modern hardware: large, slow SATA disks, SSDs or many cores. Castle, an open-source project, is a ground-up overhauling of RAID, file systems, and the POSIX interface. It is released under the GPL and runs as part of the Linux kernel. Our target is 1 million random inserts per second to disk on a $1,000 commodity box, and we’re nearly there. Castle is also the core of the Acunu Data Platform, which delivers up to 100x higher performance for applications written for Cassandra and other tools.
YOU MAY ALSO LIKE:
- Typesafe's Apache Spark: An Introductory Workshop For Developers (in London on 14th - 15th March 2016)
- CukeUp! 2016 - the progressive BDD conference for testers, devs and product owners (in London on 14th - 15th April 2016)
- Spring Source's Processing Big Data with Hadoop and Pivotal HD (in London on 18th - 21st April 2016)
- Brian Sletten's Data Science Workshop (in London on 30th May - 1st June 2016)
Castle: Re-inventing storage for Big Data
Tom is a Software Engineer at Weaveworks. Previously he was at Google as a Site Reliability Manager for Google Analytics. Before that he was Founder and CTO at Acunu, and before that a Software Engineer at XenSource. In his spare time, Tom likes to make craft beer and build home automation systems.