In this talk, Tom Wilkie looks at Castle, an open-source project, is a ground-up overhauling of RAID, file systems, and the POSIX interface
The standard Linux storage stack wasn’t designed for write-heavy big data workloads, nor is it well-suited to modern hardware: large, slow SATA disks, SSDs or many cores. Castle, an open-source project, is a ground-up overhauling of RAID, file systems, and the POSIX interface. It is released under the GPL and runs as part of the Linux kernel. Our target is 1 million random inserts per second to disk on a $1,000 commodity box, and we’re nearly there. Castle is also the core of the Acunu Data Platform, which delivers up to 100x higher performance for applications written for Cassandra and other tools.
YOU MAY ALSO LIKE:
- Dockers unloading pallets of sparky elephants in mesos clusters (in London on 20th May 2015)
- Running ElasticSearch cluster in Docker containers with Weave (in London on 26th May 2015)
- Greg Young's Advanced CQRS & DDD Workshop (in London on 17th - 19th June 2015)
- µCon 2015: The Microservices Conference (in London on 9th - 10th November 2015)
Castle: Re-inventing storage for Big Data
Tom leads the engineering team at Acunu. He previous worked in a range of engineering roles at both Citrix and XenSource managing key customer projects with major enterprises.