Castle: Re-inventing storage for Big Data

In this talk, Tom Wilkie looks at Castle, an open-source project, is a ground-up overhauling of RAID, file systems, and the POSIX interface

The standard Linux storage stack wasn’t designed for write-heavy big data workloads, nor is it well-suited to modern hardware: large, slow SATA disks, SSDs or many cores. Castle, an open-source project, is a ground-up overhauling of RAID, file systems, and the POSIX interface. It is released under the GPL and runs as part of the Linux kernel. Our target is 1 million random inserts per second to disk on a $1,000 commodity box, and we’re nearly there. Castle is also the core of the Acunu Data Platform, which delivers up to 100x higher performance for applications written for Cassandra and other tools.

YOU MAY ALSO LIKE:

• Progressive .NET 2017 (in London on 13th - 15th September 2017)
• London Unreal Engine Meetup (in London on 20th September 2017)
• Fast Track to F# with Tomas Petricek & Phil Trelford (in London on 16th - 17th October 2017)
• Test Driven Development (TDD) Workshop with Damjan Vujnovic (in London on 7th - 8th December 2017)