Castle: Re-inventing storage for Big Data
The standard Linux storage stack wasn’t designed for write-heavy big data workloads, nor is it well-suited to modern hardware: large, slow SATA disks, SSDs or many cores. Castle, an open-source project, is a ground-up overhauling of RAID, file systems, and the POSIX interface. It is released under the GPL and runs as part of the Linux kernel. Our target is 1 million random inserts per second to disk on a $1,000 commodity box, and we’re nearly there. Castle is also the core of the Acunu Data Platform, which delivers up to 100x higher performance for applications written for Cassandra and other tools.
YOU MAY ALSO LIKE:
- Monitoring Kubernetes With Prometheus (SkillsCast recorded in September 2018)
- Flexible Architectures: Microservices, Self-contained Systems and Continuous Delivery with Eberhard Wolff & Niko Will (Online Workshop on 22nd - 24th February 2022)
- Deep Learning Fundamentals with Leonardo De Marchi (Online Workshop on 1st - 4th March 2022)
- Getting Geospatial Data on the Web (Online Meetup on 10th February 2022)
- Deep Learning with F#: An Experience Report (SkillsCast recorded in October 2021)
- Architecture Meets Artificial Intelligence (SkillsCast recorded in October 2021)
Castle: Re-inventing storage for Big Data
Tom Wilkie
Tom is one of the Prometheus Developers and VP Product at Grafana Labs. Previously he founded Kausal, a new company working on Prometheus & Cortex. and has worked at companies such as Weaveworks, Google, Acunu and XenSource. In his spare time, Tom likes to make craft beer and build 3D printers.