Dean Wampler
Product Engineering Director for Accelerated Discovery
IBM Research
Dean leads the engineering team for the Accelerated Discovery Platform in IBM Research. He is an expert in data systems, Scala, and software engineering practices. Previously he worked for Domino Data Lab, Anyscale, and Lightbend. Follow Dean on Twitter @deanwampler and LinkedIn at /deanwampler.
Talks I've Given
-
Cluster-wide Scaling of Machine Learning with Ray
Featuring Dean Wampler
Popular ML techniques like Reinforcement learning (RL) and Hyperparameter Optimization (HPO) require a variety of computational patterns for data processing, simulation (e.g., game engines), model search, training, and serving, and other tasks. Few frameworks efficiently support all these...
machine-learning-ai -
Workshop - Workshop on Streaming Data with Kafka and Microservices
Featuring Dean Wampler
When we think of modern data processing, we often think of batch-oriented ecosystems like Hadoop, including processing engines like Spark. However, the sooner we can extract useful information from our data, the better, which is driving an evolution towards stream processing or “fast...
languages -
Streaming Data with Kafka and Microservices
Featuring Dean Wampler
When we think of modern data processing, we often think of batch-oriented ecosystems like Hadoop, including processing engines like Spark. However, the sooner we can extract useful information from our data, the better, which is driving an evolution towards stream processing or “fast...
languages -
Streaming Data with Kafka and Microservices
Featuring Dean Wampler
When we think of modern data processing, we often think of batch-oriented ecosystems like Hadoop, including processing engines like Spark. However, the sooner we can extract useful information from our data, the better, which is driving an evolution towards stream processing or “fast...
big-data -
Workshop - Streaming Data with Kafka and Microservices
Featuring Dean Wampler
When we think of modern data processing, we often think of batch-oriented ecosystems like Hadoop, including processing engines like Spark. However, the sooner we can extract useful information from our data, the better, which is driving an evolution towards stream processing or “fast...
languages -
Streaming Data with Kafka and Microservices
Featuring Dean Wampler
When we think of modern data processing, we often think of batch-oriented ecosystems like Hadoop, including processing engines like Spark. However, the sooner we can extract useful information from our data, the better, which is driving an evolution towards stream processing or “fast...
languages -
Hands-on Kafka Streaming Microservices with Akka Streams and Kafka Streams
Featuring Dean Wampler
If you're building streaming data apps, your first inclination might be to reach for Spark Streaming, Flink, Apex, or similar tools, which run as services to which you submit jobs for execution. But sometimes, writing conventional microservices, with embedded stream processing, is a better fit...
data -
Stream All the Things!!
Featuring Dean Wampler
Streaming data architectures aren't just "faster" Big Data architectures. They must be reliable and scalable as never before, more like microservice architectures.
This talk has three goals:- Justify the transition from batch-oriented big data to stream-oriented fast data.
- Explain the requirements...
-
Keynote: Stream All the Things!
Featuring Dean Wampler
Stream processing is now driving the design of big data systems. Streaming architectures must be highly reliable and scalable as never before, more like microservice architectures.
bigdata spark infiniteconf stream-processing akka -
Fast Data
Featuring Dean Wampler
SMACK stands for Spark, Mesos, Akka, Cassandra and Kafka - a combination that's being adopted for 'fast data'. Join this talk by Big Data expert Dean Wampler and learn how Spark and the SMACK stack helpsolve big data and IoT-type challenges where speed of response is essential.
bigdata fast-data datascience spark data -
Scala and the JVM as a Big Data Platform: Lessons from the Spark Project
Featuring Dean Wampler
Apache Spark is implemented in Scala and it’s user-facing Scala API is very similar to Scala’s own collections API. The power and concision of this API are bringing many developers to Scala.
On the other hand, while the JVM is an excellent, general-purpose platform for scalable...
big-data -
Scala and the JVM as a Big Data Platform: Lessons from the Spark Project
Featuring Dean Wampler
Apache Spark is implemented in Scala and it’s user-facing Scala API is very similar to Scala’s own collections API. The power and concision of this API are bringing many developers to Scala.
On the other hand, while the JVM is an excellent, general-purpose platform for scalable...
big-data -
Scala and the JVM as a Big Data Platform - Lessons from the Spark Project
Featuring Dean Wampler
Apache Spark is implemented in Scala and it's user-facing Scala API is very similar to Scala's own collections API. The power and concision of this API are bringing many developers to Scala.
-
Why Scala is Taking Over the Big Data World
Featuring Dean Wampler
Want to find out why those dealing with Big Data are increasingly being won over by the power of Scala? Dean Wampler, recognised Scala author and expert, will give the keynote to open the second day of Scala X.
scala big-data functional-programming jvm -
Reactive Designs & Language Paradigms
Featuring Dean Wampler
Can reactive designs be implemented in any programming language? Or, are some languages and programming paradigms better for building reactive systems? How do traditional design approaches, like Object-Oriented Design (OOD) and Domain-Driven Design (DDD), apply to reactive applications. The...
software-development -
Reactive Design & Language Paradigms
Featuring Dean Wampler
Can reactive designs be implemented in any programming language? Or, are some languages and programming paradigms better for building reactive systems? How do traditional design approaches, like Object-Oriented Design (OOD) and Domain-Driven Design (DDD), apply to reactive applications. The...
design -
Copious Data, the “Killer App” for Functional Programming
Featuring Dean Wampler
But the MapReduce computing model is hard to use. It’s very course-grained and relatively inflexible. Translating many otherwise intuitive algorithms to MapReduce requires specialized expertise. The industry is already starting to look elsewhere…
However, the very name MapReduce...
practice