Please log in to watch this conference skillscast.
ING is a Data Driven Experimental Enterprise, which is heavily investing in big data, analytics and streaming processing. As in many other enterprises, we deal with a large variety of data sources. Some are responsible for primary processes, while others are used to improve the quality of the service and to keep internal operations going on smoothly. The amount of data which must be handled goes beyond the computing performance of single machines, and vertical scalability is hardly an option.
In this talk, Bas will share an overview of the architecture and projects at ING that have Spark at its core: 'Look Ahead' in the mobile app, the 'Actionable Insights' API and others. He will begin with traditional batch processes, touching upon the latest development about big data, data lakes and hadoop, to move further into the world of in-memory analytics. You will be able to discover what's involved in such a programme. You will also explore lessons learned, best practices and code!
YOU MAY ALSO LIKE:
Predictive analytics with Scala and Spark at ING - Intermediate
Bas is a programmer, scientist, and IT manager. At ING, he is responsible for the Fast Data chapter within the Analytics department. His academic background is in Artificial Intelligence and Informatics. His research on reference architectures for big data solutions was published at the IEEE conference ICITST 2013. Bas has a background in software development, design and architecture with a broad technical view from C++ to Prolog to Scala and is a Spark Certified Developer. He occasionally teaches programming courses and is a regular speaker on conferences and informal meetings.