data-engineering webinars

Run Apache Spark on Kubernetes with Amazon EMR on Amazon EKS


Broadcast Date: March 22, 2021 Level: 200 At AWS re:Invent 2020, we introduced Amazon EMR on Amazon EKS to simplify running big data frameworks on Kubernetes. This new deployment lets you use Amazon EMR to run Apache Spark workloads on Amazon EKS, freeing you from self-managing the open source code, providing better performance, and allowing you to consolidate your infrastructure.


cloudkubernetessoftware-developmentdevOpssparkdata-engineeringdata-science

How Apache Spark 3_0 and Delta Lake Enhances Data Lake Reliability


On-demand webinar Apache Spark has become the de facto open source standard for big data processing for its ease of use and performance. The open source Delta Lake project improves Spark’s data reliability, with new capabilities like ACID transactions, Schema Enforcement, and Time Travel.


sparksoftware-developmentdata-engineeringdata-science

Akka for Java Devs Bridging the Imagination Divide


Today’s applications are expected to support a multitude of devices, employ hybrid cloud deployments, persist petabytes of data, deliver millisecond response time and have near-perfect reliability. Traditional patterns and practices for enterprise Java application development simply can’t support these demands, or are so complicated that entire systems can be brought down by single points of failure.


on-demandiotsoftware-developmentakkakubernetesdevOpssparkdata-engineeringdata-sciencejavakafkascala

The Enterprise Architects Intro to Microservices Part 3 Bending Reality with Microservices in Production Systems


Still chugging along with a monolithic enterprise system that’s difficult to scale and maintain, and even harder to understand? In this three-part series on Microservices for enterprise architects, we explain why a microservice-based architecture that consists of small, independent services is far more flexible than the traditional all-in-one systems that continue to dominate today’s enterprise landscape.


on-demandiotsoftware-developmentakkakubernetesdevOpssparkdata-engineeringdata-sciencejavakafkascala

Understanding Akka Streams Back Pressure and Asynchronous Architectures


The term ‘streams’ has been getting pretty overloaded recently–it’s hard to know where to best use different technologies with streams in the name. In this talk by noted hAkker Konrad Malawski, we’ll disambiguate what streams are and what they aren’t, taking a deeper look into Akka Streams (the implementation) and Reactive Streams (the standard).


on-demandiotsoftware-developmentakkakubernetesdevOpssparkdata-engineeringdata-sciencejavakafkascala

The Future of Services Building Asynchronous Resilient and Elastic Systems


Microservices has become a difficult term to pinpoint as more people use it to describe various approaches to building service-based applications. Many of these approaches have become anti-patterns to scale, such as sharing code between services and traditional monolithic CRUD data storage strategies.


on-demandiotsoftware-developmentakkakubernetesdevOpssparkdata-engineeringdata-sciencejavakafkascala

Lessons Learned From Verizon Implementing Microservices


What type of platform does it take to live stream the world’s biggest media and sports events to mobile devices? In this webinar with special guest Christopher Webster, Associate Fellow at Verizon, you can get a feel of what it takes to power one of Verizon’s latest offerings, its go90 platform.


on-demandiotsoftware-developmentakkakubernetesdevOpssparkdata-engineeringdata-sciencejavakafkascala

Fast Data Selecting The Right Streaming Technologies For Data Sets That Never End


Why have stream-oriented data systems become so popular, when batch-oriented systems have served big data needs for many years? Batch-mode processing isn’t going away, but exclusive use of these systems is now a competitive disadvantage.


on-demandiotsoftware-developmentakkakubernetesdevOpssparkdata-engineeringdata-sciencejavakafkascala

Lessons Learned From PayPal Implementing Back-Pressure With Akka Streams And Kafka


Akka Streams and its amazing handling of streaming with back-pressure should be no surprise to anyone. But it takes a couple of use cases to really see it in action - especially in use cases where the amount of work continues to increase as you’re processing it.


on-demandiotsoftware-developmentakkakubernetesdevOpssparkdata-engineeringdata-sciencejavakafkascala

Distributed Systems Done Right Why Java Enterprises Are Embracing The Actor Model


Most likely, your job is heavily focused on helping your organization modernize for the digital era. As the days of purely Object-Oriented Programming and related frameworks come to a close, enterprises migrating to distributed, cloud infrastructures are embracing a different approach: the Actor Model.


on-demandiotsoftware-developmentakkakubernetesdevOpssparkdata-engineeringdata-sciencejavakafkascala

The Basics Of Reactive System Design For Traditional Java Enterprises


Like most things in life, in software there exists an Old and a New way of doing things. The growth of computing power, increase in the sheer number of users, cheaper and more available hardware, and the explosive IoT market mandates that we build our systems using modern methods that diverge from past.


on-demandiotsoftware-developmentakkakubernetesdevOpssparkdata-engineeringdata-sciencejavakafkascala

Exploring Reactive Integrations with Akka Streams Alpakka and Kafka


Since its stable release in 2016, Akka Streams is quickly becoming the de facto standard integration layer between various Streaming systems and products. Enterprises like PayPal, Intel, Samsung and Norwegian Cruise Lines see this is a game changer in terms of designing Reactive streaming applications by connecting pipelines of back-pressured asynchronous processing stages.


on-demandiotsoftware-developmentakkakubernetesdevOpssparkdata-engineeringdata-sciencejavakafkascala