Register Interest
IP EXPOCyber SecurityDeveloperAI and AnalyticsIoTBlockchain

Full Stack Developer Theatre

Wed 3rd Oct 15:00 to 15:30

From batch to pipelines - why Mesos and DC/OS are a solution for emerging patterns in data processing

Data processing paradigms are undergoing a paradigm shift as we move more and more towards real time processing. Emerging software models such as the SMACK stack are at the forefront of this change, focused on a pipeline processing model, but are also introducing new levels of operational complexity in running multiple complex distributed systems such as Spark, Kafka and Cassandra. In this talk, I'll introduce both Apache Mesos and DC/OS as a solution to this growing problem, and describe the benefits are of running these new kinds of systems for emerging cloud native workloads.

What you will take away from this session

  • Growing requirements across all industries for processing data in closer and closer to real time
  • Emerging cloud native software stacks are highly complex distributed systems
  • Encoding operational best practice through orchestration systems is critical to success
  • Apache Mesos and DC/OS are solutions proven at massive scale


Photo Speaker Name Profile
Matt Jarvis Matt Jarvis View Profile