Processing Big Data and managing large-scale container deployments both necessitates large compute cluster. And large clusters -especially when running multiple Big Data systems- require some kind of cluster manager and cluster scheduler.
In this talk, we will give an overview how Apache Mesos help solves the problems of large-scale clusters and then take a look at the current state of the Container Orchestration and Big Data ecosystem built on top of this foundation.
For example, Mesos enables users to easily deploy and manage container using different frameworks (e.g., kubernetes, marathon, or Apache Aurora).
Furthermore, we will look at the growing Big Data ecosystem on top of Apache Mesos and DC/OS including, for example, Apache Spark, Apache Cassandra, and Apache Kafka.
Finally, we will also provide some insights into future developments, both for the foundation (i.e., Apache Mesos) as well as the ecosystem on top.