We wanted people to be able to program for the datacenter just like they program for their laptop ~ Ben Hindman
Apache Mesos is a software layer for resource management and scheduling across multiple computers. It has built in support for docker.
Mesosphere provides an interface for automating the deploying mesos and associated packages on a number of cloud providers. I've started taking Mesos for a spin on Google Cloud.
Mesosphere set up everything for me. Basically, I provided my ssh key and it did the rest. Documentation for Mesosphere on Google Cloud is pretty sparse but available at http://mesosphere.com/docs/getting-started/cloud/google/
The mesos console is at http://10.42.95.190:5050
To login to my master node, I need to login from my laptop which has my public ssh key:
ssh jclouds@130.211.180.206The spark console can be launched using /opt/spark/bin/spark-shell. The Spark web view is at http://10.42.95.190:4040, but use OpenVPN to access my cluster first.