In many practical situations it is impossible to run existing machine learning methods on a single computer, because either the data is too large or the speed and throughput requirements are too demanding. Researchers and practitioners will find here a variety of machine learning methods developed specifically for parallel or distributed systems, covering algorithms, platforms and applications.