One of the defining characteristics of federated learning is that it keeps raw data decentralized, train model decentralized and then aggregate. Unlike traditional data centre-based distributed learning settings where data is arbitrarily distributed and any node within the network can access the data, Federated Learning involves heterogeneous distributed data to help protect privacy.