What this paper is about
Modern mobile devices have access to a wealth of data that is suitable for learning models that can improve user experience on the device. [S1] The paper lists language models for speech recognition and text entry as examples of models that can improve user experience. [S1] The paper also lists image models that can automatically select good photos as an example of models that can improve user experience. [S1]
The paper states that this rich on-device data is often privacy sensitive, large in quantity, or both. [S1] The paper states that these properties may preclude logging the data to a data center and training there using conventional approaches. [S1] The paper advocates an alternative approach that leaves training data distributed on the mobile devices. [S1]
The paper states that the alternative approach learns a shared model by aggregating locally computed updates. [S1] The paper terms this decentralized approach “Federated Learning. [S1] ” [S1] The paper presents a practical method for the federated learning of deep networks based on iterative model averaging. [S1] The paper also reports an extensive empirical evaluation that considers five different model architectures and four datasets. [S1]
Core claims to remember
The paper states that modern mobile devices have access to a wealth of data suitable for learning models. [S1] The paper states that such models can greatly improve user experience on the device. [S1]
The paper states that the relevant data is often privacy sensitive, large in quantity, or both. [S1] The paper states that these properties may preclude logging the data to the data center and training there using conventional approaches. [S1]
The paper advocates an approach that leaves the training data distributed on the mobile devices. [S1] The paper states that this approach learns a shared model by aggregating locally computed updates. [S1]
The paper names this decentralized approach Federated Learning. [S1] The paper presents a practical method for federated learning of deep networks that is based on iterative model averaging. [S1]
The paper reports an extensive empirical evaluation of the proposed federated learning method. [S1] The paper states that this evaluation considers five different model architectures and four datasets. [S1]
Limitations and caveats
The paper states that rich on-device data is often privacy sensitive, large in quantity, or both. [S1] The paper states that these characteristics may preclude logging data to a data center for conventional training approaches. [S1]
The paper reports empirical results from an evaluation that considers five different model architectures and four datasets. [S1] The paper presents its practical method for federated learning of deep networks as being based on iterative model averaging. [S1]
How to apply this in study or projects
Read the paper’s examples of on-device models, including language models for speech recognition and text entry and image models for automatically selecting good photos, and restate how the paper connects these examples to improving user experience. [S1]
Extract the paper’s stated reasons that centralized logging and training may be infeasible, including privacy sensitivity and large data quantity, and rewrite the problem setting using the paper’s wording. [S1]
Locate the paper’s definition of the decentralized approach it calls Federated Learning, and summarize it as “leaving training data distributed on devices and learning a shared model by aggregating locally computed updates. [S1] ” [S1]
Outline the steps of the paper’s practical federated learning method described as iterative model averaging, using the paper’s own description as the organizing phrase for your outline. [S1]
Create a reading checklist for the experimental section that records how the paper structures its extensive empirical evaluation across five different model architectures and four datasets. [S1]