Authors
- Xu Xinyi*
- Lingjuan Lyu
- Xingjun Ma*
- Chenglin Miao*
- Chuan-Sheng Foo*
- Bryan Kian Hsiang Low*
* External authors
Venue
- NeurIPS-2021
Date
- 2021
Share
Gradient Driven Rewards to Guarantee Fairness in Collaborative Machine Learning
Xu Xinyi*
Xingjun Ma*
Chenglin Miao*
Chuan-Sheng Foo*
Bryan Kian Hsiang Low*
* External authors
NeurIPS-2021
2021
Abstract
Collaborative machine learning provides a promising framework for different agents to pool their resources (e.g., data) for a common learning task. In realistic settings where agents are self-interested and not altruistic, they may be unwilling to share data or model without adequate rewards. Furthermore, as the data/model the agents share may differ in quality, designing rewards which are fair to them is important so they do not feel exploited and discouraged from sharing. In this paper, we investigate this problem in gradient-based collaborative machine learning. We propose a novel cosine gradient Shapley to evaluate the agents’ contributions and design commensurate rewards in the form of better models. Compared to existing baselines, our method is more efficient and does not require a validation dataset. We provide theoretical fairness guarantees and empirically validate the effectiveness of our method.
Related Publications
Existing collaborative self-supervised learning (SSL) schemes are not suitable for cross-client applications because of their expensive computation and large local data requirements. To address these issues, we propose MocoSFL, a collaborative SSL framework based on Split Fe…
Knowledge Distillation (KD) is a typical method for training a lightweight student model with the help of a well-trained teacher model. However, most KD methods require access to either the teacher's training data or model parameter, which is unrealistic. To tackle this prob…
In real-world applications, deep learning models often run in non-stationary environments where the target data distribution continually shifts over time. There have been numerous domain adaptation (DA) methods in both online and offline modes to improve cross-domain adaptat…
JOIN US
Shape the Future of AI with Sony AI
We want to hear from those of you who have a strong desire
to shape the future of AI.
