Continual Learning and Federated Learning Advances

The field of continual learning and federated learning is rapidly evolving, with a focus on developing innovative methods to address challenges such as catastrophic forgetting, data heterogeneity, and privacy concerns. Recent research has explored the use of dynamic routing, gradient projection, and decentralized cooperation to improve the performance and efficiency of continual learning models. Additionally, there is a growing interest in federated learning, with techniques such as adaptive distillation, personalized models, and zero-shot learning being proposed to enhance the scalability and privacy of federated learning systems. Noteworthy papers in this area include Dynamic Dual-level Defense Routing for Continual Adversarial Training, which proposes a novel framework for continual adversarial training, and Zero-Shot Decentralized Federated Learning, which enables zero-shot adaptation across distributed clients without a central coordinator. These advances have the potential to significantly impact the development of intelligent systems that can learn and adapt in dynamic environments.

Sources

Dynamic Dual-level Defense Routing for Continual Adversarial Training

Task-Agnostic Federated Continual Learning via Replay-Free Gradient Projection

Efficiency Boost in Decentralized Optimization: Reimagining Neighborhood Aggregation with Minimal Overhead

Adaptive Dual-Mode Distillation with Incentive Schemes for Scalable, Heterogeneous Federated Learning on Non-IID Data

Decentralized Dynamic Cooperation of Personalized Models for Federated Continual Learning

EWC-Guided Diffusion Replay for Exemplar-Free Continual Learning in Medical Imaging

TeraAgent: A Distributed Agent-Based Simulation Engine for Simulating Half a Trillion Agents

Data-Free Continual Learning of Server Models in Model-Heterogeneous Federated learning

Zero-Shot Decentralized Federated Learning

TAP: Two-Stage Adaptive Personalization of Multi-task and Multi-Modal Foundation Models in Federated Learning

Continual Learning with Query-Only Attention

Rehearsal-free and Task-free Online Continual Learning With Contrastive Prompt

Diagnosing Shortcut-Induced Rigidity in Continual Learning: The Einstellung Rigidity Index (ERI)

Built with on top of