Personalization and Efficiency in Artificial Intelligence

The field of artificial intelligence is moving towards personalized and efficient models, with a focus on adapting large language models to meet specific user needs while maintaining privacy and computational efficiency. Researchers are exploring the potential of federated learning and collaborative mechanisms between large and small language models to achieve this goal. The integration of large language models with federated learning is also being investigated, with a focus on addressing challenges such as communication and computation overheads, heterogeneity, and privacy and security concerns. Noteworthy papers include:

  • Towards Artificial General or Personalized Intelligence, which proposes personalized federated intelligence as a key enabling technique for deploying foundation models at the edge with improved personalization, computational efficiency, and privacy guarantees.
  • A Survey on Collaborative Mechanisms Between Large and Small Language Models, which provides a comprehensive overview of interaction mechanisms and enabling technologies for collaboration between large and small language models.

Sources

Towards Artificial General or Personalized Intelligence? A Survey on Foundation Models for Personalized Federated Intelligence

A Survey on Collaborative Mechanisms Between Large and Small Language Models

Small but Significant: On the Promise of Small Language Models for Accessible AIED

Federated Large Language Models: Feasibility, Robustness, Security and Future Directions

Built with on top of