What is catastrophic forgetting in neural networks and how does Elastic Weight Consolidation (EWC) address it?

Machine Learning Hard

Machine Learning — Hard

What is catastrophic forgetting in neural networks and how does Elastic Weight Consolidation (EWC) address it?

Key points

  • EWC prevents catastrophic forgetting by adding a regularization term
  • It estimates the importance of old task parameters using the Fisher Information Matrix
  • EWC helps neural networks retain knowledge of previously learned tasks

Ready to go further?

Start full exam Practice more questions

Related questions