Lune

AAAI2026Top-tier venue

On the Misalignment Between Data Learnability and Forgettability in Machine Unlearning

Zijie Pan, Zuobin Ying, Yajie Wang, Wanlei Zhou

2026Year

Abstract

We report a structural mismatch between a data point's learnability, which measures how quickly it improves the loss, and its forgettability, which captures how strongly it anchors the final model parameters, an aspect ignored by prior machine unlearning frameworks such as SISA, Fisher Forget, and influence based fine tuning. To make this gap measurable we introduce Unlearning Gradient Sensitivity (UGS), an influence score computable with a single Hutch++ sketch, and derive the Learnability-Forgettability Divergence (LFD), the Jensen-Shannon distance between the model's learning and forgetting distributions. We prove that UGS dispersion decays exponentially only under explicit regularisation and that LFD converges to zero when its weight grows sub-linearly relative to the UGS term. Building on these findings, we introduce Dual-Aware Training (DAT)-a lightweight regularization method that reduces variability in how easily data points can be forgotten and aligns learning and forgetting behaviors during training. On CIFAR-10, MNIST, and IMDB, DAT maintains the original model accuracy while cutting forgettability divergence in half and significantly lowering the cost of certified unlearning, showing that it's effective to make models forgettable from the start.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

Builds on11

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines