Part 1-1

Task-wise Selective Adaptation

Sequential adaptationSeq-FT and Seq-LoRA forget what they learn (BWT −63.7 / −55.2), and EWC avoids it only by learning less.

Adapter-basedTask-level adapters are already competitive: IsCiL leads Kitchen at 89.8 AUC, while TAIL-τ leads World at 85.7 versus 84.3.

CiL algorithmEvolving KitchenEvolving World
FWT (%)BWT (%)AUC (%)FWT (%)BWT (%)AUC (%)
Pre-trained24.30.0
Sequential adaptationSeq-FT90.9−63.735.088.9−73.624.9
EWC34.2−19.517.125.7−18.010.5
Seq-LoRA77.5−55.228.385.6−75.121.4
Adapter-basedL2M24.7−2.522.772.1−6.665.9
L2M-g38.2−6.532.364.2−19.348.6
TAIL-g85.3−49.941.590.0−56.839.5
TAIL-τ86.20.086.285.70.085.7
IsCiL (ours)79.311.089.881.72.784.3
OracleMulti-task93.3−1.692.388.62.890.7

FWTnew tasks of the stageBWTtasks already learnedAUCoverall, across 20 stages