HANS
predicting the relationship between two sentences (Similar to NLI). Overlap betwen premise and hyphotesis.
Pemise The doctor near the actor dances
Hypthoesis the actor dances
entailment? No
In the no entailment class the model were unable to solve the task. They were good IID, but not OOD.
A Taxonomy and review of generalization research in NLP