ALPS: A Diagnostic Challenge Set for Arabic Linguistic & Pragmatic Reasoning
Hussein S. Al-Olimat, Ahmad Alshareef
TLDR: ALPS is a diagnostic challenge set designed to test deep semantic and pragmatic understanding in Arabic, revealing current model limitations in morpho-syntactic dependencies despite high fluency scores.