Detecting Primary Progressive Aphasia (PPA) from Text: A Benchmarking Study
Classifying subtypes of primary progressive aphasia (PPA) from connected speech presents significant diagnostic challenges due to overlapping linguistic markers. This study benchmarks the performance of traditional machine learning models with various feature extraction techniques, transformer-based models, and large language models (LLMs) for PPA classification. Our results indicate that while transformer-based models and LLMs exceed chance-level performance in terms of balanced accuracy, traditional classifiers combined with contextual embeddings remain highly competitive. Notably, SVM using RoBERTa's embeddings achieves the highest classification accuracy. These findings underscore the potential of machine learning in enhancing the automatic classification of PPA subtypes.