This narrative review surveys recent empirical evaluations of AI-based language assessments and presents a case for large language models revolutionizing standardized psychological assessment. It discusses the technological advances of transformers, their applications, and the potential for language-based assessments to modernize mental health evaluation beyond traditional rating scales.