Speaking and writing fluency in interactions with chatbots

Utterance fluency, particularly in speaking, has been demonstrated to be a robust indicator of L2 proficiency (Tavakoli et al., 2020), strongly linked to automaticity (Suzuki Segalowitz et al., 2017). We also obtained a proxy of L2 proficiency for the participants through a vocabulary size test (Peters et al., 2019). In parallel, we collected keystroke logs of the written conversational interactions of 81 participants in the CALL game. The keylogs allow us to compute a series of writing fluency metrics, particularly speed and pausing, such as length of P-bursts in characters, characters over time, pause number per minute and median pause length (see also Révész et al., 2022). We will report how results from the same participants correlate across modes and across aspects of utterance fluency and how much they can predict, separately and jointly, L2 proficiency.