Alternative reproductive tactics affect spatial cognition and innovative problem solving in male house mice

Male alternative reproductive tactics (ARTs) are distinct behavioural mating strategies that members of this sex follow. While these strategies lead to observable differences in behaviour, it remains unclear whether such differences arise from how individuals allocate their time or reflect true intrinsic differences in ability. To address this, we examined the relationship between two ARTs (territoriality or roaming) and problem solving, space use, spatial cognition and social interaction in male house mice, Mus musculus domesticus . Combining observations from seminatural enclosures and controlled laboratory experiments, we tested 72 adult males following one of the two tactics, identified as either ‘territorial’ or ‘roamer’. We found that ARTs influenced space use and problem solving only under ecologically relevant conditions. Specifically, in the seminatural enclosures, roamers visited more and spent more time near novel problems, leading them to be more likely to solve them, as well as exhibiting greater tolerance towards conspecifics compared to territorials. Territorials, on the other hand, engaged in more competitive interactions but limited their exposure to problem-solving opportunities. Under controlled conditions, ARTs showed no differences in spatial learning, problem solving or persistence in engaging with problems, showing that these differences probably exist due to the ecological constraints imposed by the social environment on individuals following different ARTs. Overall, while roamers solved more problems, this probably reflected their higher encounter rate with problems, rather than inherent differences in problem-solving ability. These findings highlight the importance of the ecological and social context when studying the link between behavioural polymorphisms, such as ARTs, and complex traits such as innovative problem solving or cognition. • Alternative reproductive tactics (ARTs) lead to behavioural differences. • Male house mice follow distinct ARTs, being either territorial or roamers. • Male ARTs affected innovation and space use only in ecologically relevant contexts. • When tested alone in cages, there were no differences in innovation or cognition. • Innovation differences emerged when ecological constraints limited time and space.