From the latest trendy café to the poster hall at conferences, we evolve in noisy environments. Even accustomed to these experiences, not all individuals are equal when facing these challenges. Speech comprehension in noise is often thought to be influenced by sound stream segregation and selective attentional tracking, the two aspects of auditory scene analysis, but also by individual factors, such as cognitive, linguistic and/or musical abilities. The aim of this study was to examine the respective contribution of auditory scene analysis, perceptual musical abilities, memory, attention and vocabulary on speech intelligibility in noise. 80 adults participated in six tasks selected to assess their performance in those abilities. Structural equation modeling showed that perceptual musical abilities predicted auditory stream segregation and memory. These factors, in turn, predicted selective attentional tracking, which was a predictor of speech perception in noise. Performance in the attention and vocabulary tasks were not associated with the other variables. Our results highlight a complex relationship linking low-level factors to speech perception in noise via auditory scene analysis.