The same “brain drain” applies to any potential distractor even when they aren’t actively distracting us. Research in cognitive psychology tells us that we automatically pay attention to things that are habitually relevant to us, even when we are focused on something else.
Maybe it's time to get rid of even more apps on your smartphone.