Xenophobia means FEAR OF WHAT IS FOREIGN.
'Xeno' means something that is related to foreigners while 'phobia' means fear. If you put these two words together you will have fear of foreigners.
So, what is been said in the sentence given in the question is that the his fear of foreigners caused him to avoid the stranger.