This is actually equal to the statement that it is better to live in a cage with fire and lions then to live with materialists. To live with basically means to live in the same apartment. Whomever we live with, or share a kitchen or apartment with should be a devotee. Also, someone to whom we reveal our minds or make close friendships with should be a devotee. We should associate intimately with the Vaisnavas. With other people we can have a formal or official relationship. And of course, we have to be compassionate to everyone, to go out to preach and distribute prasadam. That means that we do associate with them. We do not take their association, but we give them Krishna’s association.

We should act on the level of a madhyama adhikari, which is a second class devotee. Madhyama adhikari worships Krishna, makes close friends with the devotees, helps innocent people and avoids those who are envious and offensive or blasphemous.

On this basis we can live with someone or not live with them. There is nothing wrong if our neighbors are not devotees. Actually, one who wants to preach has to live where there are people.