I hardly use Facebook anymore since I found fanpop. But I've never used Facebook as a site in which I meet new people, I only have people on Facebook that I know in real life.
But no, they're completely different sites, who cares if you're not on facebook? No one is going to care.