When I hear 'fit in' I get a different perception meaning telling the person to be like everyone else or do what everyone is doing. I don’t like that. I don't follow trends or a crowd.
But from what you are saying fitting in has a totally different meaning that is to be in harmony with others. Which I don't classify as fitting in.
If I go to a club and everyone is drinking does is mean I should also drink with them? I can go the club and have a good time without drinking or smoking. That's where fitting in becomes subjective.
True we are all unique. But we can be different and still connect with others without compromising our morals.