How difficult should it be adjusting to a new city?

Well as you said it's cliqu-ish. It's scary being in a place you're not familiar with (especially in a town that you don't know anyone.) It's scary because you can't trust anyone. I wish you good luck.