My advice is be happy with the close circle you have.
Popularity is a myth that doesn't really exist past high school.
It can be tough. I only ever had a select group of friends. I mean, I interacted with people in various activities I did, but those weren't the people I ate lunch with or hung out with outside of school. I had a VERY small group of friends.
Honestly, you're better off having a small group that you know you can trust and count on than a plethora of people that are superficial associates.
It does suck, but also, college allows you to be way more social and open, and there's not all the bullshit stigma of social groups (goths, punks, preps, emos, etc etc etc ad naseum).
Unless you join a fraternity/sorority, but I never really got that either (unless it's a group that actually does something other than drink, sleep around, and organize times to drink and sleep around).