I know the feeling, a similar thing happened with me when I went to a group, I'm not sure if it was just Aspies or what but, I felt odd, they gave us assignments, one I specifically remember involving using a scissors, and everyone had to learn how to use scissors except for me.
Then in school I was always around other 'special needs' kids but I was the only kid in school with Aspergers' syndrome - the rest had different things. I did not feel right with them, in both cases I felt I was much more intelligent.
I'm not sure if there's 'levels' of Asperger's syndrome, it seems to be a genetic thing, and if Asperger's is a form of Autism then all Autistics must have something in common. There's a lot of things associated with Asperger's syndrome, some people might not have something that they are 'supposed' to if they have Aspergers or Autism, I think it mostly has to do with stereotypes and not actual science. I think it is a stereotype that we don't like being social (I find in many cases, especailly with myself, we want to be social, we just aren't very good at it).
And things like that. I'm sure if a person really felt weird about their diagnosis they could have their genetics tested as there seems to be genes associated with it. I'm sure mis-diagnosis happens and this might be the way to tell for sure. I'm pretty confident in my having Aspergers' because I know myself the things I feel, others around me cannot - and it's the explanation the doctors give. I really wish I didn't have it many times - other times it makes me feel special. It's a double edged sword I think.