Do feel as if I am sometimes the odd person out. My early interests in LOTR and fossils and books continually kept me isolated and unwilling to be part of the group. Do like sports, but not competitive ones, things like cycling, gymnastics, running, hiking and swimming were all personal competitions. My father taught me to box, to defend myself, and I later took up tau kwon do to keep in shape.
Yet most of the things I became involved with were my choice, outside of popular culture, although there was a time when popular music appealed. Suppose it was more a question of my not being interested in many of the fads that came and went, rather than a purposeful desire to not fit in.
I love the LOTR. Maybe not as into it as you are, but I've read the Silmarillion 3 times. That has to count for something.