I had a great family, for the most part, when I was growing up there was no such thing as Asperger's yet.
However it was a very sheltered upbringing for me, I had limited real exposure to much of the world around me, between home and church I had a good childhood.
I am glad you had a great family for the most part. Although we homeschool our children, we as parents do not shelter our children, but often get them out daily because of need, for contacts with persons at public activities, like for visits to libraries, shopping places, parks, entertainment and play places, restaurants, and things like that.