Most stereotypes, if not all, have a reason for existing. I try to find the reason and examine that. Many pedophiles do have trouble I think with bonding with adults simply because pedophiles are forced to hide a large part of themselves from them. When you have to hide such a large part of yourself that influences not only your sexual interest but also spills into other areas like politics it leads to conversations that dry up quickly; where you have to hold back from saying what you would really like to say. Ultimately interactions with adults become a stressful situation where you have to constantly act. When you can't be authentic it becomes tiring and exhausting. Then you also have to deal with the thought that "if this person knew the truth they'd want me dead" which makes close bonds with these people that much harder.
Now if it were you or another poster here and we were hanging out I'd probably have lots to say and I would find our time together very enjoyable. But I just can't do that with the average person. I can only act and pretend and I can't see them as a real friend.