Do you feel this way even when you encounter a person or persons with the very same interests as you?
Have you ever found such people?
Are there things today, like when you were 16-19, that now make you feel similarly vulnerable? No need for specifics.
Have you just always had social trouble. Or has there been an ebb and a flow over the years. It sounds like possibly the latter.