A huge part of why we feel comfortable or uncomfortable in certain situations has to do with the past. I, for instance, am a little nervous about driving on a couple nearby highways because I had terrible experiences with traffic jams there when I was first learning to drive. In the years since, I've had no problems, and I often forget those early (frightening!) experiences, but when I go down those roads, I always have this feeling in the back of my mind that something is not quite as it should be. Without knowing about the traffic jams I went through, my fears would seem totally irrational.
Humans are weird creatures, and we're not always logical. There's often not a clear thought process - conscious or subconscious - from assumption to action. In short, it be extremely difficult to piece together the reasons for why a person thinks a certain way without knowing exactly how they think and what's happened to them in the past.
I won't speak for Cognitive Sciences Stack Exchange, because I know little about it. It's certainly worth asking about on their meta site. However, given that we on Interpersonal Skills are probably not going to figure out your thoughts in much detail, I imagine we'd close such a question as Primarily Opinion-Based. There's simply no easy way of knowing.
I assume that my rationale here is partly due to my experience with Health Stack Exchange's longstanding policy against personal health questions. The relevant off-topic close reason there is
Questions requesting personal medical advice are off-topic here. Nobody here can properly address your health issues. Such questions should be taken to your personal physician who can examine you and access your full medical records. For more information, please see this meta post.