Interesting thought. Makes me think of the description of love in I Cor. 13:4-7. Fear would seem to reverse these attributes of love as well. The fearful person is interested primarily in protecting himself and in so doing is often impatient, unkind, jealous, boastful, arrogant. He often acts unbecomingly, seeks his own, is easily provoked, and takes into account every wrong. I'm not sure I would say that he rejoices in unrighteousness, but certainly he often finds the truth painful, rather than a joyous thing. He avoids many things, believes the worst, fears the worst, and cuts and runs when things become too uncomfortable.
This is not a condemnation of the fearful person, but we can see how fear takes away the joy of fellowship, friendship, intimacy, and openness.