Wearing A Yarmulke

A person removes articles of clothing when he feels at ease, and he covers himself when he believes that he is being judged from above. Therefore, covering one's head is an expression of the sense that the Shekhinah is to be found everywhere and that one is always subject to the immediacy of the omnipresent Divinity.

(Rabbi Adin Steinsaltz)