The Holy of Holies is founded on Sexual Propriety

How are the High Priest and the Holy of Holies connected to modesty and loyalty to one's spouse?