"Easy On Yourself" is when the man has made what he considers one of the hardest decisions he's ever made. As much as he tried to make the relationship work after the affair, he just can't forgive her and trust her. He finally decides to call is quits, and ends the relationship.