Sassoon was throughout his life an infamous womaniser, known to have frequent affairs. He was known to have had affairs during his first marriage, at least up to eight other woman during the marriage; it is unknown if he had any further affairs during his second marriage.

Sassoon was married twice, first to Philomena FitzFinnigan (624-) from 646 to 654, when the two divorced. He then went on to marry Georgina McCartney in 655.