William Knollys’ daughter Lettice sold Greys Court to the Paul family. In 1724 Catherine Paul married Sir William Stapleton, who inherited the family's sugar plantations. Their son Thomas joined the notorious Hell Fire club, led by his cousin Sir Francis Dashwood, and later settled down.
He married Mary Fane, niece of the Earl of Westmorland, and his alterations to Greys Court made it a fashionable Georgian house with romantic ruins. Their son later inherited the Despenser barony and moved to Mereworth, but had to sell Greys Court to his mother after he had some financial difficulties.
The Stapletons sold Greys Court to Evelyn Fleming in 1934, but after making some alterations, she moved back to London.
The Brunners: Homemakers and Campaigners 1937 – 1969 (2003)