By the late 14th century the Manor had passed to the Norris family, who were to own Speke until the mid-18th century. Most of the building of the present house was the work of three members of the family: William 1 (d. 1506), who was knighted after the Battle of Stoke in 1487, William II (d. 1568) and his son Edward (d. 1606).

Like many such families in the Northwest, the Norrises were Catholics and the numerous priests’ holes at Speke bear witness to their continued loyalty to the old faith. The recusancy fines incurred, particularly by the reckless William IV in the early 17th century, accelerated the financial decline of the family.

Although Thomas, who inherited in 1651, was the first head of the family to espouse Protestantism, he was regarded as a Royalist; his uncle, Edward, was a staunch supporter and held Liverpool for the King for a period. At the end of the Civil War the Norris estates were confiscated by Parliament and not regained until 1662.

The Beauclerks