At the time of Edward the Confessor the people of Cornwall lived a more or less quite life in small settlements and their living earned from land and the sea, they had little or no knowledge of what was going on in the rest of the county let alone England itself. By 1068 the town of Exeter was in the hands of the Conqueror, the people of that city had not given up without a fight and neither had the inhabitants of Cornwall but by at least 1072 William I had total control of England and Cornwall. William held a number of manors in Cornwall himself such as the Manor of Brannel in the south of the county which incidentally becomes the property of the descendants of my family at Week St Mary’s by early in the 13th century. On the whole most of Cornwall was held by the conquerors half brother, Robert, Count of Mortain. Under Mortain in the north of Cornwall there were three other powerful men. Turstin the second most powerful man under Mortain who was Sheriff of Cornwall, Richard Fitz Turold, who was his steward, and Reginald de Vallatort.
It is Richard fitz Turold who we are interested in in connection with Penhallam. It is probable that fitz Turolds father was in Mortains entourage and was said to have been in command of the troops that secured Cornwall and was for this reason he was rewarded with Penhallam. It is probable that he built the foundations and moat which circled the later building. By 1087 Richard Fitz Turold succeeded his father at Penhallam still holding it under the family of Mortain. Due to the exploits of Mortains son and the loss of his the families lands Richard Fitz Turold was given Penhallam which he held directly from the king thus setting the family on the road to being one of the most powerful family in Cornwall.