In the 1841 census, Samuel & Mary were in Hucknall-Under-Huthwaite with their three oldest children, and also living with them was Sam's widowed mother, Elizabeth (Wilson) (Coleman) Allsop.
In 1851 they are still there, with Mrs. Allsop, their three children, and a 1-year-old named Mary. Also in the household is Ellen Greaves, age 19, "daughter-in-law." She may be a daughter Mary had before she married Samuel. If so, why wasn't she with them in 1841? Is the baby hers, or Mary's?
In 1881, at Sampsons Yard, Hucknall Under Huthwaite, Samuel & Hannah have no more of their own children living with them, but have two grandsons -- Abraham and Samuel Berrisford, 9 and 6. Also in the household is William Greaves age 86, Mary's father.