I am making an assumption that this family in the 1871 & 1881 British Census belongs to him. The year and place of birth fit; plus, a daughter is named Ellen, and my grandma used to speak of a cousin "Nellie Slack." Elizabeth seems to be the "servant" age 18 who is living with Joseph & Elizabeth Coleman and family in the 1891 census.
In 1871 they are at 1 Union St.; in 1881 they are at 47 Union St., Mansfield.
In 1891 Ann is a widow, still at 47 Union St.
The son John, born c1860, apparently is the one who is married to Mary, and with whom his cousin Florrie Coleman (my great aunt) is living in 1901.