In the Federal Census of 1850, Thomas & Mercy Remington, ages 37 & 38, both b RI, are living at Southbridge, MA. They have two daughters: Caroline (middle initial I, T, or P?) 15, and Sarah A. 9. Apparently Caroline was a twin to Cornelia, but Cornelia died young. Carrie died in 1855. In 1850, Thomas's brother Henry and family also are living at Southbridge.
In the Federal Census of 1860, Thomas J. Remington is a day laborer living with the family of Henry Fiske at Sturbridge, Worcester Co., MA. It is not clear whether his wife and children have all died, but they are not with him. Perhaps his death record would show whether he was a widower or not. However, I am not sure where he died.