Virgilious D. Remington appears to be living in McDonough Co., Illinois, in the 1850 Federal Census.
In 1860 V.D. & Caroline Remington are at Hillsboro, Washington Co., OR. They have four children born in various states: Illinois, California, & Oregon.
In 1870, the family is at Abiqua Precinct, Marion Co., Oregon: V.D. & Caroline, and (apparently) their four children. Son Dewitt Remington is also with them.
In 1880 Virgilius D. & Clarinda D. Remington are living in Idaho Territory, with their son James. Also in the household are Elmer & Jerome. They are next door to son Comfort Remington and his wife.