Richmond Terrace is on the site of Richmond House, destroyed by a fire on 21 December 1791.
The lease of the site changed hand in the early nineteenth century and in 1822, Richmond Terrace - eight large terraced houses - occupying approximately the same footprint and orientation as the house - was built.
The terrace became a fashionable address but in the 1920s, the leases expired. They returned to use as government offices until a 1982 redevelopment.