The house served as the London residence of the Marquesses of Londonderry. It remained their home until its demolition in 1965.

Holdernesse House, later Londonderry House, was designed by Athenian Stuart for Robert Darcy, 4th Earl of Holderness in the period c.1760-5, with ceiling’s based on Robert Wood’s Ruins of Palmyra. The Earl is thought to have acquired the building next door as well, but at a later date. He subsequently joined the two so that the house became a double-fronted London mansion.

The residence was purchased in 1819 by the 1st Baron Stewart, a British aristocrat, to serve as a home whilst the family stayed in London during the annual social season. Soon after the purchase, he began redecorating and spared no expense, as shown by his choice of architects: Benjamin Dean Wyatt and Philip Wyatt. Lord Stewart became the 3rd Marquess of Londonderry in 1822. By 1835, the transformation was complete.

The main stairway was meant to outdo that of Lancaster House in nearby St James’s. It succeeded in this: it had a large skylight, Rococo chandelier and two individual flights of stairs flanking each other. This stairway led into the Grand Ballroom which, rather individually, held pictures of the Stewart family men in Garter Robes. Said to have been inspired by the ’Waterloo Chamber’ of Apsley House, it also outdid that. Around the room were large marble statues by Canova and chairs in the French style.

During World War I, the house was used as a military hospital. After the war, Charles Vane-Tempest-Stewart, Viscount Castlereagh, and his wife, Edith Helen Chaplin, continued to use the house and entertained extensively. After World War II, the house remained in the possession of the family.

The Londonderry age was over by the late 1950s. Retrenchment saw Londonderry House sold in 1962 and demolished, to make way for the London Hilton. The "Londonderry Silver" was mostly bought by the Brighton council for the Royal Pavilion where it can be seen today, along with the Ormonde silver.