Litchfield Street is possibly named after Edward Lee, 1st Earl of Lichfield, who was brother-in-law of Henry FitzRoy, 1st Duke of Grafton and son of Charles II.
Another theory has it, that it commemorates Charlotte Lee, Countess of Lichfield, daughter of Charles II.