Lord Stavordale seems to have been hardly less afflicted with the passion for gambling than his cousins, Charles James and Stephen Fox. Horace Walpole wrote to Mann about him on 2 Feb. 1770:
Lord Stavordale, not one and twenty, lost eleven thousand ... last Tuesday, but recovered it by one great hand at hazard: he swore a great oath—‘Now if I had been playing deep I might have won millions.’
And George Selwyn to Lord Carlisle, November 1775:
Stavordale was returned unopposed for Midhurst, which in 1768 was placed by its patron, Viscount Montagu, at Lord Holland’s disposal. In the House of Commons he was of little consequence. His first recorded vote was with Administration on Brass Crosby’s case, 27 Mar. 1771. On the royal marriage bill he voted with his cousins in opposition; and his only other recorded vote was with Administration on the revival of the Middlesex question, 26 Apr. 1773. In 1774 Holland had lost control of Midhurst, and Stavordale is not known to have stood anywhere else.
He seems also to have taken his military career very lightly; and when in 1775 his regiment was ordered to America, he resigned his commission.
He died 5 Sept. 1802.