Willoughby came from Bristol mercantile stock, but could trace descent from the medieval barons Willoughby d’Eresby. One ancestor, John Willoughby (b. c.1616), served as treasurer and master of the Society of Merchant Venturers and, as mayor of Bristol, gained notoriety for sentencing women to punishment by public ducking. His grandson Christopher Willoughby (c.1700-73) of Prince Street, Bristol and Berwick Lodge, Gloucestershire, also held office in the Merchant Venturers.
Willoughby succeeded to the baronetcy as a minor, after the death of his elder brother at Corpus Christi, Oxford in 1813, from a blow sustained whilst playing cricket. He went up to Oxford himself the following year. On coming of age, he succeeded to the family estates, which comprised 2,882 acres in Oxfordshire, Gloucestershire, Surrey and Berkshire in 1872, and the £30,390 residue of his father’s will.
At the 1831 general election he was returned for Yarmouth, Isle of Wight, where the 2nd Baron Yarborough held a controlling interest and returned Members friendly to the Grey ministry. He duly voted for the second reading of the reintroduced reform bill, 6 July, at least twice against adjourning the debates, 12 July, and gave generally steady support to its details, though he was in the minorities against the disfranchisement of Appleby, 19 July, Downton, 21 July, and St. Germans and Saltash, 26 July, and for an amendment to withhold the vote from weekly tenants and lodgers, 25 Aug. 1831. When the fate of his own borough was considered, 26 July, he drew attention to an inhabitants’ petition, of which no record has been found. He divided with ministers on the Dublin election controversy, 23 Aug. He voted for the reform bill’s passage, 21 Sept., the second reading of the Scottish measure, 23 Sept., and for Lord Ebrington’s confidence motion, 10 Oct. 1831. He divided for the second reading of the revised reform bill, 17 Dec. 1831, when he suggested that the more viable national constituency produced by the enfranchisement schedules would provide a more effective check on public expenditure, denied that close boroughs were a necessary buttress of the constitution, and hoped that their abolition might be linked to ending the requirement for those appointed to office to seek re-election. On a note of caution he added that in the metropolitan districts the £10 franchise qualification might prove ‘too low’. He voted for going into committee on the bill, 20 Jan., and supported some of its details, but was in the minorities for excluding urban freeholders from the county electorate, 1 Feb., the enfranchisement of all persons rated to the poor at £10, 3 Feb., and against the inclusion of Helston in schedule B, 23 Feb., Tower Hamlets in schedule C, 28 Feb., and Gateshead in schedule D, 5 Mar. 1832.
Willoughby was in the majority against the second reading of the Vestry Act amendment bill, 23 Jan. 1832. He voted with ministers on the Russian-Dutch loan, 26 Jan., 12, 16, 20 July, and relations with Portugal, 9 Feb. On 31 Jan. he was in the minority for inquiry into distress in the glove trade. He divided to go into committee on Baring’s bill to exclude insolvent debtors from Parliament, 27 June. On 1 Aug. he argued that tithes should be commuted to a fixed charge, especially in Ireland, but denied that the amount appropriated by the Irish clergy had been generally excessive and warned that the anti-tithe movement was the first step towards anarchy. On this issue he could draw on personal experience, having quarrelled with the rector of Marsh Baldon, his half-brother Hugh Pollard Willoughby, over tithe apportionment the previous year, since when he had retained the sums collected for his own use.
At the 1832 general election Willoughby contested Newcastle-under-Lyme as a ‘moderate and constitutional reformer’ and displaced Edmund Peel, a brother of Sir Robert. In the House he veered towards the Conservatives on such issues as reforming the Irish church and the new poor law, but he lost to Peel at the next general election.
