Baker seems to have belonged to a Salisbury family of some standing. His grandfather John, an alderman of the corporation, died in 1768, having, by his will of 15 Mar. 1766, divided his property in Wiltshire between his two sons, the Rev. John and Edward.
This Edward, who was admitted to St. John’s, Cambridge as a duchess of Somerset’s scholar in 1792, did not graduate, nor was he called to the bar.
In the House he was a silent supporter of the Liverpool ministry. He voted against inquiry into the right of voting in parliamentary elections, 20 Feb., repealing the tax on houses worth less than £5, 10 Mar., and limiting the sinking fund, 13 Mar. 1823. He divided against repeal of the Foreign Enlistment Act, 16 Apr., and inquiry into the legal proceedings against the Dublin Orange rioters, 22 Apr. He voted against reform of the Scottish representative system, 2 June 1823, and the representation of Edinburgh, 26 Feb. 1824, 13 Apr. 1826. He divided for the Irish unlawful societies bill, 25 Feb. 1825, and against Catholic relief, 1 Mar., 21 Apr., 10 May, and the Irish franchise bill, 26 Apr. He voted for the duke of Cumberland’s grant, 30 May, 10 June 1825. He was again returned unopposed for Wilton at the general election of 1826. He voted against Catholic relief, 6 Mar. 1827, 12 May 1828. He presented at least one petition against repeal of the Test Acts, 25 Feb., and voted against this next day. He divided with the Wellington ministry against reducing the salary of the lieutenant-general of the ordnance, 4 July 1828. In February 1829 he was listed by Planta, the patronage secretary, among those ‘opposed to the principle of the bill’ to emancipate the Catholics, and, having signed the Wiltshire anti-Catholic address, he voted accordingly, 6, 18, 27, 30 Mar. 1829.
At the general election later that year, the 12th earl of Pembroke, who had succeeded his father in 1827, had Baker replaced at Wilton. Already considered as an ‘effective and valuable officer’, as well as a ‘judge of wine of the first water’, Baker took an active part against the ‘Swing’ rioters in Wiltshire in late 1830.
