The Pyms, who were involved in trade with Holland and India, had a footing in Bedfordshire in the late 17th century, but it was initially in Hertfordshire that they built up substantial estates. Pym’s father acquired the Hasells property through his marriage to the Kingsley heiress; Pym himself extended the family’s holdings around Sandy and by 1791, when he was appointed sheriff, he was well established among the Bedfordshire gentry. John Byng, later Viscount Torrington, visited Pym and his wife, daughter of the estate agent of the dukes of Bedford, in May 1794 and found their style of living uncomfortably formal:
Mr P. and his wife, a couple much respected, would be much happier could they cast off much form and grandeur of living; and adopt an easier style; permitting dogs to enter and boots and leathern breeches to sit down to dinner.
Torrington Diaries, iv. 7.
When Pym came forward for the county on a vacancy in December 1805 the 6th Duke of Bedford agreed to support him, but made it clear that his son would stand for Bedfordshire at the first opportunity on coming of age. There was no opposition to his return and he was again unchallenged at the 1806 general election. He supported the ‘Talents’, voting for the repeal of the Additional Force Act, 30 Apr. 1806, and for Brand’s motion condemning the ministerial pledge after their fall, 9 Apr. 1807. A ‘naturally nervous’ man, according to Bedford,
In 1810 Whitbread asserted that ‘the sterling sense and sound integrity of Mr Pym are universally respected’ in Bedfordshire,
There were further doubts about his firmness before the 1812 election, but no opposition was encountered. In 1818, when Osborn stood again, Pym initially declared his own intention of doing so but, baulking at the prospect of an expensive contest, he backed down at the eleventh hour. His loss of nerve mortified Whig supporters, the more so as it was rumoured that he had ‘£20,000 worth of timber upon his estate, which wants to be cut down’, and Bedford told Lord Holland, 4 Aug. 1818, that ‘Old Pym’ had done ‘irreparable mischief’ to ‘the Whig interest in our county’.
