Kemp had resigned his Lewes seat in 1816 to join his brother-in-law the Rev. George Baring in founding a religious sect, which ‘attracted notoriety, chiefly from the rank and fortune of some of ... its most prominent members’. Doctrinal details are sketchy, but it appears that Unitarian sentiment motivated their secession from the established church. As the ‘leading citizen’ in Brighton and Lewes, Kemp provided places of worship there and was a regular preacher, though he was no great orator. Disillusion with the vagaries of some of his co-religionists seems to have prompted his return to the Anglican fold in 1823, when he resumed a fashionable lifestyle and his political interests; the sect disintegrated two years later.
He was a fairly regular attender who voted with the Whig opposition to Lord Liverpool’s ministry on most major issues. He would have divided for parliamentary reform, 24 Apr., had he not been shut out,
The ministry regarded Kemp as one of the ‘bad doubtfuls’, but he was absent from the crucial division on the civil list, 15 Nov. 1830, having ‘retired to dinner, not anticipating so immediate a division’.
He divided for the second reading of the reintroduced reform bill, 6 July 1831, and steadily for its details. He voted against the complete disfranchisement of Saltash, on which ministers declined to give a lead, 26 July. He believed the people of Brighton were ‘too sensible of the benefit of the reform bill to the country at large to throw any obstacle in its way by making any unreasonable demands for themselves’, 5 Aug. He defended the right of urban freeholders to vote in counties, 17 Aug., disputing the assertion that the Birmingham Political Union had wielded a disproportionate influence in recent Warwickshire elections. He voted for the bill’s passage, 21 Sept., and Lord Ebrington’s confidence motion, 10 Oct. He divided with the minorities for O’Connell’s motion to swear in the Dublin election committee, 29 July, and for printing the Waterford petition urging that the Irish yeomanry be disarmed, 11 Aug. At a Sussex meeting on reform, 4 Nov., he expressed regret at the delay in settling the matter but was consoled that this had ‘generated a more deep rooted and extensive conviction of its justice and expediency and had served to draw a palpable line between those who were friends of the people and those who were not’.
Kemp’s second marriage late in 1832, like his first, was to ‘a lady of fortune’, but this could not halt his slide into deep insolvency, which obliged him to resign his seat in 1837 and live abroad; most of his Brighton property was sold in 1842. He was declared an outlaw in January 1844 after failing to surrender to a suit brought against him. The family historian postulates that his sudden death in Paris in December 1844 may have been by his own hand, but this is contradicted by other sources. He made arrangements for clearing his debts and left his remaining Brighton estate to his son from his second marriage, Frederick Shakerley Kemp. While his ‘mania for building’ had ruined him, it left Kemptown as an enduring monument, and his ‘many philanthropic acts’ also helped shape the growth of Brighton.
