Herbert entered the navy at an early age and was in command of the Resource in the West Indies in 1794. He owed his promotion a year later to his father’s ‘never-ceasing importunities and remonstrances’. He subsequently informed the House, 16 Mar. 1807, that he knew all the West Indian islands and had been to Haiti. He appears to have damaged his prospects early in 1802 by leaving his ship before peace was concluded, against Lord St. Vincent’s express wish; but a year later, St. Vincent was prepared to overlook this ‘desertion’ and although he doubted if he could do anything for Herbert afloat, thought he might find him employment ashore. Not long afterwards, he was captain of a convoy to the West Indian fleet.
As soon as the Grenville ministry was formed in 1806, Herbert was returned by his kinsman the 11th Earl of Pembroke for Wilton. His elder brother Lord Porchester, his father and his younger brother William were drawn to the support of the new government and his wife was the ‘favourite niece’ of Mrs Windham, the cabinet minister’s wife.
Herbert was displaced by Lord Pembroke at the dissolution of 1807, in favour of his uncle and namesake. It seems that Sir Christopher Hawkins may have considered returning him for Grampound, but the plan fell through.
