Born a bondman at Burton Pidsea in Yorkshire, Spencer owed his rise to high royal office, his marriage to the daughter of an affluent knight, and his acquisition of valuable landed estates entirely to his own ability and industry. Where he was educated and how he first came to enter royal service is not revealed, but he was described as ‘King’s clerk’ in October 1382 when he obtained a patent of manumission, and a year later he was wearing the livery of a member of the royal household. By 1390 he had been assigned to assist John Carp, the treasurer of the Household, and from then on he often went to the Exchequer in his superior’s place to collect money to cover the expenses of their department. Rewards for his work were soon forthcoming: in October 1390 he was given the corrody reserved for one of the royal clerks at the cathedral church of Coventry; in March 1391 the King granted him a life annuity of £5 charged at the Exchequer; and in January 1392 he was awarded a maintenance at the lazar house at Ilford in Essex.
After the fall of the former Lords Appellant, effected during the first session of the Parliament of 1397 (Sept.), Spencer, like many other royal servants, received a share of their confiscated lands and goods. In October he was granted the free chapel of Shrawardine in Shropshire, forfeited by the earl of Arundel, four months later being formally presented by the King as warden there; and then, in February 1398, he obtained Arundel’s wood at Wellington, worth 20 marks p.a. Spencer’s interests in Shropshire were further increased that May when an annual rent of £12, payable into the Exchequer by the heirs of Nicholas, Lord Audley, for the manor of Ford, was given to him for life.
The usurpation of Henry IV brought in its wake measures which cannot have been to Spencer’s financial advantage. One such was the reversal of the forfeitures of 1397, resulting in his loss of Shrawardine chapel and the wood at Wellington. But the new King could not readily dispense with the services of experienced administrators, even if they had been members of Richard II’s household. Accordingly, on 12 Nov. 1399 Spencer’s annuity of £5 and his £12 p.a. rent from Ford were given royal confirmation, and in the following March he was granted 20 marks yearly at the Exchequer for life, in lieu of the annuity granted him in 1396.
That Spencer was able to make purchases of such value was due to the income he derived from his employment by Henry IV and, more especially, by Henry of Monmouth. He had become a ‘King’s esquire’ by June 1402, and by that date had already been assigned to the prince’s service as his receiver-general and controller of his household, offices which he subsequently shared with his friend, John Wynter. His devotion to duty won him rewards over and above his official fees: for instance, in April 1403 the prince granted him an annuity of £20 from the issues of the toll booth at Bishop’s Lynn. For the next three months Spencer was busily engaged as paymaster to the military captains enlisted to follow the prince into North Wales: based at Chester from 15 May to 11 June and at Shrewsbury for the following week, he moved on to Harlech before the end of that month, and then, with his own small following of eight archers he most probably saw action at the battle of Shrewsbury under the prince’s banner. In 1404 he was once more in the Welsh marches in Monmouth’s entourage, there being preoccupied with disbursements for the household’s expenses during its stay at Hereford and Leominster.
On 28 Mar. 1413, within a week of Henry V’s accession, Spencer’s annuities (which provided him with an annual income of £50 6s.8d.) received royal confirmation. He was then returned to Henry’s first Parliament, and on 13 June, four days after the close of the session, he secured appointment as one of four custodians of the temporalities of the bishopric of Norwich, pending the elevation to the see of the King’s friend, Richard Courtenay. His fellow keepers were Erpingham, Wynter and John Wodehouse, men who like him had all been closely connected with the King while he was prince of Wales. Spencer held an important place in the newly organized royal household: described in the accounts of March to October 1413 as ‘cofferer’, on 1 Oct. he secured promotion to the keepership of the wardrobe, an office he was to hold for the rest of his life.
During Henry V’s reign Spencer established connexions of considerable importance. He acted as a trustee of the estates of Elizabeth, widow of Michael de la Pole, 3rd earl of Suffolk, who had met his death at Agincourt, and in May 1417 he stood bail for Richard, Lord Strange of Knockin, when he was released from the Tower of London. In March that same year he had assisted the King’s standard-bearer, the Hainaulter Sir Lewis Robessart, to purchase lands in England from the estate of a former bishop of Norwich. Among the trustees of his own lands, as named two years earlier, were such prominent figures as Sir Simon Felbrigg KG, Sir John Howard and Sir William Phelip.
