James Duff 4th Earl

James Duff (1776-1857), the 4th Earl, inherited Duff House after the death of his father Alexander, the 3rd Earl, in 1811.

From an early age, James was to inherit the family estates so his uncle, the 2nd Earl, provided for his education. James' parents were not considered able to provide a suitable upbringing for the future heir, so the 2nd Earl arranged for his young nephew to be sent away from home. James and and his younger brother Alexander were taught Latin and Greek which was the custom for sons of wealthy families and later, James, went to Westminster School in London and Oxford University. At the age of 20 he started his military career abroad, later joining the British army, the Austrian Army and the Spanish Patriotic Army in Cadiz, where he fought Napoleon in the Peninsular Wars and was wounded twice in battle.   

A portrait of James Duff the soldier can be seen in the North Drawing Room. It is by Henry Pickersgill, RA after the original by Sir Henry Raeburn, painted after 1827. It shows him wearing the Breast Star of the Order of the Thistle. Other awards included a Knight of the Spanish Order of St Ferdinand and Knight of the Swedish Order of the Sword. 

Tragically, his wife, Maria (Mary Caroline Manners), whom he had married in 1799, died young after being bitten by a rabid pet dog. The Earl was devastated at his loss and never married again. He retired to Duff House where he spent his life making improvements to the family estates: he founded the town of Fife-Keith (Dufftown), modernised the harbour at Macduff, and had the Fife Arms Hotel built in Low Street, Banff. He also allowed free entry to the grounds surrounding Duff House, which had been private in his uncle’s day.

The 4th Earl had many friends who were entertained at Duff House with rich dishes prepared by his French chef. One of the most famous of these guests was the South American liberator, General Jose de San Martin (1778-1850), who made a surprise visit to Banff in 1824to see his old friend. 

A replica of the sword once used by the General can be seen in Banff Museum in the High Street.

More information on the Earl’s in-laws, the Manners family, whose seat is Grimsthorpe Castle in Lincolnshire, can be found at www.grimsthorpe.co.uk.