Baume was a well-known eccentric who lived a poverty-stricken life in a loft on the South Quay, Douglas, during the mid-nineteenth century. Although his origins were shrouded in mystery, rumours abounded about him having been a secret agent in France following Napoleon's downfall.

Throughout his later life, he insisted he was probably one of the richest men on the Island. Following his death, it was revealed that he had indeed been wealthy and that his estate had been left to Manx trustees for charitable works on the Island. Proceeds from the estate were used to purchase the John Miller Nicholson collection of oil paintings for the Manx nation, now held and displayed at Manx National Heritage.