John Tyler $51 million
Like others John Tyler’s wealth came both from an inheritance and marrying into money. He inherited a large tobacco plantation which he retired on after his presidency. He took to farming seriously and would work hard at his farm to make sure he got high yields. He withdrew from politics until the Civil War when he became a leader of the secessionist movement. He would die in debt though due to his generosity, making bad loans and supporting his 14 children.
James Madison $101 million
James Madison was yet another president that was wealthy but struggled with financial trouble following his retirement. He was the largest landowner in Orange County, Virginia and he owned numerous slaves and a tobacco plantation. But the price of tobacco fell and his plantation was neglected while he was president causing him to agonize over money until his death. His wife would then sell the home and the land.