They say Jackson ran off with someone else's wife and later married her as a divorced woman. She became very religious in her old age. Henry Clay dug up this dirt on him and used it in an election. Some historians believe the Jackson campaign's counter-accusation that the equivalent of the state department had hired prostitutes overseas, was completely false. Jackson lamented that he hadn't shot Henry Clay. Jackson was the first president in the Democratic Party.
My history teacher in high school said he had a couple of bullets in him from duels.
Jackson went against a decision of the Supreme Court in the way he treated the Indians.
If I had lived back then and was a voter, I'd probably have voted for someone who was not Andrew Jackson. But if the other side was promoting legalized baby killing, I might change my mind.