Oh, my goodness, these Cannons are hard to track down. Is he a junior of the James Madison Cannon married to a Middlebrooks, b. 1799? He seems like a wily type, which makes documentation hard. That would make your James Madison my ancestor's brother. I'm working on building out his siblings now.