The Daniel Graves Dilemma

I've cross posted this in one group on Ravelry, the Knitting Genealogists, as well as here. I'll add a little more detail here to help out.

Okay, so I decided to start a topic as I’ve alluded to this situation enough and you guys give pretty good advice ;-)

Here’s what I know:

Daniel Graves was born in 1794 (according to the 1850 census) in New York, or in Vermont (if you ask his kids on their data forms).

He married Mary “Polly” Ferguson in 1813 in Bennington, Bennington Co, Vermont. A Ferguson researcher and I are determining and so far proving that she is originally from Bennington, a descendant of the relatives of the Hezekiah Ferguson family.

Between 1813 and 1815, they somehow manage to get to New York, where their first child is born. I don’t know this for sure, since its info from census/death certs, but its what I have to go on.

After having some more kids in NY (again, census info, biography info, death certs info), they show up in Middlesex County Ontario for the birth of 2 kids, and they’re back in New York by 1830, and have their last four kids concluding in 1838.

In 1850, I have a for sure census entry in Gouverneur, New York. (One of their kids is named Hazelton and another is nicknamed Hawley. Needless to say, its a bit unusual and makes them a little easier to find).

Then they vanish again. Nothing. I have two more kids assigned to them based off of family information, but no years for their birth and I haven’t been able to find them yet.

The problem is, there are three Daniel Graves in roughly the same area with roughly the same age range. One is in Vermont, still another one in Walpole, NH, one is in Middlesex Co, Ontario, and there’s another one that even shows up in Gouverneur about ten years later (luckily, not the same age so I could spot him).

These guys are driving me batty! I have no idea where else to look to find anything about him. The Graves Family Association has no idea other than he might be the Captain Daniel Graves that lived in Barton, VT for a time, since they don’t know the Captain’s wife’s name, there’s no telling. So I’m stuck. I’ve gone over this and over it, and I don’t know where their information could be hiding.

I have to be missing something here, it just doesn’t seem to make sense to me.

Children:
Pittman Graves
Son
b. ?

Rebecca Graves
Daughter
b. ?
New York

John Graves
Son
b. 29 Jan 1815 (also postulated to be 1826)
New York, United States
d. 7 Aug 1866
Bridgehampton, Sanilac, Michigan, United States

Hezekiah Graves (m. Harriet Hart)
Son
b. 29 Nov 1818
New York, United States
d. 22 Sep 1892
Bridgehampton, Sanilac, Michigan, United States

Enoch Graves (m. Rachel Sipes)
Son
b. 2 March 1826
New York
d. 22 May 1904
Oxford, Oakland, Michigan, USA

Sheldon Hall "Hawley" Graves (m. Hannah Jeffrey) - this nickname is carried down so it is confirmed.
Son
b. 26 Aug 1828
Delaware, Middlesex Bay County, Ontario, Canada
d. 1 Jul 1895
Sanilac, Sanilac, Michigan, United States

Hazelton Graves (m. Lovila Green)
Son
b. 17 Apr 1830
Ontario, Canada
d. 18 Dec 1907
Bridgehampton, Sanilac, Michigan, United States

Elizabeth Ann Graves (m. David Daniel Ingerson)
Daughter
b. 8 April 1831
New York
d. 4 September 1903
Bridgehampton, Sanilac, Michigan, United States

Justus "Jess" Graves
Son
b. 1837
New York

Lewis Graves
Son
b. 1838
New York, United States