Likely not this James Elliott; he's shown on the 1850 census with "Nancy", age 38, who is almost certainly his first wife, Ann Willett (Nancy being a nickname for Ann); the source used for her life dates (Mary Louise Donnelly's "Edward Willett: Colonial Maryland Pewterer, County Clerk, Plantation Owner: His Ancestors and Descendants") appears to be in error regarding the death date of Ann Willett (and if he was married to her in 1850 he can't have married a Sarah/Sally Hammond in 1849).