My 5th cousin, Ellen Lewis (Herndon) Arthur, died before her husband, Chester Arthur, became president. The White House still lists her as a First Lady as Chester never officially put someone else in that role.
But the White House officially changed the website earlier this year and changed the heading of the White House page from First Ladies to First Families. Ellen is number 22.