This is very difficult, because the name is so common. Just to illustrate: in the first complete Swedish census, 1880, there are 142 men named Joh* Er* (Eriksson, Ericsson or Ersson) born in 1854. However, none of them is your John Erickson, because as far as I understand he left Sweden earlier, arrving from New York to Australia in 1874.
Since you have information that his father was named Eric, this indicates that Ericksson was a patronymic name, which does not tell us anything about the last name of his father.
We'll need to ask some follow-up questions. First: how sure are you about the birth year? Does it come from an estimated age at some point in his life? A full birth date would help. Also any inkling of where in Sweden he came from in any of his papers?