He started as an adventurer, laying tracks for the Central Pacific Railroad in California, later moved to Nevada where he mingled with the hardest set of men: there might was law, and pistols and knives set many a dispute. He dabbled in mines and became interested in a patent that he thought would make his fortune. The patent brought him back to Rhode Island where his idea failed. He soon after was hired by the Howe Sewing Machine Company. Success began to follow him, he became head bookkeeper of Howe, later opened his own chain of clothing stores under the name of Fisk & Goff, clothiers. He served two years in the Massachussets State senate and two in the house of Representatives.

Tragedy was lurking close: his eldest son William died at 36 years of age.

He died in Lima, Peru while visiting his son Clarence who was on a mission for the United States.