Smith was born on May 6th, 1814. Smith's father was Samuel Strong and his mother was Hannah Smith. His paternal grandparents were Benajah Strong and Abigail Hurlburt. He had a brother and a sister, named Lewis and Laura. He was the oldest of the three children.