The site selected in 1869 for Spencer was an unforested section north of the Little Sioux River. The city has long served as the southern gateway to Iowa's Great Lakes area to the north and northeast. Though the usual highway commercial strip has developed along US 18, the town itself seems remarkably self-contained. Much of the downtown of the community was rebuilt after a fire that took place on July 4, 1931.