Spencer, West Virginia, in the snow. Spencer is the “big” small town in our county, the county seat. The entire county has a population around 15,000, so big and small are relative terms…… Our little town of Walton, where I live, has a population of several hundred. A trip to Spencer is almost like going to THE BIG CITY!!!!