Deacon Benjamin Foster built a small house on Store Hill about 1824, adding the large front section in 1834. In 1845 he and his wife, Joanna (West) opened their home to transients and guests. Many of their patrons were gentlemen from Massachusetts who came for the summer season to enjoy outings on the lakes, and along the riverbanks, fishing for trout and salmon. The Deacon was a straightforward, matter-of-fact landlord who required all of his guests to register before being shown to a room or seated at a table. He and his wife entertained over a thousand people during the eight years they offered accommodation. H. Howard Kilby and his wife Emily (Kilby), the next owners of the Foster house, used it only as a family residence. After the death of the Kilby's, the house was rented out to different families until it was purchased in the 1930's by Mr. and Mrs. Charles Smith and his sister, Minnie Thompson, descendants of Capt. John Smith. Mr. Smith, a carpenter, made repairs before selling it to Mrs. Susan Comber, former proprietor of Riverside Inn, and her granddaughter and husband, Mina and Donald Phinney.