Penn Yan, the name of the village, is said to have been contrived from the first syllables of "Pennsylvania" and "Yankee", as most of the early settlers were from Pennsylvania and New England; the latter were known as Yankees. It became a trading center for the agricultural county, with mills for lumber, buckwheat and other grains. The village was the western terminus of the former Crooked Lake Canal.