Hazy December Day
LaFarge Cement Silos
How to Download an HTML Manual or Book Using wget
I wanted a local copy of the R-Spatial Book to read while I was up at camp. I was going to write an R script to do this but I realize I simple wget with the right parameters, inspired by this StackOverflow answer will do the trick.
wget --recursive ${comment# self-explanatory} \
--no-parent ${comment# will not crawl links in folders above the base of the URL} \
--convert-links ${comment# convert links with the domain name to relative and uncrawled to absolute} \
--random-wait --wait 3 --no-http-keep-alive ${comment# do not get banned} \
--no-host-directories ${comment# do not create folders with the domain name} \
--execute robots=off --user-agent=Mozilla/5.0 ${comment# I AM A HUMAN!!!} \
--level=inf --accept '*' ${comment# do not limit to 5 levels or common file formats} \
--reject="index.html*" ${comment# use this option if you need an exact mirror} \
--cut-dirs=0 ${comment# replace 0 with the number of folders in the path, 0 for the whole domain} \
$URL
North of Little Falls – Fields and Crop Land
A look at agricultural lands north of little falls and what they are used for and how it blends into the Adirondack Park. It's interesting how Dolgeville is right on the intersection between the fields and pastures of the Mohawk Valley and the heavily wooded Adirondack flatlands.
