oam/knowledge base/wget.md

wget

Table of contents

1. TL;DR
2. Further readings
3. Sources

TL;DR

# Download all the pictures from a webpage.
# Limit yourself to JPG files from the domain storing them.
# Save them in a single directory.
wget 'https://www.theskyfolk.com/photo' -Hcr -D'images.squarespace-cdn.com' \
  --e'robots=off' -t'3' -w'1' -A'jpg' -nc -nd -np --xattr
wget 'https://www.theskyfolk.com/photo' \
  --span-hosts --continue --recursive \
  --domains 'images.squarespace-cdn.com' --execute 'robots=off' \
  --tries '3' --wait '1' \
  --accept 'jpg' --no-clobber --no-directories --no-parent --xattr

Further readings

• Manual

Sources

All the references in the further readings section, plus the following:

• Ský Fólk