Download all of the released NSA documents (continuously updating) with two scripts. Very hacky, but gets the job done. DEPENDS ON LYNX. (Why? Because I'm lazy)
$ apt install lynx
nsadl.sh
#!/bin/bash
echo 'Scraping links from Primary Sources...'
lynx -dump "https://www.eff.org/nsa-spying/nsadocs" | grep "https://www.eff.org/document" | awk '/http/{print $2}' > links
echo 'Done. Links saved as "links.txt"'
echo 'Downloading .pdf documents using "links.txt" -- this may take awhile...'
while read line
do
name=$line
sh scraper.sh $name
done < links
echo 'All done!'
scraper.sh
#!/bin/bash
STR="`wget --quiet -O - $1 | grep -Eo 'https://www.eff.org/files/[0-9]+/[^"]+\.pdf';`"
wget --no-clobber --quiet $STR
Usage:
$ sh nsadl.sh; echo 'Have fun!'