Thread: Download Website Links (but not content)
i looking tool can download links referred website not website content. need list of urls dumped text file. needs recursive within domain specify. can suggest tool doing this?
i've looked @ wget, doesn't seem support this...
may have install lynx. safe so.code:lynx -dump http://www.domain.com | grep -a999 "^references$" | tail -n +3 | awk '{print $2 }' > /path/to/file.ext
Forum The Ubuntu Forum Community Ubuntu Specialised Support Ubuntu Servers, Cloud and Juju Server Platforms [ubuntu] Download Website Links (but not content)
Ubuntu
Comments
Post a Comment