+- Sinisterly (https://sinister.ly)
+-- Forum: Coding (https://sinister.ly/Forum-Coding)
+--- Forum: Coding (https://sinister.ly/Forum-Coding--71)
+--- Thread: get duckduckgo urls from dorks (/Thread-get-duckduckgo-urls-from-dorks)
get duckduckgo urls from dorks - sunjester - 05-19-2019
Code:
#!/bin/sh
#sunjester / https://underwurld.club/
if [ -z $1 ];
then
echo "please give a duck dork"
exit
fi
echo "searching duckduckgo.."
curl -sLk -H 'User-Agent: Mozilla/5.0 (X11; CrOS x86_64 11895.95.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.125 Safari/537.36' \
-H 'Host: duckduckgo.com' \
-H 'Referer: https://duckduckgo.com/' \
'https://duckduckgo.com/html/?q='$1'&t=h_&ia=web&s=999' >src
echo "gathering links.."
grep -Eo "(http|https)://[a-zA-Z0-9./?=_-]*" src >links
#echo "removing duplicates.."
cat links |sort|uniq >links2
echo "cleaning up directory"
rm src links
mv links2 urls
echo "done!"and to use it...
Code:
./duck.sh 'inurl+php+id'make sure you urlencode your dorks as i did not add that into the script. the urls will be stored in a file named "urls"
RE: get duckduckgo urls from dorks - Sh1tHappens - 05-19-2019
Thank you for your work! I tried it and its working well. Is it possible to make it work with google instead of duckduck?
I have got the feeling, google has got better search results than duckduck or does duckduck got any advantage?
RE: get duckduckgo urls from dorks - mothered - 05-20-2019
Wonderful, just what I needed.
Thank you.
RE: get duckduckgo urls from dorks - Sartux - 05-29-2019
really useful - thanks for this sunjester.
RE: get duckduckgo urls from dorks - Mahal - 07-03-2019
Nice way to search juicy info
RE: get duckduckgo urls from dorks - dreadpixel - 07-08-2019
Nice example to see how to do the proper request on bash.
Thanks.