Thread: Robots!
View Single Post
Old 12-31-2014, 09:11 AM   #3
phiscribe
Junior Member
phiscribe began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Dec 2014
Device: Next7P12-8G
I didn't put a link to my server anywhere and I am getting crawled.

The only way I can think it got out was I am using a free dns service, https://duckdns.org/.

That or Google is sucking stuff out of my email.

A robots.txt with User-agent: * Disallow: / would be nice.

I guess I can try a password.
phiscribe is offline   Reply With Quote