Thread Rating:
  • 1 Vote(s) - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Google will print every question on meds u ask
(09-13-2016, 11:18 AM)barq- Wrote: There is a partial technical solution. Does this forum have a robots.txt file? For anyone who doesn't know what robots.txt means, I would say "google it", but that seems a bit inappropriate Wink - though to be fair, Google have some quite detailed and informative info about it.

hxxps://support.google.com/webmasters/answer/6062608?hl=en  - replace hxxps with https at the start.

Basically, a robots.txt file communicates with a search engine when it crawls a website. You can in essence say "please don't index this website". Not all search engines will play nicely, but the big G does obey your request. Not sure it will scrub what is already out there, but might more stop more stuff leaking. You still have to assume anything posted in the open is entirely public.

Guys, why out of 11 pages is nobody talking about the actual solution to this problem, which was pointed out by barq- clear back on page 2.  This is super easy to fix and a site like this should absolutely have a robots.txt file to prevent search engines from crawling it.  Who is in charge of the site?  Who manages DNS and wherever it is hosted?  This is very easy, if you'd like my help constructing the robots.txt file or getting it in place PM me.
Reply


Messages In This Thread
RE: Google will print every question on meds u ask - by devlspawn - 06-15-2018, 02:24 AM

Forum Jump:


Users browsing this thread: 2 Guest(s)