Question:

What should I do if I don’t want Alexa to crawl my site?

by Guest22456408  |  8 years, 7 month(s) ago

0 LIKES UnLike

I don’t want Alexa to crawl my website. What I’m supposed to do, please guide me.

 Tags: Alexa, crawl, dont, site

   Report

1 ANSWERS

  1. SEO Expert
    Alexa does not wish to crawl anything you want to remain private. All you have to do is tell them. By using a simple robots.txt file you can do so. Robots.txt files are the most widely used standard on the Web for telling crawlers where they should and should not go on your site. All major crawlers respect these robots.txt files, including those from Google, MSN, Yahoo!, etc. There is extensive information about how to create a robots.txt file on Alexa on their Webmasters help page at http://www.alexa.com/help/webmasters.

Question Stats

Latest activity: 8 years, 7 month(s) ago.
This question has been viewed 238 times and has 1 answers.

BECOME A GUIDE

Share your knowledge and help people by answering questions.