Call Now

WhatsApp

Go back
to top

Arrow Icon
Site Logo

Google webmaster temporarily unreachable

Shape Image Layout Star Icon Star Icon

Google webmaster temporarily unreachable

From what I’ve read and seen, CloudFront does not consistently identify itself in requests. But you can get around this problem by overriding robots.txt at the CloudFront distribution.

1) Create a new S3 bucket that only contains one file: robots.txt. That will be the robots.txt for your CloudFront domain.

2) Go to your distribution settings in the AWS Console and click Create Origin. Add the bucket.

3) Go to Behaviors and click Create Behavior: Path Pattern: robots.txt Origin: (your new bucket).

4) Set the robots.txt behavior at a higher precedence (lower number).

5) Go to invalidations and invalidate /robots.txt.

Now domainname.cloudfront.net/robots.txt will be served from the bucket and everything else will be served from your domain. You can choose to allow/disallow crawling at either level independently.

Another domain/subdomain will also work in place of a bucket, but why go to the trouble.

Tags :

Google webmaster fetch as google temporarily unreachable

Google Webmaster tool fetch error

Related Posts

Google Webmaster Temporarily Unreachable

Outsource WordPress Development

Blazingcoders is an Outsource WordPress Development Company in India. We build custom web applicatio

Read More
Google Webmaster Temporarily Unreachable

eCommerce website maintenance and support services

Blazingcoders Good maintenance of eCommerce website will helps establish your brand and uses full fo

Read More
Google Webmaster Temporarily Unreachable

Accelerated Mobile Pages (AMP) Implementation Service

Accelerated Mobile Pages Implementation Service Accelerated Mobile Pages (AMP) as it is popularly

Read More