StoreSteadyStoreSteady
← All Guides

Fix crawler access blocks on product pages

Robots rules, firewalls, geoblocks, or bot blocking can stop Google from reading products and structured data.

Parent hub
Shopify Google Shopping and Merchant Center fixes
Use the parent hub to route GTIN, attribute, feed, disapproval, diagnostics, policy, shipping, promotion, domain, and crawler-access fixes.

Symptom

The page works for the team but fails for Googlebot because of robots, security middleware, WAF rules, geoblocks, or unstable responses.

Exact cause

Google flagged this state because storeSteady detected a data inconsistency between your Shopify store, Google Merchant Center, or storefront markup. Review the details below to understand the specific mismatch.

This page is about the “works for me” trap. A storefront can render in a browser and still be effectively blocked for Google crawlers.

Which system wins

Public, crawlable HTTP 200 pages win. Robots blocks, noindex, 4xx or 5xx responses, geo rules, and bot blocking break eligibility before feed quality matters.

Correct edit point

Fix robots.txt, WAF or CDN rules, geoblocking, rate limits, and security middleware before changing theme markup.

Manual fix steps

  1. Compare the values shown in the Shopify, Google, and Markup columns below.
  2. Identify which source has the incorrect or missing data.
  3. Update the data in the appropriate system.
  4. Trigger a sync to verify the issue is resolved.

Validation steps

  1. Load the affected product or image URL as an anonymous visitor and confirm it returns a clean HTTP 200 response.
  2. Use URL Inspection or Merchant Center diagnostics to confirm Google can fetch the page or asset.
  3. Wait for Google to recrawl and then re-check the live diagnostic state.
Free Scanner

Audit related storefront signals

Check which related public signals StoreSteady can observe before you connect the app. A scan cannot determine how Google or another platform will classify or resolve the issue.

Source article: Fix crawler access blocks on product pages

Related Issues

More in this family