AI Related Guide
IMPORTANT: Make site AI-Search ready.
Prompt: You are an AI assistant helping to analyze website domains to determine if they are accessible and AI-search ready.
You are an AI assistant helping to analyze website domains to determine if they are accessible and AI-search ready.
### Task
1. For each domain listed below, try to access the site.
2. Report whether the site is accessible (SUCCESS) or not (ERROR).
3. If ERROR, provide the most likely reason (e.g., timeout, DNS issue, 500 internal server error, SSL error, blocked bot access).
4. Summarize accessibility results in a clear, scannable format.
5. Suggest whether the domain is AI-search ready, and provide optimization tips if not.
Domains to Check:
– https://www.domain.com/
– https://www.domain2.com/
– https://www.domain3.com/
### Output Format (per domain):
**Domain:** example.com
**Status:** SUCCESS or ERROR
**Details:** (Short explanation, e.g., “Accessible, loads without error” OR “500 Internal Server Error”)
**AI-Search Ready:** Yes/No
**Suggestions:** (If not AI-ready, list improvements such as sitemap.xml, robots.txt check, structured data, fast load speed, mobile responsiveness, etc.)
### Final Summary
– Total Domains Checked: X
– Successful: X
– Errors: X
– Common Issues Found: (list)
Optimize Site using ChatGPT
Step 1: Make sure site is accessible. Ask ChatGPT to scan the site, example prompt: “Can you access the domain customwinecellarsdallas.com ?”
If not accessible, what you can do:
1.) Check settings in the backend and make sure Search Engine Visibility option is uncheck(Discourage search engines from indexing this site). Site should be indexable.
2.) DMARC, SPF and DKIM should be set
3.) Check Wordfence Security plugin
– Set Web Application Firewall Status to Learning mode
– Add chatgpt ip addresses to whitelist
20.42.10.176/28
172.203.190.128/28
51.8.102.0/24
135.234.64.0/24
23.98.179.16/28
172.183.222.128/28
52.190.190.16/28
51.8.155.64/28
51.8.155.48/28
135.237.131.208/28
51.8.155.112/28
52.159.249.96/28
172.178.141.112/28
172.178.140.144/28
172.178.141.128/28
4.196.118.112/28
20.215.188.192/28
4.197.22.112/28
172.213.21.16/28
172.213.12.112/28
57.154.175.0/28
52.236.94.144/28
23.98.186.192/28
23.98.186.176/28
68.221.67.192/28
13.83.167.128/28
20.97.189.96/28
20.161.75.208/28
52.225.75.208/28
52.156.77.144/28
40.84.221.208/28
40.84.221.224/28
52.230.152.0/24
20.171.206.0/24
20.171.207.0/24
4.227.36.0/25
20.125.66.80/28
172.182.204.0/24
4.) Add this line of code in Robots.txt to allow ChatGPT robots to crawl
User-agent: GPTBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: *
5.) If it all fails then Hosting most likely is blocking robots.txt. Contact their support rep and ask to whitelist the domain.
