OK
https://www.redditstatic.com/robots.txt
Websites
Runtime: 1s
On November 20, 2024, 06:39 PM UTC, https://www.redditstatic.com/robots.txt was accessible when tested on AS21928 in Puerto Rico.
Failures
HTTP Experiment
null
DNS Experiment
null
Control
null
DNS Queries
Resolver:
172.253.8.146
Query:
IN A www.redditstatic.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
151.101.17.140
TCP Connections
Connection to 151.101.17.140:443 succeeded.
HTTP Requests
URL
GET https://www.redditstatic.com/robots.txt
Response Headers
Accept-Ranges:bytesContent-Length:507Content-Type:text/plainDate:Wed, 20 Nov 2024 18:39:21 GMTNel:{"report_to": "w3-reporting-nel", "max_age": 14400, "include_subdomains": false, "success_fraction": 0.02, "failure_fraction": 0.02}Report-To:{"group": "w3-reporting-nel", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting-nel.reddit.com/reports" }]}, {"group": "w3-reporting", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting.reddit.com/reports" }]}, {"group": "w3-reporting-csp", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting-csp.reddit.com/reports" }]}Retry-After:0Server:snooservVary:OriginVia:1.1 varnish
Response Body
User-Agent: * Disallow: / Allow: /desktop2x/img/favicon/* Allow: /favicon.ico Allow: /icon.png Allow: /new-icon.png Allow: /desktop2x/img/social-sharing/* Allow: /talk/assets/social-sharing/* Allow: /marketplace-assets/* User-agent: Googlebot User-agent: AdsBot-Google User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google-Mobile-Apps User-agent: Googlebot-Image User-agent: Googlebot-Video User-agent: Applebot User-agent: ClarityBot Disallow: User-agent: bingbot User-agent: MSNBot-Media Allow: /
Resolver
Resolver ASN
AS15169
Resolver IP
172.253.8.146
Resolver Network Name
Google LLC
Report ID
20241120T183615Z_webconnectivity_PR_21928_n1_P4xeq9Dy7cZKmFId
Platform
android
Software Name
ooniprobe-android-unattended (4.0.0)
Measurement Engine
ooniprobe-engine (3.23.0)