OK
https://www.redditstatic.com/robots.txt
Caribbean Netherlands
Country
Network
December 02, 2024, 01:35 PM UTC
Date & Time
Websites
Websites
Runtime: 1.1s
On December 02, 2024, 01:35 PM UTC, https://www.redditstatic.com/robots.txt was accessible when tested on AS27745 in Caribbean Netherlands.

Failures

HTTP Experiment
null
DNS Experiment
null
Control
null

DNS Queries

Resolver:
172.253.15.209
Query:
IN A www.redditstatic.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
151.101.193.140
@
IN
A
151.101.129.140
@
IN
A
151.101.1.140
@
IN
A
151.101.65.140
Query:
IN AAAA www.redditstatic.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
AAAA
2a04:4e42:200::396
@
IN
AAAA
2a04:4e42::396
@
IN
AAAA
2a04:4e42:600::396
@
IN
AAAA
2a04:4e42:400::396

TCP Connections

Connection to 151.101.1.140:443 succeeded.
Connection to 151.101.129.140:443 succeeded.
Connection to 151.101.193.140:443 succeeded.
Connection to 2a04:4e42:200::396:443 was blocked.
Connection to 2a04:4e42:600::396:443 was blocked.
Connection to 2a04:4e42::396:443 was blocked.
Connection to 2a04:4e42:400::396:443 was blocked.
Connection to 151.101.65.140:443 succeeded.

HTTP Requests

URL
GET https://www.redditstatic.com/robots.txt
Response Headers
Accept-Ranges:
bytes
Content-Length:
507
Content-Type:
text/plain
Date:
Mon, 02 Dec 2024 13:35:13 GMT
Nel:
{"report_to": "w3-reporting-nel", "max_age": 14400, "include_subdomains": false, "success_fraction": 0.02, "failure_fraction": 0.02}
Report-To:
{"group": "w3-reporting-nel", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting-nel.reddit.com/reports" }]}, {"group": "w3-reporting", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting.reddit.com/reports" }]}, {"group": "w3-reporting-csp", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting-csp.reddit.com/reports" }]}
Retry-After:
0
Server:
snooserv
Vary:
Origin
Via:
1.1 varnish
Response Body

User-Agent: *
Disallow: /
Allow: /desktop2x/img/favicon/*
Allow: /favicon.ico
Allow: /icon.png
Allow: /new-icon.png
Allow: /desktop2x/img/social-sharing/*
Allow: /talk/assets/social-sharing/*
Allow: /marketplace-assets/*

User-agent: Googlebot
User-agent: AdsBot-Google
User-agent: AdsBot-Google-Mobile
User-agent: AdsBot-Google-Mobile-Apps
User-agent: Googlebot-Image
User-agent: Googlebot-Video
User-agent: Applebot
User-agent: ClarityBot
Disallow:

User-agent: bingbot
User-agent: MSNBot-Media
Allow: /

Resolver

Resolver ASN
AS15169
Resolver IP
172.253.15.209
Resolver Network Name
Google LLC
Report ID
20241202T133012Z_webconnectivity_BQ_27745_n1_IUJSEdnMLKvExywM
Platform
android
Software Name
ooniprobe-android-unattended (3.7.0)
Measurement Engine
ooniprobe-engine (3.15.2)

Raw Measurement Data

Loading