OK
https://external-content.duckduckgo.com/robots.txt
Websites
Runtime: 371ms
On November 23, 2024, 09:38 AM UTC, https://external-content.duckduckgo.com/robots.txt was accessible when tested on AS4788 in Malaysia.
Failures
HTTP Experiment
null
DNS Experiment
null
Control
null
DNS Queries
Resolver:
162.158.25.91
Query:
IN A external-content.duckduckgo.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
20.43.160.189
TCP Connections
Connection to 20.43.160.189:443 succeeded.
HTTP Requests
URL
GET https://external-content.duckduckgo.com/robots.txt
Response Headers
Accept-Ranges:bytesCache-Control:max-age=31536000Content-Length:382Content-Security-Policy:default-src 'none' ; connect-src https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; manifest-src https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; media-src https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; script-src blob: https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com 'unsafe-inline' 'unsafe-eval' ; font-src data: https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; img-src data: https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; style-src https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com 'unsafe-inline' ; object-src 'none' ; worker-src blob: ; child-src blob: https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; frame-src blob: https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; form-action https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; frame-ancestors 'self' https://html.duckduckgo.com; base-uri 'self' ; block-all-mixed-content ;Content-Type:text/plain; charset=UTF-8Date:Sat, 23 Nov 2024 09:38:45 GMTEtag:"67408b83-17e"Expect-Ct:max-age=0Expires:Sun, 23 Nov 2025 09:38:45 GMTLast-Modified:Fri, 22 Nov 2024 13:47:47 GMTPermissions-Policy:interest-cohort=()Referrer-Policy:originServer:nginxStrict-Transport-Security:max-age=31536000Vary:Accept-EncodingX-Content-Type-Options:nosniffX-Duckduckgo-Locale:en_USX-Frame-Options:SAMEORIGINX-Xss-Protection:1;mode=block
Response Body
User-agent: * Disallow: /lite Disallow: /html # No search result pages Disallow: /*? # chrome new tab page Disallow: /chrome_newtab # Email Protection Disallow: /email/ Allow: /email/$ Allow: /email/privacy-guarantees Allow: /email/privacy-terms # Old Privacy page Disallow: /2012-privacy-policy User-agent: ia_archiver Disallow: / Sitemap: https://duckduckgo.com/sitemap.xml
Resolver
Resolver ASN
AS13335
Resolver IP
162.158.25.91
Resolver Network Name
Cloudflare Inc
Report ID
20241123T093810Z_webconnectivity_MY_4788_n1_Iy72a4fY8iCpeKI4
Platform
android
Software Name
ooniprobe-android-unattended (4.0.0)
Measurement Engine
ooniprobe-engine (3.23.0)