# www.robotstxt.org/ # www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449 User-agent: * Crawl-delay: 10 Disallow: /api Disallow: /redirect Disallow: /logout Disallow: /login Disallow: /register Disallow: /user Disallow: /opener-reload-and-window-close Disallow: /showMore Disallow: /autocomplete Disallow: /image_gallery/ Disallow: /tracking/image_gallery/ Disallow: /artikel-arkiv Disallow: /search Disallow: /sonata/ Sitemap: https://www.berlingske.dk/sitemap.xml