User-agent: * # Disallow all crawlers access to certain pages. Disallow: /BEEN/ Disallow: /NLNL/ Disallow: /GBooksPreview/ Disallow: /Assets/Media/Sitemap/SitemapNLNL_0.xml Disallow: /Assets/Media/Sitemap/Sitemap/NLNL/ # Sitemap files Sitemap: http://www.proxis.be/Assets/Media/Sitemap/SitemapBEFR_0.xml Sitemap: http://www.proxis.be/Assets/Media/Sitemap/SitemapBENL_0.xml