Sitemap: https://www.compusoft.com/sitemap # Whitelist Crisp user-agents User-agent: Crisp Allow: / User-agent: CrispBot Allow: / User-agent: Crisp IM Allow: / User-agent: Crisp Webbot Allow: / User-agent: Crisp-SnippetCrawler Allow: / User-agent: Crisp-SnippetCrawler/1.0 Allow: / User-agent: Crisp-WebsiteBot Allow: / User-agent: Crisp-DomainProcessing Allow: / User-agent: Crisp-LinkPreview Allow: / User-agent: Crisp-Proxy Allow: / User-agent: Crisp-HooksDeliver Allow: / # General rules for all others User-agent: * Disallow: /download Disallow: /webkalender/arrild/kalender.htm