# bad user agents - copied from BCD User-agent: 008 Disallow: / User-agent: BLEXBot Disallow: / User-agent: Yandex Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: SemrushBot Disallow: / User-agent: Fatbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: MJ12bot Disallow: / User-agent: DomainAppender Disallow: / User-agent: coccoc Disallow: / User-agent: image.coccoc Disallow: / User-agent: EasouSpider Disallow: / User-agent: linkdexbot Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: 360Spider Disallow: / User-agent: NetSeer Disallow: / User-agent: proximic Disallow: / User-agent: SearchmetricsBot Disallow: / User-agent: SMTBot Disallow: / User-agent: SeznamBot Disallow: / User-agent: omgilibot Disallow: / User-agent: Sogou web spider Disallow: / User-agent: pimonster Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Scrapy Disallow: / User-agent: Expanse Disallow: / User-agent: Bytespider Disallow: / User-agent: MauiBot Disallow: / User-agent: PetalBot Disallow: / User-agent: AspiegelBot Disallow: / User-agent: internet-measurement Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Dotbot Disallow: / User-agent: Barkrowler Disallow: / User-agent: wp_is_mobile Disallow: / User-agent: python-requests Disallow: / User-agent: Java Disallow: / User-agent: Mozlila Disallow: / User-agent: CensysInspect Disallow: / User-agent: Dataprovider Disallow: / User-agent: Foregenix Disallow: / User-agent: IonCrawl Disallow: / # allow all other bots User-agent: * Allow: / # internal stuff Disallow: /style-guide Disallow: /my-account/* Disallow: /cart Disallow: /checkout/* Sitemap: https://www.covercraft.com/sitemap.xml