80legs Aboundexbot AdsTxtCrawlerTP AfD-Verbotsverfahren AhrefsBot Anarchy Attach BackStreet BotALot Claritybot Curious Custo DSearch DTS Agent Disco DomCopBot DomainCrawler Domains Project GridBot HEADMasterSEO HTTrack Haansoft HaosouSpider InternetMeasurement Iria JetCar JikeSpider Jorgee Kozmosbot LNSpiderguy LexiBot Libwhisker Likse Linkbot LinkextractorPro Litemage_walker Mail.RU_Bot NearSite Octopus OnCrawl OpenLinkProfiler PeoplePal ProPowerBot RedesScrapy Ripper Rogerbot SBIder Searchestate Semrush SemrushBot-BA SemrushBot-SI Siphon SiteLockSpider Sociscraper Spammen SpankBot Spinn3r SplitSignalBot SputnikBot SurveyBot Telesphorep Titan Toweyabot Trendiction TurnitinBot V-BOT VB Project Vagabondo VoidEYE WBSearchBot WWW-Collector-E WWWOFFLE Web Auto WebAuto WebCollage WebCopier WebFetch WebSauger WebWhacker Whack Wotbox Xenu arquivo.pt clark-crawler cognitiveseo cohere-ai com.plumanalytics crawler.feedback evc-batch gopher lwp-request mediawords omgili pcBrowser ripz sogouspider sysscan tAkeOut webgains-bot xpymep1.exe