V4.2024.08.4663 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-ASPSeek
-AfD-Verbotsverfahren
+Aboundexbot
+Acunetix
+Alexibot
 AlphaBot
-Attach
-Barkrowler
-Battleztar Bazinga
-Bitacle
+Anarchy
+BLEXBot
+BotALot
+Brandprotect
 Brandwatch
-CazoodleBot
-ChatGPT-User
-CheeseBot
-ChinaClaw
-Citoid
+Buddy
+BunnySlippers
+Bytespider
+CCBot
+Calculon
 Cloud mapping
-Cosmos
-Crawling at Home Project
-DSearch
-DataCha0s
-DomainAppender
-DomainStatsBot
+Copyscape
+DBLBot
+DIIbot
+Dirbuster
+DomCopBot
 Drip
 ECCP/1.0
-Evil
-Exabot
-Extractor
-FHscan
-Fyrebot
-Grabber
+Fimap
+Flunky
+Fuzz
+GetRight
+HTTP::Lite
+HTTrack
 Heritrix
-IDBot
-Iblog
-Id-search
-IlseBot
-InterGET
-Internet Ninja
-Jyxobot
+InternetSeer
+IstellaBot
 Keybot Translation-Search-Machine
-Keyword Density
-LNSpiderguy
-Libwhisker
-Lightspeedsystems
-Lipperhey Spider
-Lmspider
-MIIxpc
+LWP::Simple
+Leap
+LinkScan
+Ltx71
 MSIECrawler
-Mag-Net
-Majestic-SEO
-Mass Downloader
+Majestic SEO
+MarkWatch
+Microsoft Data Access
+Mozlila
 Musobot
-NICErsPRO
-Navroad
-Nessus
-NetMechanic
+NearSite
+Net Vampire
+Netcraft
 Nettrack
-Ninja
-Nutch
-Offline Explorer
+NextGenSearchBot
+Niki-bot
+Octopus
 OpenLinkProfiler
-OutclicksBot
-PHPCrawl
-POE-Component-Client-HTTP
+Openfind
+OutfoxBot
 PageAnalyzer
-PageScorer
-Pixray
+Picscout
+ProPowerBot
+Psbot
+Pump
 QueryN Metasearch
-RankurBot
-RebelMouse
-Recorder
-SEOprofiler
-Seomoz
-Site Sucker
+Quick-Crawler
+RankingBot2
+ReGet
+RealDownload
+RocketCrawler
+SEOkicks
+Scrapy
+ScrepyBot
+SearchmetricsBot
+SiteExplorer
+SiteLockSpider
 Sitebeam
-Spinn3r
-Sqworm
-TightTwatBot
-Twice
+Siteimprove
+SmartDownload
+Sociscraper
+Sottopop
+SpankBot
+TeleportPro
+Toata
+VB Project
 Vacuum
-VidibleScraper
 VoidEYE
-Wallpapers/3.0
-WeSEE
-Web Enhancer
-WebAuto
-WebBandit
-WebCollage
-WebSucker
-WebsiteQuester
+WEBDAV
+Web Sauger
+WebFetch
+WebFuck
+WebLeacher
+WebZIP
+Whatweb
 Widow
-archive.org_bot
-arquivo-web-crawler
-eCatch
-lwp-trivial
-mediawords
-page scorer
-ripz
-satoristudio.net
-serpstatbot
-siteripz
+Wotbox
+Zeus
+anthropic-ai
+backlink-check
+domainsproject.org
+gopher
+imagesift.com
+lwp-request
+seobility
 sp_auditbot
-ubermetrics-technologies.com
+sysscan
+zauba.io