V4.2023.09.3983 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
 404checker
-80legs
-AiHitBot
-AllSubmitter
+404enemy
+Apexoo
+Atomseobot
+BBBike
 BDFetch
+BLEXBot
+BackDoorBot
 BackStreet
+Badass
+Barkrowler
+Bigfoot
 Brandprotect
-CSHttp
-CensysInspect
-Cogentbot
+BuiltWith
+BunnySlippers
+CazoodleBot
+Collector
+Cosmos
+DBLBot
+Demon
 Disco
+DnBCrawler-Analytics
 DnyzBot
-DomCopBot
-DomainAppender
-DomainSigmaCrawler
-Dragonfly
-Ebingbong
-EirGrabber
-EroCrawler
-FDM
 FlashGet
-Foobot
-GrapeFX
+Flunky
+GetWeb
+GrabNet
 GrapeshotCrawler
-Havij
-Heritrix
-Hloader
-HonoluluBot
+GridBot
+HTTrack
 IDBTE4M
+Image Fetch
 InfoNaviRobot
-Jbrofuzz
-Jyxobot
-Libwhisker
-LinqiaMetadataDownloaderBot
-Lipperhey
-Litemage_walker
-MQQBrowser
-Microsoft URL Control
-Mozlila
-NetAnts
-Niki-bot
-Nikto
+InterGET
+Lftp
+LieBaoFast
+Likse
+LinkScan
+LinkWalker
+Ltx71
+MJ12bot
+MarkWatch
+Mata Hari
+Metauri
+Moblie Safari
+Net Vampire
+NetSpider
 Ninja
-PECL::HTTP
-PageGrabber
-PageThing.com
+Nuclei
+OutfoxBot
+PHPCrawl
+POE-Component-Client-HTTP
 Panscient
-Pi-Monster
-Piepmatz
-ProWebWalker
-RSSingBot
+Pimonster
+RankActiveLinkBot
+Re-re
+RealDownload
 Reaper
-RedesScrapy
-ScanAlert
-Searchestate
-Seekport
-SenutoBot
-SeoSiteCheckup
-Seomoz
-Sitevigil
-Sociscraper
+SEOkicks-Robot
+SEOprofiler
+Siphon
+SocialRankIOBot
+Sogou web spider
+SpankBot
 Spinn3r
-SputnikBot
+Sqlmap
 Sqlworm
-SuperBot
-T8Abot
-Telesphoreo
-Toweyabot
+Suzuran
+Teleport
 Turnitin
-VelenPublicWebCrawler
-VidibleScraper
-Virusdie
-WEBDAV
-Wallpapers/3.0
-WeSEE
-Web Enhancer
-Web Fuck
-Web Sauger
-WebCopier
+Upflow
+VCI
+Vagabondo
+Voil
+WASALive-Bot
+WPScan
+WallpapersHD
+WebFuck
+WebPix
+WebStripper
+Webshag
 WebsiteQuester
-WinHTTrack
-Wonderbot
+Whack
 Woobot
-Xaldon WebSpider
-ZyBorg
+Xaldon_WebSpider
+archive.org_bot
 autoemailspider
-cah.io.community
-check1.exe
-facebookscraper
-iubenda-radar
-lwp-request
-openai.com
-s1z.ru
-satoristudio.net
-sitechecker.pro
-sp_auditbot
-ubermetrics-technologies.com
-webmeup-crawler
-webpros.com
-xpymep1.exe
+cognitiveseo
+crawler.feedback
+gopher
+internetVista monitor
+meanpathbot
+mediawords
+page scorer
+scan.lol
+sysscan
+voyagerx.com
+webprosbot
+zauba.io
+zgrab