V4.2024.09.4785 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-ASPSeek
-Aipbot
+AiHitBot
+AllSubmitter
 Anarchy99
 Ankit
-Apexoo
-Bitacle
-BotALot
-Chlooe
-Crescent
+BDCbot
+BackStreet
+BatchFTP
+CATExplorador
+Cegbfeieh
+ChatGPT-User
+ClaudeBot
+Cloud mapping
+Cosmos
 CrunchBot
-Custo
-DSearch
-Disco
-ECCP/1.0
-EroCrawler
-Fuzz
-GalaxyBot
-Haansoft
-Image Fetch
+DataCha0s
+DomainAppender
+Dotbot
+EirGrabber
+ExtLinksBot
+Grafula
+GrapeshotCrawler
+HTMLparser
+IRLbot
+Iblog
+Indy Library
 InfraSec Scanner
-Iskanie
-Jbrofuzz
-JennyBot
-JikeSpider
-Jyxobot
+Intelliseek
+Joomla
+Jorgee
+LeechFTP
+LexiBot
+LibWeb
 Libwhisker
-Linkbot
 Lipperhey
-Litemage_walker
-MQQBrowser
-Masscan
-Meanpathbot
+Majestic SEO
 Mediatoolkitbot
-MegaIndex.ru
-MicroMessenger
-Minefield
-Moblie Safari
-Mojeek
-Mr.4x3
-Musobot
+Microsoft Data Access
+Microsoft URL Control
+Navroad
+Net Vampire
+NetMechanic
+NetZIP
 NextGenSearchBot
-POE-Component-Client-HTTP
-PageScorer
-PageThing.com
-Pandalytics
+Nuclei
+Offline Explorer
+Openfind
+Openvas
+OrangeBot
+OutclicksBot
+PECL::HTTP
 Picscout
-Probethenet
-Psbot
-Pump
-SEOkicks
-SEOkicks-Robot
+Piepmatz
+RSSingBot
+RankActive
+RankurBot
+Re-re
+Reaper
+RocketCrawler
+Rogerbot
 Scanbot
-SeoSiteCheckup
-SiteLockSpider
-SlySearch
-Sottopop
-Spammen
-Spinn3r
-Steeler
-Sucuri
-Szukacz
-T0PHackTeam
-T8Abot
-The Intraformant
-Tracemyfile
-TwengaBot
-V-BOT
-Vagabondo
-Virusdie
-WEBDAV
-WPScan
+ScreenerBot
+Searchestate
+Semrush
+Sitebeam
+Snake
+Snapbot
+Sogou web spider
+Sosospider
+SpankBot
+Spbot
+Sqlmap
+TheNomad
+Thumbor
+Turingos
+Turnitin
+VeriCiteCrawler
 WWW-Mechanize
-Wallpapers
-WallpapersHD
-Web Pix
-WebAuto
-WebGo IS
-Webalta
-Wonderbot
-Woobot
-Wotbox
-ZoomBot
-ZumBot
-ZyBorg
-awario.com
-clark-crawler
-com.plumanalytics
-crawl.sogou.com
-dataforseobot
-gopher
-internetVista monitor
-linkdexbot
+WWWOFFLE
+Web Auto
+WebFuck
+WebWhacker
+WebsiteExtractor
+Webster
+Whacker
+Zauba
+backlink-check
+cah.io.community
+demandbase-bot
+facebookscraper
 linkfluence
-lwp-trivial
-omgili
-pcBrowser
-satoristudio.net
-siteripz
-trendiction.com
-zgrab
+lwp-request
+muhstik-scan
+netEstate NE Crawler
+openai
+page scorer
+probe-image-size
+serpstatbot
+sexsearcher
+sitechecker.pro
+xpymep1.exe