V4.2023.05.3733 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-404enemy
-AhrefsBot
-AwarioSmartBot
-BackDoorBot
-BatchFTP
-Battleztar Bazinga
-BuiltWith
+360Spider
+AllSubmitter
+Atomseobot
+Attach
+Bitacle
+Blackboard
+Boardreader
+Bolt
+Brandwatch
+Buddy
+BunnySlippers
+CCBot
 CODE87
-CazoodleBot
-Citoid
-CrunchBot
-Curious
-DIIbot
-DatabaseDriverMysqli
-Deusu
-Digincore
-DittoSpyder
-DnBCrawler-Analytics
-DomainStatsBot
-Dragonfly
-Drip
-ECCP/1.0
-EasyDL
+Calculon
+CheTeam
+CherryPicker
+Cliqzbot
+Cloud mapping
+Cogentbot
+Copyscape
+DomainSigmaCrawler
+EirGrabber
+Express WebPictures
 Ezooms
-FHscan
+FDM
+FemtosearchBot
 Fimap
+Firefox/7.0
+FrontPage
 GalaxyBot
+GermCrawler
+GetWeb
 Getintent
-Go-Ahead-Got-It
-Grafula
-HTMLparser
-Heritrix
-Jetty
-Jyxobot
-Keybot Translation-Search-Machine
-Kozmosbot
-Lanshanbot
-Lightspeedsystems
-Likse
-LinkWalker
-LinqiaMetadataDownloaderBot
-Lipperhey
-Lmspider
+GrapeshotCrawler
+Hloader
+Iblog
+IlseBot
+Indy Library
+Iskanie
+JennyBot
+LibWeb
 MFC_Tear_Sample
-MIDown tool
-Magnet
-Majestic-SEO
-MarkWatch
-Metauri
-Minefield
+MSFrontPage
+Mag-Net
+Majestic SEO
+Mojolicious
+Morfeus Fucking Scanner
 Mozlila
-NPbot
-Name Intelligence
-Netcraft
-Niki-bot
-Nuclei
-Offline Explorer
-OpenLinkProfiler
-Openfind
-PageAnalyzer
+Nameprotect
+NetLyzer
+NetSpider
+Netvibes
+PageGrabber
 PageScorer
-Pi-Monster
-Pockey
+Picsearch
+PleaseCrawl
+ProWebWalker
 PyCurl
-RankActiveLinkBot
-SBIder
-ScreenerBot
-SiteSnagger
-Snoopy
-Sqlworm
-Surfbot
-True_Robot
-Turingos
-Twice
-UnisterBot
-WBSearchBot
-WallpapersHD
-WeSEE
-Web Fetch
+RSSingBot
+RankActive
+ReGet
+Reaper
+SISTRIX
+SMTBot
+Seekport
+Seomoz
+SiteLockSpider
+Sitevigil
+Sqlmap
+Telesoft
+Telesphorep
+Thumbor
+Typhoeus
+URLy.Warning
+Voil
+WASALive-Bot
+WEBDAV
+WISENutbot
+WebCollage
 WebGo IS
-WebImageCollector
-WebStripper
 WebWhacker
-WinHTTrack
-ZoomBot
-arquivo.pt
+Webster
+Xenu
+Zeus
+archive.org_bot
+arquivo-web-crawler
+backlink-check
+clark-crawler
 com.plumanalytics
+crawl.sogou.com
 dataforseobot
-meanpathbot
-mediawords
-pcBrowser
-plumanalytics
-polaris version
-scalaj-http
-seocompany.store
-serpstatbot
-ubermetrics-technologies.com
-webmeup-crawler
-webpros.com
+facebookscraper
+internetVista monitor
+lwp-request
+satoristudio.net
+seostar
+sogouspider
+tAkeOut
 x09Mozilla
+zgrab