V4.2024.09.4784 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-Aboundex
-AlphaBot
-Attach
-BBBike
-BackStreet
-Blackboard
-Blow
-Buck
-BuiltWith
-Bytespider
-Crawling at Home Project
+ASPSeek
+Aipbot
+Anarchy99
+Ankit
+Apexoo
+Bitacle
+BotALot
+Chlooe
 Crescent
 CrunchBot
-DataCha0s
-DomCopBot
-DomainAppender
-DomainCrawler
-EMail Siphon
-Ecxi
-Evil
-Extreme Picture Finder
-EyeNetIE
-FlashGet
-FyberSpider
-Go-Ahead-Got-It
+Custo
+DSearch
+Disco
+ECCP/1.0
+EroCrawler
+Fuzz
+GalaxyBot
 Haansoft
-Hloader
-Humanlinks
-Information Security Team InfraSec Scanner
-Keybot Translation-Search-Machine
-Keyword Density
-Lightspeedsystems
-Likse
+Image Fetch
+InfraSec Scanner
+Iskanie
+Jbrofuzz
+JennyBot
+JikeSpider
+Jyxobot
+Libwhisker
 Linkbot
-LinksManager
-MIDown tool
-MJ12bot
-MTRobot
-Mag-Net
-Majestic12
-Mass Downloader
+Lipperhey
+Litemage_walker
+MQQBrowser
+Masscan
+Meanpathbot
+Mediatoolkitbot
+MegaIndex.ru
+MicroMessenger
+Minefield
 Moblie Safari
-Mojolicious
-Nameprotect
-Navroad
-NearSite
-NetSpider
-Nibbler
-OutclicksBot
-PHPCrawl
+Mojeek
+Mr.4x3
+Musobot
+NextGenSearchBot
 POE-Component-Client-HTTP
-PageAnalyzer
-PageGrabber
-PeoplePal
-Piepmatz
+PageScorer
+PageThing.com
+Pandalytics
+Picscout
 Probethenet
-Proximic
+Psbot
 Pump
-QueryN Metasearch
-RankingBot2
-Ripper
-SBIder
-Searchestate
-Siteimprove
-Sociscraper
+SEOkicks
+SEOkicks-Robot
+Scanbot
+SeoSiteCheckup
+SiteLockSpider
+SlySearch
+Sottopop
 Spammen
-SpankBot
-Sucker
-Surfbot
-Swiftbot
-Telesoft
-Toata
+Spinn3r
+Steeler
+Sucuri
+Szukacz
+T0PHackTeam
+T8Abot
+The Intraformant
 Tracemyfile
-Turnitin
-Twice
-URLy.Warning
+TwengaBot
 V-BOT
-VelenPublicWebCrawler
+Vagabondo
+Virusdie
 WEBDAV
-WWWOFFLE
-Web Auto
-Web Fuck
+WPScan
+WWW-Mechanize
+Wallpapers
+WallpapersHD
 Web Pix
-Who.is Bot
+WebAuto
+WebGo IS
+Webalta
+Wonderbot
+Woobot
 Wotbox
-Xenu
-YoudaoBot
-ZmEu
+ZoomBot
 ZumBot
-arquivo-web-crawler
-check1.exe
-coccocbot
-cognitiveseo
-instabid
+ZyBorg
+awario.com
+clark-crawler
+com.plumanalytics
+crawl.sogou.com
+dataforseobot
+gopher
 internetVista monitor
-magpie-crawler
-openai
-polaris version
-s1z.ru
-webpros.com
+linkdexbot
+linkfluence
+lwp-trivial
+omgili
+pcBrowser
+satoristudio.net
+siteripz
+trendiction.com
+zgrab