V4.2023.08.3913 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
+80legs
 Abonti
-Acunetix
-AhrefsBot
-Anarchy99
-Atomseobot
-Attach
-BDCbot
-BackStreet
+Alligator
+BBBike
+Barkrowler
+BetaBot
 Blow
 Brandprotect
-Buddy
-BuzzSumo
-Bytespider
-CazoodleBot
-CensysInspect
-Collector
+BuiltWith
+CCBot
+Cegbfeieh
+CheeseBot
+Claritybot
+Cocolyzebot
+Cogentbot
+Copier
 Craftbot
-Custo
-DataCha0s
-Dirbuster
-DomainStatsBot
-Download Wonder
-Dragonfly
-Ebingbong
+CyotekWebCopy
+Demon
+Digincore
+Discobot
+DnBCrawler-Analytics
+DomCopBot
+Exabot
 FemtosearchBot
-Firefox/7.0
-Flunky
-Genieo
-Getintent
-Gigabot
+G-i-g-a-b-o-t
+HTMLparser
+HTTP::Lite
 Havij
-Hloader
-IDBTE4M
-IRLbot
-Intelliseek
-JetCar
-Jorgee
-MIIxpc
+HybridBot
+Image Sucker
+InfoNaviRobot
+Internet Ninja
+Jbrofuzz
+Keybot Translation-Search-Machine
+Keyword Density
+Leap
+LibWeb
+LinkScan
+LinksManager
+MJ12bot
 MSIECrawler
-Mag-Net
+Mb2345Browser
 MeanPath Bot
-Microsoft Data Access
+Microsoft URL Control
+Mojolicious
 Mozlila
 Musobot
-NPbot
+NICErsPRO
 NearSite
+NetSpider
 Octopus
-Openfind
-OrangeBot
-Panscient
-PictureFinder
-PleaseCrawl
-PyCurl
-RankingBot2
+OrangeSpider
+POE-Component-Client-HTTP
+Pandalytics
+Pavuk
+PeoplePal
+Picscout
+Picsearch
+Pixray
 Re-re
-ReGet
-RebelMouse
-RepoMonkey
-SEOkicks-Robot
-ScanAlert
-SearchmetricsBot
+RealDownload
+SBIder
+SeoSiteCheckup
 Seomoz
+Siphon
 Site Sucker
-Siteimprove
-Sitevigil
-SlySearch
-Snapbot
-Sottopop
-Szukacz
-TheNomad
-Titan
-TwengaBot
+Sitebeam
+Sogou web spider
+SpaceBison
+Sqlworm
+Swiftbot
+Telesphoreo
+Trendictionbot
 Twice
-URLy Warning
-UnisterBot
-Upflow
 Vacuum
-Web Auto
-Web Enhancer
-Web Fetch
-WebGo IS
-WebImageCollector
-WebReaper
-Website Quester
+Virusdie
+Voil
+Voltron
+WASALive-Bot
+Wallpapers
+WeSEE
+Web Pix
+WebEnhancer
+WebFuck
+Webalta
+Widow
 WinHTTrack
-Xaldon WebSpider
-ZmEu
-adscanner
-coccocbot
-com.plumanalytics
-crawler4j
-dataforseo.com
-dataforseobot
-evc-batch
-ripz
+Wotbox
+Wprecon
+clark-crawler
+demandbase-bot
+lwp-trivial
+satoristudio.net
+scalaj-http
+seoscanners
+seostar
+serpstatbot
 sexsearcher
-tAkeOut
-ubermetrics-technologies.com
-webpros.com
-zgrab
+sitechecker.pro