V4.2023.08.3958 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-AhrefsBot
-AllSubmitter
-AwarioSmartBot
-BLEXBot
-BackWeb
-Battleztar Bazinga
-Bolt
-Brandwatch
-Bytespider
-Calculon
-CazoodleBot
-CherryPicker
-Curious
+Aboundex
+AlphaBot
+Anarchie
+BBBike
+Bitacle
+BuiltBotTough
+CheeseBot
+Cocolyzebot
+Copier
+CrazyWebCrawler
+CyotekWebCopy
+Disco
+Discoverybot
 DittoSpyder
-DnBCrawler-Analytics
-DomainAppender
-Foobot
-Freeuploader
-FrontPage
-Fyrebot
-Genieo
+DomCopBot
+Download Wonder
+Ebingbong
+FHscan
+Firefox/7.0
+G-i-g-a-b-o-t
 GetWeb
 Go-Ahead-Got-It
-GridBot
-Havij
-IDBot
-Iblog
+GoZilla
+HTTP::Lite
+Humanlinks
 Id-search
-JustView
-Jyxobot
-Larbin
-Leap
-LexiBot
-LibWeb
-LinksManager
-Lipperhey
-Magnet
-Mail.RU_Bot
+Image Fetch
+Image Sucker
+IstellaBot
+LinkScan
+LinqiaRSSBot
+LinqiaScrapeBot
+MFC_Tear_Sample
+MIIxpc
+MQQBrowser
+MSFrontPage
 Majestic SEO
-Masscan
+MarkMonitor
+Mata Hari
 Mb2345Browser
-Mediatoolkitbot
-MicroMessenger
-Microsoft URL Control
-Mister PiX
-MolokaiBot
-Msrabot
-NextGenSearchBot
-Offline Explorer
-OpenVAS
-Openvas
-PageAnalyzer
-Pi-Monster
-Psbot
+Meanpathbot
+Microsoft Data Access
+Mr.4x3
+Musobot
+Needle
+NetMechanic
+NetZIP
+Netvibes
+Nimbostratus
+Nmap
+POE-Component-Client-HTTP
+Panscient
+Papa Foto
+Pump
 RankActiveLinkBot
-RealDownload
-Searchestate
-SentiBot
-SeoSiteCheckup
+RankurBot
+ReGet
+SMTBot
+ScrepyBot
+SearchmetricsBot
+SemrushBot
+Siphon
 Site Sucker
-SiteSucker
-SmartDownload
-Snoopy
-Sqlworm
-SurveyBot
+Sitebeam
+Sitevigil
+SocialRankIOBot
+Sottopop
+SpaceBison
+Spammen
+Sucker
+SuperBot
 Suzuran
-Titan
-Toata
-Toweyabot
-Turingos
-Upflow
-VeriCiteCrawler
-VoidEYE
-Web Fetch
+Szukacz
+TeleportPro
+Tracemyfile
+Trendiction
+TwengaBot
+VB Project
+WASALive-Bot
+WPScan
+Web Auto
+Web Enhancer
+Web Pix
 Web Sauger
-WebAuto
-WebCopier
-WebReaper
-Whack
-WiseGuys Robot
+WebZIP
+Whatweb
+Woobot
 Wprecon
 Xenu
-Zermelo
-ZmEu
-archive.org_bot
-arquivo.pt
+Zade
+ZoominfoBot
+cah.io.community
 clark-crawler
-eCatch
-heritrix
-isitwp.com
-linkdexbot
-page scorer
-probe-image-size
-seocompany.store
-sexsearcher
-sogouspider
-tAkeOut
-webmeup-crawler
-webprosbot
-zauba.io
+instabid
+lwp-trivial
+ripz
+seostar
+siteripz
+trendiction.com
+webpros.com