V4.2024.07.4630 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-AIBOT
-Aipbot
-Atomseobot
-AwarioBot
-BDFetch
-BackStreet
-BatchFTP
-Bigfoot
-BlackWidow
-Brandprotect
-Brandwatch
-Buck
+ASPSeek
+Aboundex
+Acunetix
+Anarchie
+BDCbot
+Bandit
+Barkrowler
+Bitacle
+Blackboard
+Bolt
+BuiltBotTough
 ChatGPT-User
-ChinaClaw
-Cocolyzebot
-Copier
+Cloud mapping
+Collector
+CopyRightCheck
+CrazyWebCrawler
 Crescent
-DBLBot
-Discobot
-DittoSpyder
+CyotekWebCopy
+DatabaseDriverMysqli
+Devil
 DnyzBot
-DomCopBot
-DomainAppender
-Download Wonder
-EMail Siphon
-EMail Wolf
-Ecxi
-EroCrawler
-ExtractorPro
-FacebookBot
+Extreme Picture Finder
+Fimap
 FrontPage
+G-i-g-a-b-o-t
 GalaxyBot
-HTTP::Lite
-Harvest
-IDBot
-Iblog
-IlseBot
-Image Sucker
-Indy Library
-Intelliseek
-LWP::Simple
-LieBaoFast
-MQQBrowser
+GetWeb
+Go-Ahead-Got-It
+IDBTE4M
+Internet Ninja
+Iria
+Jetty
+Jyxobot
+Likse
+LinkWalker
+Lipperhey Spider
+MSFrontPage
 Mag-Net
+Majestic SEO
 Majestic12
-Morfeus Fucking Scanner
-NICErsPRO
-NetSpider
+Masscan
+Mata Hari
+MauiBot
+Mediatoolkitbot
+Minefield
+Mojolicious
+Msrabot
+NPbot
+NearSite
 Nikto
-NimbleCrawler
-Nimbostratus
-OrangeSpider
-OutclicksBot
-PageGrabber
-Pandalytics
-Psbot
-PyCurl
-RankFlex
-RebelMouse
-SEOstats
-Scanbot
-Scrapy
-Searchestate
-SentiBot
-SenutoBot
-SeoSiteCheckup
-Sitevigil
-Snapbot
-SpaceBison
-Spinn3r
-Suzuran
+Octopus
+Offline Explorer
+ProWebWalker
+PxBroker
+RankingBot
+RankurBot
+Recorder
+SEOprofiler
+Seekport
+SiteCheckerBotCrawler
+SiteExplorer
+SiteSucker
+SmartDownload
+Sociscraper
+SputnikBot
+Stripper
+Sucker
+SuperBot
+SuperHTTP
+Surfbot
 Szukacz
-TheNomad
+TeleportPro
+Telesphoreo
 TightTwatBot
-Toata
-Upflow
-Vacuum
-VeriCiteCrawler
+TurnitinBot
+TwengaBot
+URLy Warning
 VoidEYE
-Voil
-WWW-Mechanize
-Wallpapers/3.0
-WallpapersHD
-Web Fuck
-Whack
-Widow
-Zermelo
+Voltron
+WISENutbot
+WebImageCollector
+Webshag
+Wprecon
+Xenu
 Zeus
-arquivo-web-crawler
-backlink-check
-check1.exe
-clark-crawler
+awario.com
 facebookscraper
-page scorer
+heritrix
+internetVista monitor
+linkdexbot
+lwp-trivial
+netEstate NE Crawler
+openai
 polaris version
-ripz
-siteripz
-trendiction.de
-x09Mozilla
-zauba.io
+seobility
+seoscanners
+sitechecker.pro
+sp_auditbot
+voyagerx.com
+webprosbot