V4.2023.05.3726 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-Alexibot
-Asterias
-Attach
-AwarioSmartBot
-Badass
-Bigfoot
-BlowFish
+360Spider
+Aboundex
+AfD-Verbotsverfahren
+BackDoorBot
+BacklinkCrawler
+BetaBot
+Black Hole
+BlackWidow
+Bolt
 BotALot
 Brandprotect
-BuiltWith
-BuzzSumo
-Calculon
-Citoid
-Cocolyzebot
-CrazyWebCrawler
-Dirbuster
-Ecxi
-Extractor
+CODE87
+CheeseBot
+CopyRightCheck
+CrunchBot
+Custo
+CyotekWebCopy
+DBLBot
+DIIbot
+Deusu
+DigitalPebble
+Disco
+Discoverybot
+Dispatch
+DnBCrawler-Analytics
+Domains Project
+Ebingbong
+Express WebPictures
 Extreme Picture Finder
-Flunky
-FrontPage
+Fimap
+FlashGet
 FyberSpider
-Genieo
+G-i-g-a-b-o-t
+GalaxyBot
+GetRight
+Getintent
+Go!Zilla
+Gotit
 GrabNet
-Grabber
-Grafula
+HEADMasterSEO
 HMView
-HaosouSpider
-Harvest
-Iblog
+Heritrix
+Hloader
+Id-search
 IndeedBot
-InfoNaviRobot
-Jyxobot
-LeechFTP
-LeechGet
-Lftp
-Libwhisker
-LinkpadBot
+Intelliseek
+JOC Web Spider
+Joomla
+JustView
+Kinza
+LWP::Simple
+Lanshanbot
+Leap
+LinqiaRSSBot
 LinqiaScrapeBot
-Litemage_walker
-Magnet
-Majestic-SEO
-Mass Downloader
-Microsoft URL Control
-Mojeek
-Nameprotect
-Needle
-NextGenSearchBot
-POE-Component-Client-HTTP
-PageGrabber
-Picsearch
-Pimonster
-Pockey
-Proximic
-Quick-Crawler
-Recorder
-RedesScrapy
-SalesIntelligent
-SeekportBot
+Lipperhey
+MFC_Tear_Sample
+MarkMonitor
+MauiBot
+Mb2345Browser
+MicroMessenger
+OrangeSpider
+Page Analyzer
+PageScorer
+Pavuk
+ProWebWalker
+QueryN Metasearch
+RankingBot
+RankingBot2
+Rankivabot
+ReGet
+ScoutJet
+SemrushBot
 Siphon
-SmartDownload
 Snoopy
-Sogou web spider
-SputnikBot
-Sqlworm
-Suzuran
-TeleportPro
-Trendictionbot
-TwengaBot
-Twice
-URLy.Warning
-VCI
-WWW-Collector-E
+Sosospider
+Sottopop
+Sqlmap
+Steeler
+Titan
+Toata
+V-BOT
 WWWOFFLE
-Wallpapers/3.0
-Web Enhancer
-WebBandit
-WebCollage
-WebEnhancer
-WebImageCollector
+Web Collage
 WebSauger
-WebsiteExtractor
-Xaldon WebSpider
-Xenu
-ZyBorg
-backlink-check
-cognitiveseo
-dataforseo.com
+Zade
+archive.org_bot
+autoemailspider
+com.plumanalytics
 eCatch
 heritrix
 ips-agent
-muhstik-scan
-netEstate NE Crawler
-page scorer
+isitwp.com
+iubenda-radar
+magpie-crawler
+polaris version
+s1z.ru
 sexsearcher
-sogouspider
-voyagerx.com
-webprosbot
-xpymep1.exe
-zauba.io
+siteripz
+x09Mozilla