V4.2024.04.4414 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-AIBOT
-ALittle Client
-ASPSeek
-AiHitBot
-Alligator
-BBBike
-BackWeb
-BetaBot
-Bitacle
-Bolt
+404checker
+404enemy
+AfD-Verbotsverfahren
+Aspiegel
+AwarioRssBot
+Blow
 Buddy
 BuiltBotTough
-BunnySlippers
-Cegbfeieh
-CensysInspect
-ChinaClaw
-Collector
-Copyscape
+BuiltWith
+CSHttp
+DIIbot
 Devil
-Ebingbong
-Ecxi
-EirGrabber
-EroCrawler
+Discobot
+DnBCrawler-Analytics
+Dragonfly
+Drip
 Extractor
+Extreme Picture Finder
+FDM
+Flunky
 Fuzz
-GPTBot
-GetRight
-Gotit
+Go!Zilla
 Grafula
 GrapeFX
 GrapeshotCrawler
-HTTrack
-Iblog
-InfoNaviRobot
-Internet Ninja
+HEADMasterSEO
+HTTP::Lite
+Havij
+Heritrix
+Id-search
+ImagesiftBot
+InterGET
+Iskanie
+IstellaBot
 JOC Web Spider
+Jbrofuzz
 JetCar
+LWP::Simple
+Larbin
+Leap
 LeechFTP
-LibWeb
-LinkpadBot
-LinqiaRSSBot
-Lipperhey
-Ltx71
-Majestic SEO
-Majestic-SEO
-Mediatoolkitbot
-Minefield
-Moblie Safari
-Mojeek
+LexiBot
+LieBaoFast
+LinkWalker
+Litemage_walker
+MQQBrowser
+MauiBot
+Microsoft URL Control
 Mojolicious
-Netcraft
-NextGenSearchBot
-Nikto
-NimbleCrawler
+NPbot
+Nessus
+Net Vampire
+Nettrack
 Nimbostratus
-Nutch
+Offline Explorer
+OrangeSpider
 Page Analyzer
-Papa Foto
+PageScorer
 Petalbot
-Picsearch
-Psbot
-Rainbot
-RankingBot
+PictureFinder
+PleaseCrawl
+Pockey
+ProWebWalker
+PxBroker
+QueryN Metasearch
+RankingBot2
 Reaper
-RepoMonkey
-SearchmetricsBot
-SemanticJuice
-Snapbot
-Sqlmap
-Steeler
-Stripper
+Recorder
+SEOkicks
+SEOlyticsCrawler
+Searchestate
+Site Sucker
+Snoopy
+Spinn3r
 SuperHTTP
-TwengaBot
-VCI
-VelenPublicWebCrawler
-VoidEYE
-Voil
-WPScan
-WWW::Mechanize
-WallpapersHD
-Web Fetch
+T8Abot
+Thumbor
+Tracemyfile
+Turingos
+V-BOT
+Voltron
+WEBDAV
 Web Fuck
-WebSauger
-Woobot
-Xaldon_WebSpider
-Xenu
-Zeus
-ZoominfoBot
+WebFetch
+WebGo IS
+WebImageCollector
+Wonderbot
+Wprecon
+Zade
+Zauba
 anthropic-ai
-check1.exe
-cohere-ai
-crawler4j
-dataforseobot
-meanpathbot
-oBot
-probe-image-size
-satoristudio.net
+archive.org_bot
+iubenda-radar
+openai.com
 scalaj-http
-scan.lol
-tAkeOut
+seobility
+seoscanners
+siteripz
+webprosbot
+zauba.io