V4.2024.06.4580 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-404checker
-404enemy
-AIBOT
+AhrefsBot
+AiHitBot
 AlphaBot
-AwarioRssBot
-AwarioSmartBot
-BBBike
 BDFetch
+Backlink-Ceck
 Bigfoot
-Boardreader
-Bullseye
-BunnySlippers
-CCBot
-Calculon
-CensysInspect
-Claritybot
+Black Hole
+BotALot
+Citoid
+Cogentbot
 Curious
-DIIbot
-DataCha0s
-DatabaseDriverMysqli
-DnyzBot
-DomCopBot
+Deusu
+DigitalPebble
+DomainCrawler
 DomainStatsBot
+Ebingbong
+Evil
+Exabot
+ExtLinksBot
 Extreme Picture Finder
-FemtosearchBot
+Fimap
+Flunky
+Foobot
 Freeuploader
-Genieo
-Go-Ahead-Got-It
-Harvest
+FrontPage
+Google-Extended
+GrabNet
+GrapeFX
+HEADMasterSEO
 Heritrix
-HybridBot
-IDBTE4M
-Iblog
-JOC Web Spider
-Jbrofuzz
-JikeSpider
-Lftp
-LinkextractorPro
-LinqiaMetadataDownloaderBot
-Lipperhey
-Mag-Net
-MarkMonitor
-MarkWatch
-Masscan
-Mr.4x3
-Musobot
+InfoNaviRobot
+Information Security Team InfraSec Scanner
+InterGET
+JamesBOT
+JennyBot
+Jetty
+LWP::Simple
+Leap
+Libwhisker
+Likse
+MFC_Tear_Sample
+Majestic-SEO
+Meanpathbot
+Microsoft Data Access
+NPbot
+Nessus
 Net Vampire
-NetZIP
-Netcraft
-Nimbostratus
-Offline Explorer
-Openfind
-OutclicksBot
-PECL::HTTP
-Picsearch
-ProWebWalker
+NimbleCrawler
+OpenVAS
+OrangeBot
+Panscient
 Pu_iN
-QueryN Metasearch
-Rankivabot
-SBIder
-SEOprofiler
-ScanAlert
-Scanbot
-ScreenerBot
-SeekportBot
-Site Sucker
-SocialRankIOBot
-SputnikBot
-Sqlmap
-Steeler
-Sucker
-Surfbot
+Pump
+Reaper
+SEOlyticsCrawler
+SISTRIX
+SalesIntelligent
+Shodan
+SiteCheckerBotCrawler
+Snapbot
+Sosospider
+Spammen
+SpankBot
+Spbot
+Suzuran
+Swiftbot
+T0PHackTeam
 Teleport
-TheNomad
-Toata
-Trendiction
-Trendictionbot
+TeleportPro
+TinyTestBot
 URLy.Warning
-UnisterBot
-WISENutbot
-WWW::Mechanize
-WWWOFFLE
-Wallpapers/3.0
-WeSEE
-Web Fuck
-WebAuto
-WebGo IS
-Webalta
+V-BOT
+VCI
+Vacuum
+Vagabondo
+WEBDAV
+Wallpapers
+Web Enhancer
+Web Pix
+WebCopier
+WebSauger
+WebSucker
 WebsiteQuester
-Wonderbot
-com.plumanalytics
-crawler4j
+Whacker
+Xaldon WebSpider
+Xenu
+Zade
+ZoomBot
+anthropic-ai
+clark-crawler
 dataforseo.com
-eCatch
-iubenda-radar
-lwp-trivial
-meanpathbot
-seocompany.store
-webprosbot
-xpymep1.exe
+demandbase-bot
+evc-batch
+omgili
+openai.com
+plumanalytics
+sp_auditbot
+sysscan
+tAkeOut
+webmeup-crawler