nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-06-22 10:07:17 +00:00

100 lines
1.1 KiB
Text

AdsTxtCrawlerTP
AlphaBot
Anarchie
Anarchy99
AwarioSmartBot
Backlink-Ceck
BlackWidow
Blackboard
Blow
Buddy
BuzzSumo
CATExplorador
ChatGPT-User
CheTeam
CheeseBot
CherryPicker
CrazyWebCrawler
Crescent
DIIbot
DigitalPebble
Dirbuster
DomCopBot
DomainStatsBot
Domains Project
Dotbot
ECCP/1.0
Ebingbong
Ecxi
FHscan
Freeuploader
GoZilla
HTTrack
Image Sucker
Information Security Team InfraSec Scanner
Kozmosbot
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinqiaScrapeBot
Ltx71
MarkMonitor
Masscan
Microsoft URL Control
Mojolicious
Needle
Nutch
Octopus
Offline Explorer
OutclicksBot
Panscient
ProPowerBot
ProWebWalker
RankingBot2
RankurBot
RebelMouse
Recorder
Ripper
SBIder
SEOkicks-Robot
SMTBot
ScoutJet
SentiBot
SiteSucker
Sitevigil
Snake
Snoopy
Sogou web spider
SpaceBison
Spinn3r
SputnikBot
Surfbot
Thumbor
TinyTestBot
TurnitinBot
URLy Warning
VCI
VidibleScraper
WWW-Mechanize
Web Sucker
WebWhacker
WebsiteExtractor
Who.is Bot
Wonderbot
Wprecon
Xenu
YoudaoBot
Zade
clark-crawler
domainsproject.org
lwp-request
oBot
plumanalytics
polaris version
serpstatbot
ubermetrics-technologies.com
webprosbot
xpymep1.exe
zauba.io