nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-04-10 12:23:49 +00:00

100 lines
1.1 KiB
Text

Acunetix
AhrefsBot
AwarioBot
BackWeb
Backlink-Ceck
BlowFish
BuiltBotTough
Bytespider
CheeseBot
Citoid
Copier
Cosmos
Craftbot
Crescent
DSearch
DatabaseDriverMysqli
Demon
Disco
DomainCrawler
DomainSigmaCrawler
Domains Project
EasyDL
Grabber
HTTP::Lite
HTTrack
Harvest
HonoluluBot
Id-search
IndeedBot
IstellaBot
JamesBOT
JennyBot
Jorgee
JustView
Lightspeedsystems
LinksManager
Lmspider
Minefield
Mojolicious
Musobot
NearSite
NetMechanic
NextGenSearchBot
NimbleCrawler
Nimbostratus
Nutch
OrangeBot
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageThing.com
Proximic
Psbot
RankFlex
Rankivabot
SemanticJuice
SenutoBot
Seomoz
SiteSucker
Sitevigil
SmartDownload
Sosospider
Szukacz
T0PHackTeam
Thumbor
Titan
Toata
Trendictionbot
Twice
VidibleScraper
WPScan
Wallpapers/3.0
WallpapersHD
WebCollage
WebEnhancer
WebFuck
WebZIP
Website Quester
Whack
Wprecon
YoudaoBot
Zitebot
archive.org_bot
arquivo-web-crawler
autoemailspider
awario.com
check1.exe
clark-crawler
cohere-ai
domainsproject.org
heritrix
ips-agent
iubenda-radar
lwp-trivial
openai.com
polaris version
spyfu
webmeup-crawler
x22Mozilla