nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-29 22:04:50 +00:00

100 lines
1.1 KiB
Text

Aboundex
AlphaBot
Attach
BBBike
BackStreet
Blackboard
Blow
Buck
BuiltWith
Bytespider
Crawling at Home Project
Crescent
CrunchBot
DataCha0s
DomCopBot
DomainAppender
DomainCrawler
EMail Siphon
Ecxi
Evil
Extreme Picture Finder
EyeNetIE
FlashGet
FyberSpider
Go-Ahead-Got-It
Haansoft
Hloader
Humanlinks
Information Security Team InfraSec Scanner
Keybot Translation-Search-Machine
Keyword Density
Lightspeedsystems
Likse
Linkbot
LinksManager
MIDown tool
MJ12bot
MTRobot
Mag-Net
Majestic12
Mass Downloader
Moblie Safari
Mojolicious
Nameprotect
Navroad
NearSite
NetSpider
Nibbler
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PeoplePal
Piepmatz
Probethenet
Proximic
Pump
QueryN Metasearch
RankingBot2
Ripper
SBIder
Searchestate
Siteimprove
Sociscraper
Spammen
SpankBot
Sucker
Surfbot
Swiftbot
Telesoft
Toata
Tracemyfile
Turnitin
Twice
URLy.Warning
V-BOT
VelenPublicWebCrawler
WEBDAV
WWWOFFLE
Web Auto
Web Fuck
Web Pix
Who.is Bot
Wotbox
Xenu
YoudaoBot
ZmEu
ZumBot
arquivo-web-crawler
check1.exe
coccocbot
cognitiveseo
instabid
internetVista monitor
magpie-crawler
openai
polaris version
s1z.ru
webpros.com