nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-20 22:07:42 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
AIBOT
ALittle Client
Acunetix
AhrefsBot
AiHitBot
Alexibot
AwarioRssBot
AwarioSmartBot
BDFetch
BLEXBot
BatchFTP
BetaBot
BlackWidow
Blow
Boardreader
Buddy
BuiltBotTough
BunnySlippers
CODE87
CSHttp
Cegbfeieh
CheTeam
Claritybot
Cogentbot
Collector
Copier
CopyRightCheck
Cosmos
Crawling at Home Project
CrunchBot
CyotekWebCopy
DIIbot
Dirbuster
Disco
Dispatch
DomainAppender
DomainSigmaCrawler
Dotbot
Download Wonder
Dragonfly
Drip
EMail Wolf
Ebingbong
Ecxi
EirGrabber
EroCrawler
Evil
ExtLinksBot
ExtractorPro
Extreme Picture Finder
FHscan
FemtosearchBot
Fimap
FlashGet
Foobot
FrontPage
Go!Zilla
GoZilla
Grafula
HEADMasterSEO
HMView
HTTrack
Harvest
Havij
IDBTE4M
IRLbot
Iblog
IlseBot
Indy Library
InfoNaviRobot
Intelliseek
InterGET
InternetSeer
IstellaBot
Jetty
JikeSpider
Jyxobot
Kenjin Spider
Keyword Density
Kinza
Lanshanbot
LexiBot
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Linkbot
Linkdexbot
LinkextractorPro
LinkpadBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MTRobot
Magnet
Majestic SEO
Majestic-SEO
Masscan
Mb2345Browser
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft URL Control
Mister PiX
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Nessus
Net Vampire
NetLyzer
Netcraft
Netvibes
Nikto
Nmap
Octopus
Offline Explorer
Offline Navigator
Openfind
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Pavuk
PeoplePal
Petalbot
Picscout
Picsearch
Pimonster
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot
RankurBot
ReGet
RealDownload
Recorder
RedesScrapy
Ripper
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
Scanbot
Scrapy
Screaming
Searchestate
Seekport
SentiBot
SeoSiteCheckup
SeobilityBot
Shodan
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
Siteimprove
SlySearch
SmartDownload
Snake
Snoopy
Spanner
Spinn3r
Sqlmap
Sqlworm
Steeler
Sucuri
SuperHTTP
Suzuran
Swiftbot
T8Abot
Telesoft
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
Turingos
TurnitinBot
TwengaBot
Typhoeus
Upflow
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voil
Voltron
WISENutbot
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Fetch
Web Fuck
Web Sucker
WebAuto
WebCollage
WebCopier
WebEnhancer
WebFetch
WebImageCollector
WebLeacher
WebPix
Webster
Widow
Wonderbot
Woobot
Wotbox
Xenu
Zermelo
Zitebot
ZoomBot
ZyBorg
archive.org_bot
arquivo.pt
autoemailspider
coccocbot-web
crawler4j
demandbase-bot
domainsproject.org
instabid
iubenda-radar
muhstik-scan
netEstate NE Crawler
polaris version
probe-image-size
ripz
s1z.ru
sp_auditbot
trendiction.com
trendiction.de
webgains-bot
webprosbot
x22Mozilla
xpymep1.exe
zgrab