nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-19 22:07:11 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
404checker
ADmantX
ALittle Client
ASPSeek
Alexibot
Anarchie
Ankit
Anthill
Aspiegel
Attach
AwarioSmartBot
BBBike
BackDoorBot
BackWeb
Badass
Bandit
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Black Hole
BlackWidow
Blackboard
Blow
Bolt
BuiltWith
Bullseye
BuzzSumo
CCBot
CSHttp
CazoodleBot
Cegbfeieh
CherryPicker
Cliqzbot
Cloud mapping
Cogentbot
CopyRightCheck
Copyscape
Crawling at Home Project
CrazyWebCrawler
Curious
CyotekWebCopy
DatabaseDriverMysqli
Digincore
DigitalPebble
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainCrawler
Download Wonder
EMail Siphon
EMail Wolf
Evil
Extractor
ExtractorPro
Ezooms
FDM
Firefox/7.0
Fuzz
Fyrebot
GT::WWW
GetRight
Getintent
Go!Zilla
GoZilla
GrabNet
Grabber
GridBot
HMView
HTTP::Lite
Haansoft
HonoluluBot
IDBot
IRLbot
Iblog
InfoNaviRobot
Internet Ninja
Iria
IstellaBot
JikeSpider
Jorgee
JustView
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
LeechFTP
LexiBot
Lftp
LibWeb
Lightspeedsystems
LinkpadBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIDown tool
MSFrontPage
MarkMonitor
MeanPath Bot
Metauri
Microsoft URL Control
Mojolicious
Mozlila
Nameprotect
Navroad
NearSite
Needle
NetLyzer
NetZIP
NextGenSearchBot
Nibbler
Not
Nuclei
Octopus
Offline Explorer
Offline Navigator
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com
Pandalytics
Pavuk
Petalbot
Picscout
ProPowerBot
ProWebWalker
PyCurl
RSSingBot
RankActiveLinkBot
RankingBot
RankurBot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
RepoMonkey
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
Scanbot
Screaming
Searchestate
SearchmetricsBot
Semrush
SemrushBot
Seomoz
Shodan
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
Sitevigil
Sosospider
SpaceBison
SpankBot
Sqlmap
Sqworm
Sucuri
SuperBot
SurveyBot
T0PHackTeam
Telesoft
Telesphorep
Thumbor
TightTwatBot
Toata
Tracemyfile
True_Robot
Turingos
URLy.Warning
UnisterBot
VB Project
Vagabondo
VidibleScraper
VoidEYE
Voil
Voltron
WASALive-Bot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Collage
Web Enhancer
Web Fuck
Web Pix
WebBandit
WebGo IS
WebPix
WebReaper
WebmasterWorldForumBot
Webshag
WebsiteExtractor
WebsiteQuester
Who.is Bot
WinHTTrack
Woobot
Wprecon
Xaldon_WebSpider
Xenu
YoudaoBot
Zitebot
ZoomBot
ZyBorg
arquivo.pt
backlink-check
check1.exe
clark-crawler
coccocbot
crawl.sogou.com
crawler4j
dataforseo.com
demandbase-bot
eCatch
facebookscraper
gopher
instabid
ips-agent
iubenda-radar
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler
page scorer
probe-image-size
s1z.ru
scalaj-http
scan.lol
seobility
seocompany.store
seostar
sitechecker.pro
siteripz
sogouspider
sysscan
tAkeOut
ubermetrics-technologies.com
voyagerx.com