nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-07 10:09:36 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
Aboundex
AhrefsBot
AiHitBot
AllSubmitter
Alligator
AlphaBot
Anarchy
Anarchy99
Aspiegel
Asterias
Attach
AwarioSmartBot
BDCbot
BDFetch
BacklinkCrawler
Badass
Bandit
BatchFTP
Battleztar Bazinga
Bigfoot
Blackboard
Blow
Brandwatch
BuiltBotTough
Bullseye
BuzzSumo
CATExplorador
CazoodleBot
CensysInspect
CheTeam
CherryPicker
ChinaClaw
Claritybot
Cliqzbot
Cocolyzebot
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
Crescent
CyotekWebCopy
DBLBot
DSearch
Demon
Devil
DigitalPebble
Dirbuster
Discobot
Dispatch
DnyzBot
DomCopBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Drip
ECCP/1.0
EirGrabber
ExtLinksBot
ExtractorPro
Extreme Picture Finder
Fuzz
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
Getintent
Gigabot
Go!Zilla
GrabNet
Grabber
Grafula
HEADMasterSEO
HTMLparser
Havij
Hloader
Humanlinks
IDBTE4M
Iblog
Id-search
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
InternetSeer
Iskanie
JOC Web Spider
JamesBOT
JennyBot
JetCar
JikeSpider
Joomla
Kenjin Spider
Kozmosbot
Larbin
Leap
LeechGet
Libwhisker
LieBaoFast
Linkbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
MJ12bot
Mag-Net
Magnet
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
MeanPath Bot
MegaIndex.ru
Mojeek
Mojolicious
Mozlila
Mr.4x3
Msrabot
NICErsPRO
Nameprotect
Navroad
NearSite
NetAnts
NetSpider
Netcraft
Nettrack
Nikto
NimbleCrawler
Nutch
Offline Navigator
OpenVAS
Openvas
OrangeBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
Papa Foto
Petalbot
Pimonster
Pixray
PleaseCrawl
ProPowerBot
Psbot
Pu_iN
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankFlex
ReGet
Reaper
SEOkicks
SEOstats
SISTRIX
SMTBot
ScanAlert
Scanbot
ScoutJet
Screaming
Searchestate
SearchmetricsBot
SentiBot
SeobilityBot
Shodan
SiteLockSpider
Siteimprove
Sitevigil
SlySearch
Snake
Snapbot
Sociscraper
Sosospider
SpaceBison
SpankBot
Spanner
Spbot
Sucker
SuperBot
T8Abot
TightTwatBot
Tracemyfile
True_Robot
Turingos
Twice
URLy.Warning
UnisterBot
Upflow
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
Voltron
WISENutbot
WWWOFFLE
Web Auto
Web Fetch
WebAuto
WebEnhancer
WebFetch
WebLeacher
WebReaper
WebStripper
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteQuester
Whack
Wotbox
Xaldon WebSpider
YoudaoBot
Zade
Zauba
ZmEu
archive.org_bot
arquivo-web-crawler
crawl.sogou.com
crawler4j
domainsproject.org
eCatch
facebookscraper
gopher
internetVista monitor
isitwp.com
lwp-trivial
mediawords
netEstate NE Crawler
plumanalytics
satoristudio.net
seobility
seoscanners
serpstatbot
sexsearcher
siteripz
sp_auditbot
spyfu
tAkeOut
voyagerx.com
x09Mozilla