nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-01 22:07:13 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
80legs
ADmantX
AIBOT
AfD-Verbotsverfahren
AhrefsBot
Aipbot
AllSubmitter
Alligator
Anarchy
Anarchy99
Anthill
Apexoo
Asterias
Attach
AwarioSmartBot
BDCbot
BLEXBot
BackDoorBot
BackWeb
Backlink-Ceck
BetaBot
Bitacle
Black Hole
Blackboard
BlowFish
Brandprotect
Buddy
BuiltWith
CATExplorador
CCBot
CSHttp
Calculon
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
Collector
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
CyotekWebCopy
Dirbuster
Disco
DomCopBot
DomainAppender
Dragonfly
EMail Siphon
EasyDL
Ebingbong
Exabot
ExtLinksBot
Extractor
Ezooms
FemtosearchBot
Foobot
Freeuploader
GT::WWW
GermCrawler
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite
HTTrack
HaosouSpider
Harvest
Hloader
IDBTE4M
IDBot
IRLbot
Iblog
Image Fetch
Indy Library
InfoTekies
Intelliseek
InternetSeer
Iria
IstellaBot
JamesBOT
JennyBot
Joomla
JustView
Jyxobot
Kozmosbot
LWP::Simple
LeechGet
LieBaoFast
LinkScan
Linkbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Magnet
Mass Downloader
Masscan
Mediatoolkitbot
Metauri
MicroMessenger
Minefield
Moblie Safari
Mojeek
Musobot
Name Intelligence
Needle
Net Vampire
NextGenSearchBot
NimbleCrawler
Nimbostratus
Nuclei
Octopus
OnCrawl
OpenVAS
OrangeSpider
OutclicksBot
PECL::HTTP
PageThing.com
PeoplePal
Pi-Monster
PleaseCrawl
ProPowerBot
RankFlex
RankingBot2
RankurBot
ReGet
Reaper
RebelMouse
RedesScrapy
RepoMonkey
Rogerbot
SBIder
SEOkicks
SalesIntelligent
Screaming
ScreenerBot
SemanticJuice
SemrushBot
SentiBot
SeoSiteCheckup
Shodan
SiteSnagger
Sitebeam
Siteimprove
SlySearch
Snake
SocialRankIOBot
Sociscraper
Sottopop
Spammen
SputnikBot
Sqlworm
Sqworm
Sucker
Sucuri
SuperBot
Suzuran
Teleport
Telesoft
Telesphoreo
Telesphorep
TheNomad
Thumbor
Toata
True_Robot
Turingos
TurnitinBot
TwengaBot
URLy Warning
URLy.Warning
VidibleScraper
VoidEYE
WBSearchBot
WEBDAV
WWW-Collector-E
WWW-Mechanize
Wallpapers
Web Auto
Web Enhancer
Web Pix
Web Sauger
WebCopier
WebFetch
WebGo IS
WebLeacher
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Wprecon
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
Zitebot
ZoomBot
ZumBot
adscanner
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
check1.exe
cognitiveseo
crawl.sogou.com
crawler4j
evc-batch
facebookscraper
isitwp.com
lwp-trivial
page scorer
pcBrowser
plumanalytics
probe-image-size
scan.lol
seobility
sitechecker.pro
sogouspider
sp_auditbot
trendiction.com
webmeup-crawler
xpymep1.exe
zgrab