nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-08 10:09:25 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
Abonti
Acunetix
AhrefsBot
AiHitBot
Alexibot
AlphaBot
Anarchy99
Ankit
Aspiegel
Asterias
AwarioRssBot
BLEXBot
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
BotALot
Brandprotect
BuiltWith
CATExplorador
CODE87
Calculon
CazoodleBot
ChinaClaw
Claritybot
Cocolyzebot
Cogentbot
Collector
CrazyWebCrawler
Crescent
DBLBot
DIIbot
DSearch
DatabaseDriverMysqli
Deusu
Disco
Dispatch
DittoSpyder
DnyzBot
DomainAppender
Domains Project
Dotbot
Download Wonder
Dragonfly
EMail Wolf
Ebingbong
EirGrabber
EroCrawler
Evil
Exabot
ExtLinksBot
Extractor
ExtractorPro
FHscan
Fimap
FlashGet
FrontPage
G-i-g-a-b-o-t
GalaxyBot
GetRight
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
Grafula
GrapeFX
HEADMasterSEO
Harvest
Heritrix
Hloader
Humanlinks
Id-search
Image Fetch
Indy Library
InterGET
Iskanie
Jbrofuzz
JetCar
Joomla
JustView
Jyxobot
Kozmosbot
LWP::Simple
Leap
LeechFTP
LeechGet
LexiBot
LibWeb
Libwhisker
LieBaoFast
LinkScan
Linkbot
LinkextractorPro
LinksManager
Ltx71
MSFrontPage
MSIECrawler
Magnet
Majestic-SEO
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
Microsoft URL Control
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
Name Intelligence
Nameprotect
Navroad
Net Vampire
NetMechanic
Netcraft
Nettrack
Nikto
NimbleCrawler
Ninja
Nmap
Nuclei
Nutch
Offline Navigator
Openvas
OrangeBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Pi-Monster
Picscout
PleaseCrawl
ProPowerBot
ProWebWalker
PyCurl
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
RankurBot
ReGet
RealDownload
Recorder
Rogerbot
SBIder
SEOkicks
SISTRIX
SMTBot
ScanAlert
Scanbot
Scrapy
Semrush
SeobilityBot
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SmartDownload
Snake
Snapbot
Snoopy
SocialRankIOBot
Sosospider
SpaceBison
Spanner
SputnikBot
Stripper
Swiftbot
T0PHackTeam
T8Abot
Telesphoreo
Thumbor
Titan
Toweyabot
Trendictionbot
Turingos
Turnitin
Typhoeus
URLy Warning
UnisterBot
V-BOT
VCI
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
WASALive-Bot
WWW-Collector-E
Wallpapers/3.0
WallpapersHD
Web Fetch
Web Fuck
WebBandit
WebFetch
WebGo IS
WebReaper
WebSauger
WebWhacker
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Whack
Whacker
Whatweb
WiseGuys Robot
Xaldon WebSpider
Zauba
Zeus
ZoomBot
ZoominfoBot
arquivo-web-crawler
backlink-check
check1.exe
cognitiveseo
com.plumanalytics
demandbase-bot
eCatch
evc-batch
heritrix
ips-agent
lwp-trivial
magpie-crawler
muhstik-scan
oBot
plumanalytics
polaris version
probe-image-size
ripz
s1z.ru
scan.lol
seobility
seoscanners
spyfu
tAkeOut
trendiction.de
x22Mozilla
xpymep1.exe