nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-25 07:30:03 +00:00

250 lines
2.6 KiB
Text

ASPSeek
Abonti
Aboundexbot
AiHitBot
Aipbot
Alexibot
AlphaBot
Anarchy
Anthill
Apexoo
Asterias
BDCbot
BDFetch
BacklinkCrawler
BatchFTP
Bitacle
Black Hole
BlowFish
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CazoodleBot
CensysInspect
CheTeam
ChinaClaw
Cliqzbot
Cloud mapping
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CyotekWebCopy
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Devil
Digincore
Discoverybot
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Download Wonder
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
Evil
Express WebPictures
Extractor
Ezooms
Flunky
Foobot
Fyrebot
GT::WWW
GalaxyBot
GetWeb
Getintent
Go-Ahead-Got-It
Gotit
Grafula
GrapeFX
HEADMasterSEO
HMView
HTTrack
Harvest
Humanlinks
IDBTE4M
IDBot
IRLbot
Iblog
Id-search
IlseBot
InfoNaviRobot
Internet Ninja
InternetSeer
JamesBOT
JennyBot
JetCar
Joomla
Kenjin Spider
LNSpiderguy
LexiBot
Libwhisker
Likse
LinkScan
Linkbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
MTRobot
Magnet
MarkMonitor
Mass Downloader
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Minefield
Mojolicious
Morfeus Fucking Scanner
Msrabot
Musobot
NICErsPRO
NPbot
Needle
Nessus
NetAnts
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Not
Nuclei
Nutch
Octopus
OnCrawl
OpenVAS
Openfind
OrangeSpider
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Pandalytics
Petalbot
Pi-Monster
Picscout
PictureFinder
Piepmatz
Pixray
PleaseCrawl
ProPowerBot
Pump
PyCurl
RSSingBot
RankActiveLinkBot
RankingBot
RankurBot
RedesScrapy
Rogerbot
SEOstats
SMTBot
SalesIntelligent
ScanAlert
Scanbot
Scrapy
Searchestate
SemanticJuice
SemrushBot
SeoSiteCheckup
Seomoz
Shodan
SiteCheckerBotCrawler
SiteLockSpider
SlySearch
Sociscraper
Sosospider
Sottopop
Spammen
Spbot
SputnikBot
Sqlworm
Sqworm
Steeler
SurveyBot
Teleport
Telesphoreo
TheNomad
Toweyabot
Tracemyfile
Trendictionbot
Typhoeus
URLy.Warning
Vagabondo
VidibleScraper
WISENutbot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Collage
Web Enhancer
Web Fuck
Web Sauger
WebAuto
WebBandit
WebFetch
WebLeacher
WebReaper
WebWhacker
WebmasterWorldForumBot
Webshag
WebsiteQuester
Webster
Whatweb
Wonderbot
Wotbox
Zauba
Zermelo
ZmEu
ZoominfoBot
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
cah.io.community
check1.exe
coccocbot-web
cognitiveseo
com.plumanalytics
crawl.sogou.com
eCatch
instabid
isitwp.com
meanpathbot
page scorer
plumanalytics
ripz
scalaj-http
seobility
seocompany.store
seostar
sitechecker.pro
sogouspider
sp_auditbot
trendiction.de
webmeup-crawler
webpros.com
webprosbot