nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-03 10:09:26 +00:00

250 lines
2.6 KiB
Text

404enemy
ALittle Client
ASPSeek
Abonti
Acunetix
AhrefsBot
Alligator
Anarchie
Anarchy
Ankit
Anthill
Aspiegel
Atomseobot
Attach
AwarioRssBot
BBBike
BLEXBot
BackDoorBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Barkrowler
Bigfoot
Bitacle
Black Hole
BlackWidow
Blackboard
BlowFish
Boardreader
BotALot
Brandwatch
Buck
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CSHttp
Calculon
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Cocolyzebot
CrazyWebCrawler
Custo
DBLBot
DTS Agent
Demon
Deusu
Devil
DigitalPebble
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dragonfly
ECCP/1.0
EirGrabber
ExtLinksBot
ExtractorPro
Extreme Picture Finder
FemtosearchBot
FlashGet
Fuzz
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight
GetWeb
Getintent
Gigabot
Go!Zilla
Gotit
Grabber
Grafula
GrapeFX
HMView
HTTP::Lite
Haansoft
HaosouSpider
Heritrix
Hloader
HonoluluBot
IRLbot
Id-search
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
Internet Ninja
Jetty
JikeSpider
JustView
Kenjin Spider
LNSpiderguy
LWP::Simple
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
Lightspeedsystems
LinkScan
Lmspider
MIDown tool
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Majestic12
MarkMonitor
Mass Downloader
Masscan
MauiBot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
MolokaiBot
Mozlila
NICErsPRO
NPbot
Name Intelligence
Navroad
NearSite
Needle
Net Vampire
NetAnts
NetLyzer
Netcraft
Netvibes
Nibbler
Niki-bot
Nikto
Nimbostratus
Not
Offline Navigator
OnCrawl
Openfind
PageGrabber
PageScorer
Pandalytics
Panscient
PeoplePal
Pi-Monster
Picscout
Pimonster
ProPowerBot
Pu_iN
PyCurl
RankActive
RankFlex
RankingBot2
ReGet
RebelMouse
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
Scrapy
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
Seekport
SeoSiteCheckup
Seomoz
Siphon
SiteCheckerBotCrawler
Siteimprove
Sitevigil
Snake
Snapbot
Sociscraper
Sogou web spider
Spammen
SpankBot
Spbot
SputnikBot
Sqlmap
Steeler
SuperBot
SuperHTTP
SurveyBot
T0PHackTeam
Telesoft
Telesphoreo
Telesphorep
TheNomad
Thumbor
Toata
Trendictionbot
Typhoeus
V-BOT
Vacuum
Vagabondo
VeriCiteCrawler
VoidEYE
Voil
WEBDAV
WWW-Collector-E
WWW-Mechanize
WeSEE
Web Collage
Web Fetch
Web Fuck
Web Pix
Web Sauger
WebCopier
WebFuck
WebImageCollector
WebLeacher
WebSucker
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Whack
Whacker
WiseGuys Robot
Wonderbot
Xenu
Zauba
Zeus
adscanner
arquivo-web-crawler
coccocbot
crawler4j
dataforseo.com
demandbase-bot
eCatch
evc-batch
facebookscraper
internetVista monitor
netEstate NE Crawler
pcBrowser
probe-image-size
ripz
scan.lol
serpstatbot
sp_auditbot
ubermetrics-technologies.com
voyagerx.com
zauba.io