nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-28 22:07:03 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
80legs
ADmantX
Aboundexbot
AiHitBot
AllSubmitter
Ankit
Anthill
Apexoo
Atomseobot
Attach
BackDoorBot
BacklinkCrawler
BatchFTP
BetaBot
Black Hole
BlackWidow
Boardreader
Bolt
Brandprotect
Buck
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
Cegbfeieh
ChinaClaw
Citoid
Copier
Copyscape
Cosmos
Crawling at Home Project
Crescent
Curious
DataCha0s
Digincore
DigitalPebble
Dirbuster
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
Evil
Exabot
ExtractorPro
Extreme Picture Finder
Ezooms
FemtosearchBot
FlashGet
Flunky
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GermCrawler
GetWeb
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HMView
HTTP::Lite
Haansoft
Harvest
Hloader
IRLbot
Id-search
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InternetSeer
Iria
Jbrofuzz
JennyBot
Jorgee
Kinza
LWP::Simple
Lanshanbot
Larbin
Leap
LeechGet
LibWeb
LieBaoFast
Likse
Linkbot
LinkpadBot
LinksManager
Lipperhey Spider
MIDown tool
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Magnet
Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader
Masscan
Metauri
Microsoft Data Access
Microsoft URL Control
Morfeus Fucking Scanner
Mozlila
Navroad
Needle
Nessus
Net Vampire
NetAnts
NetMechanic
NextGenSearchBot
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Not
Offline Explorer
Offline Navigator
Openvas
PHPCrawl
Page Analyzer
PageGrabber
Papa Foto
PeoplePal
Pi-Monster
PictureFinder
Pimonster
Pockey
ProPowerBot
Pu_iN
Pump
PxBroker
PyCurl
RankActiveLinkBot
RankingBot2
ReGet
Recorder
RedesScrapy
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
ScanAlert
Searchestate
SearchmetricsBot
SeoSiteCheckup
SeobilityBot
Seomoz
SiteCheckerBotCrawler
SiteLockSpider
Sitevigil
Snapbot
Sogou web spider
Sosospider
SpaceBison
Spammen
SpankBot
Spanner
SputnikBot
Steeler
Stripper
Sucker
Szukacz
T8Abot
The Intraformant
Titan
Trendiction
True_Robot
Turnitin
TwengaBot
URLy.Warning
V-BOT
Vacuum
Voil
WISENutbot
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Collage
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebCollage
WebCopier
WebFetch
WebGo IS
WebStripper
WebZIP
Webalta
Webshag
WebsiteExtractor
WebsiteQuester
Webster
Whack
Widow
WinHTTrack
Wonderbot
Woobot
Wprecon
YoudaoBot
Zauba
Zermelo
Zeus
ZmEu
ZyBorg
arquivo-web-crawler
cah.io.community
com.plumanalytics
crawler.feedback
eCatch
evc-batch
facebookscraper
lwp-request
lwp-trivial
muhstik-scan
netEstate NE Crawler
oBot
page scorer
pcBrowser
plumanalytics
s1z.ru
scan.lol
seostar
serpstatbot
sitechecker.pro
spyfu
trendiction.com
trendiction.de
voyagerx.com
webgains-bot
webpros.com
webprosbot
xpymep1.exe
zauba.io
zgrab