nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-07 06:28:29 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404checker
Aboundexbot
Acunetix
AhrefsBot
Alexibot
Anarchie
Anthill
Apexoo
Aspiegel
Asterias
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Badass
Barkrowler
BlackWidow
Bolt
Buddy
BunnySlippers
Calculon
CazoodleBot
CheeseBot
CherryPicker
Collector
Crescent
Curious
Custo
DTS Agent
Deusu
Dirbuster
Discobot
Discoverybot
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Drip
EMail Wolf
Ecxi
EroCrawler
Exabot
Express WebPictures
Extreme Picture Finder
Ezooms
Firefox/7.0
Flunky
Foobot
Freeuploader
Fyrebot
GalaxyBot
GetRight
GetWeb
Gotit
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
Havij
HybridBot
IRLbot
IlseBot
Image Sucker
InternetSeer
JOC Web Spider
Jbrofuzz
Jyxobot
Kenjin Spider
Kinza
Lanshanbot
LeechFTP
Lftp
Likse
LinkpadBot
LinqiaScrapeBot
Litemage_walker
Lmspider
Ltx71
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Magnet
MarkMonitor
MarkWatch
Masscan
MauiBot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Mr.4x3
NICErsPRO
Nameprotect
Navroad
Needle
Nessus
Net Vampire
NetAnts
NetLyzer
NetMechanic
Nettrack
Netvibes
Niki-bot
NimbleCrawler
Nimbostratus
Not
Nutch
OnCrawl
OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Papa Foto
Petalbot
Picsearch
PictureFinder
Pockey
Probethenet
Pump
PyCurl
RankActive
RankFlex
ReGet
RealDownload
Reaper
RedesScrapy
RocketCrawler
SBIder
SEOstats
SISTRIX
SMTBot
Scanbot
Scrapy
Screaming
ScrepyBot
Seomoz
Shodan
Sitebeam
SlySearch
Snoopy
Sociscraper
Sogou web spider
SpankBot
Spanner
Spbot
Sqworm
Steeler
Sucker
SuperBot
Suzuran
Swiftbot
Teleport
Telesoft
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Toata
Tracemyfile
True_Robot
Turingos
V-BOT
VB Project
Vacuum
VidibleScraper
VoidEYE
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers
Wallpapers/3.0
Web Auto
Web Fuck
Web Pix
Web Sauger
WebAuto
WebBandit
WebCopier
WebImageCollector
WebPix
WebSucker
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Webster
Whack
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Xaldon_WebSpider
Xenu
Zermelo
Zeus
ZmEu
ZoomBot
ZyBorg
adscanner
arquivo.pt
autoemailspider
cah.io.community
clark-crawler
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler4j
demandbase-bot
ips-agent
isitwp.com
lwp-trivial
mediawords
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
scan.lol
seocompany.store
seostar
sexsearcher
sitechecker.pro
spyfu
voyagerx.com
x22Mozilla
xpymep1.exe