nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-14 22:07:00 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
ADmantX
ALittle Client
Abonti
Aboundexbot
AhrefsBot
AllSubmitter
Anarchy
Apexoo
Attach
AwarioSmartBot
BDCbot
BackStreet
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Black Hole
Blackboard
Boardreader
Bolt
Brandprotect
Bullseye
Calculon
CheTeam
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Curious
DBLBot
DIIbot
DatabaseDriverMysqli
Devil
Discobot
Discoverybot
Dispatch
DomainCrawler
Domains Project
Dragonfly
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
EirGrabber
EroCrawler
Evil
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
Fimap
Firefox/7.0
Freeuploader
FrontPage
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
Gotit
Grabber
Grafula
GrapeFX
GridBot
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
Haansoft
IDBTE4M
Id-search
Image Sucker
Iria
Iskanie
IstellaBot
JamesBOT
JetCar
LeechFTP
LeechGet
Libwhisker
Likse
Linkdexbot
Ltx71
MFC_Tear_Sample
MIDown tool
MQQBrowser
MSIECrawler
Mag-Net
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
MauiBot
MeanPath Bot
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mozlila
Musobot
Nameprotect
Navroad
Needle
Nessus
NetAnts
NetSpider
NimbleCrawler
Nimbostratus
Not
Nuclei
Nutch
Offline Navigator
OnCrawl
Openfind
Openvas
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
PageGrabber
Pavuk
PeoplePal
Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz
Pixray
Pockey
Psbot
Pu_iN
Pump
QueryN Metasearch
RankActive
Re-re
ReGet
Recorder
RocketCrawler
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SalesIntelligent
Scanbot
ScoutJet
Scrapy
ScreenerBot
Searchestate
Seekport
SemanticJuice
SemrushBot
SentiBot
SeobilityBot
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
Sitebeam
SlySearch
SmartDownload
Snapbot
Sociscraper
SpankBot
Spanner
SputnikBot
Sqlmap
Steeler
Sucker
SuperBot
Swiftbot
Telesoft
Telesphoreo
Thumbor
Toata
Toweyabot
TurnitinBot
VB Project
Vacuum
Vagabondo
VidibleScraper
VoidEYE
WASALive-Bot
WBSearchBot
WPScan
Wallpapers
Web Auto
Web Pix
Web Sucker
WebAuto
WebBandit
WebCopier
WebEnhancer
WebFetch
WebImageCollector
WebLeacher
WebReaper
WebSucker
WebWhacker
WebZIP
Website Quester
Webster
Widow
Xaldon WebSpider
Xenu
YoudaoBot
Zermelo
ZmEu
ZoomBot
ZumBot
ZyBorg
arquivo-web-crawler
backlink-check
cah.io.community
coccocbot
cognitiveseo
crawl.sogou.com
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
facebookscraper
gopher
internetVista monitor
lwp-trivial
meanpathbot
muhstik-scan
probe-image-size
s1z.ru
scalaj-http
scan.lol
seobility
seoscanners
serpstatbot
sexsearcher
siteripz
spyfu
tAkeOut
trendiction.com
webgains-bot
webpros.com
webprosbot
x09Mozilla
x22Mozilla