nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-08 10:09:18 +00:00

250 lines
2.6 KiB
Text

404enemy
AIBOT
ALittle Client
Acunetix
AhrefsBot
Aipbot
AllSubmitter
Alligator
Anarchie
Ankit
Apexoo
Aspiegel
AwarioSmartBot
BDCbot
BackDoorBot
BatchFTP
BlackWidow
BlowFish
Boardreader
Bolt
BotALot
Brandwatch
Buddy
BuiltBotTough
BuzzSumo
CCBot
CSHttp
CensysInspect
ChinaClaw
Chlooe
Citoid
Cocolyzebot
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
CyotekWebCopy
DBLBot
DTS Agent
DatabaseDriverMysqli
Deusu
Digincore
DigitalPebble
Dirbuster
Disco
Discobot
Dispatch
DittoSpyder
DnyzBot
DomCopBot
Domains Project
Dotbot
Drip
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
EroCrawler
Express WebPictures
Extractor
Extreme Picture Finder
FDM
FHscan
FemtosearchBot
FlashGet
Freeuploader
FyberSpider
Genieo
GetRight
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
Grafula
GrapeFX
GridBot
HEADMasterSEO
HTTrack
Haansoft
HaosouSpider
Havij
HybridBot
IDBot
IRLbot
Iblog
Id-search
Image Fetch
InfoNaviRobot
IstellaBot
JennyBot
JetCar
Jetty
JustView
Jyxobot
Keyword Density
Leap
LeechGet
LexiBot
Lftp
LieBaoFast
LinkWalker
Linkdexbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
MegaIndex.ru
Minefield
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Mozlila
Navroad
Netcraft
Netvibes
NextGenSearchBot
Nibbler
NimbleCrawler
Nmap
Not
Nuclei
Nutch
OpenVAS
OrangeSpider
POE-Component-Client-HTTP
PageGrabber
Pandalytics
PeoplePal
Petalbot
Picscout
Picsearch
Pixray
ProPowerBot
Probethenet
RankActive
RealDownload
Ripper
RocketCrawler
Rogerbot
SEOlyticsCrawler
SEOstats
SMTBot
Scanbot
ScoutJet
Scrapy
Searchestate
SemanticJuice
SemrushBot
SeoSiteCheckup
SeobilityBot
Seomoz
Siphon
SiteSnagger
SlySearch
Sosospider
Sottopop
Spammen
Spanner
Sqlmap
Sqworm
Steeler
SuperBot
SuperHTTP
SurveyBot
Suzuran
Swiftbot
TeleportPro
Telesoft
Telesphoreo
TightTwatBot
Titan
Trendiction
Twice
Typhoeus
URLy Warning
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
Voil
WASALive-Bot
WEBDAV
WWW::Mechanize
WWWOFFLE
WeSEE
Web Auto
Web Collage
Web Fetch
Web Fuck
WebCollage
WebCopier
WebImageCollector
WebPix
WebStripper
WebmasterWorldForumBot
Webster
Whack
Whatweb
Who.is Bot
Widow
WiseGuys Robot
Wonderbot
Wotbox
Wprecon
Xaldon WebSpider
Zauba
ZoomBot
ZoominfoBot
adscanner
autoemailspider
cah.io.community
check1.exe
clark-crawler
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com
evc-batch
heritrix
isitwp.com
magpie-crawler
page scorer
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
seocompany.store
seostar
sitechecker.pro
siteripz
sp_auditbot
sysscan
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
zauba.io
zgrab