nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-20 22:07:32 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404checker
80legs
ADmantX
AIBOT
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Anarchy
Anthill
Aspiegel
BDCbot
BDFetch
BackDoorBot
BackStreet
Barkrowler
Battleztar Bazinga
Blackboard
Blow
Brandprotect
Buddy
Bullseye
BuzzSumo
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
Chlooe
Claritybot
Collector
Copier
Cosmos
Crescent
Custo
DIIbot
Devil
Digincore
DittoSpyder
DnyzBot
Download Wonder
Drip
ECCP/1.0
EMail Wolf
Ecxi
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
Fimap
FrontPage
FyberSpider
Genieo
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
GrapeFX
GridBot
HMView
HTMLparser
HTTP::Lite
Heritrix
IRLbot
Iblog
Id-search
InfoNaviRobot
Intelliseek
Iria
Iskanie
JOC Web Spider
JamesBOT
JetCar
Jetty
Jorgee
Keyword Density
Kozmosbot
LeechFTP
LeechGet
LibWeb
Libwhisker
Lightspeedsystems
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MIDown tool
MIIxpc
MQQBrowser
MSFrontPage
Mag-Net
Majestic-SEO
Majestic12
MarkMonitor
Masscan
Mata Hari
MeanPath Bot
Meanpathbot
MegaIndex.ru
Metauri
Mister PiX
Moblie Safari
Mojeek
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Musobot
NICErsPRO
Name Intelligence
Nameprotect
NearSite
Needle
NetAnts
NetLyzer
NetMechanic
NetSpider
Netcraft
Nibbler
NimbleCrawler
Nmap
Offline Explorer
OnCrawl
OpenVAS
OrangeSpider
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
Panscient
Papa Foto
Pavuk
PeoplePal
Picscout
PleaseCrawl
Pockey
ProPowerBot
Pu_iN
PyCurl
Quick-Crawler
RSSingBot
RankingBot2
RebelMouse
Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
Scanbot
Screaming
ScreenerBot
SearchmetricsBot
SentiBot
Shodan
SiteCheckerBotCrawler
Sitebeam
SlySearch
Sosospider
Spammen
Spanner
Spbot
Sqlworm
Sqworm
Stripper
Sucker
Sucuri
Suzuran
T0PHackTeam
TeleportPro
Telesphoreo
Toata
Turingos
Turnitin
URLy.Warning
Upflow
Virusdie
VoidEYE
Voil
Voltron
WEBDAV
WISENutbot
WPScan
WWW-Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Pix
Web Sucker
WebFuck
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Whatweb
Woobot
Wotbox
Wprecon
Xaldon_WebSpider
Zauba
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
adscanner
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
cah.io.community
check1.exe
crawl.sogou.com
crawler.feedback
demandbase-bot
evc-batch
facebookscraper
gopher
heritrix
iubenda-radar
linkdexbot
magpie-crawler
meanpathbot
pcBrowser
polaris version
satoristudio.net
seostar
sexsearcher
siteripz
spyfu
trendiction.de
webpros.com
webprosbot
zauba.io
zgrab