nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-07 22:07:20 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
ADmantX
ALittle Client
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
Anarchy99
Ankit
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BackWeb
BatchFTP
BetaBot
BlackWidow
Blackboard
Blow
BlowFish
Bolt
BotALot
BuiltBotTough
BuiltWith
Bullseye
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
ChinaClaw
Claritybot
Copier
CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
Crescent
Demon
Dirbuster
Disco
Dispatch
DnyzBot
DomainSigmaCrawler
DomainStatsBot
ECCP/1.0
EMail Siphon
EasyDL
Ecxi
EirGrabber
Exabot
Express WebPictures
FDM
Firefox/7.0
FlashGet
Flunky
Freeuploader
FrontPage
Fyrebot
GT::WWW
GermCrawler
GetRight
Gigabot
Gotit
Grabber
GridBot
HEADMasterSEO
HTTP::Lite
Haansoft
HaosouSpider
Havij
Heritrix
HybridBot
IDBot
Iblog
IlseBot
InfoTekies
InterGET
Internet Ninja
InternetSeer
Iskanie
JOC Web Spider
JamesBOT
Jorgee
JustView
Keyword Density
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin
Leap
LeechFTP
LibWeb
Lightspeedsystems
LinkWalker
LinkpadBot
LinksManager
LinqiaScrapeBot
Litemage_walker
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Mail.RU_Bot
MarkMonitor
Masscan
MeanPath Bot
Metauri
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Musobot
NPbot
Name Intelligence
Navroad
Net Vampire
NetAnts
NetSpider
Netvibes
Niki-bot
Nikto
NimbleCrawler
Nuclei
Octopus
OnCrawl
OpenLinkProfiler
Openvas
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
Petalbot
Pi-Monster
Picscout
Piepmatz
Pixray
Pockey
ProPowerBot
Probethenet
Psbot
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
Rankivabot
ReGet
RealDownload
RepoMonkey
SBIder
SEOprofiler
Scanbot
ScoutJet
Screaming
ScreenerBot
ScrepyBot
SeobilityBot
Siphon
Site Sucker
Sitevigil
Snapbot
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
Steeler
Stripper
SuperHTTP
SurveyBot
Suzuran
Szukacz
T0PHackTeam
Telesphoreo
Telesphorep
The Intraformant
Toata
Toweyabot
Tracemyfile
Turingos
Turnitin
Twice
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
VB Project
Virusdie
Voil
Voltron
WISENutbot
WPScan
WWW-Collector-E
WallpapersHD
Web Collage
Web Enhancer
Web Sauger
Web Sucker
WebBandit
WebCopier
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebWhacker
Webalta
WebmasterWorldForumBot
Website Quester
Whatweb
WiseGuys Robot
Woobot
Xaldon WebSpider
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZoominfoBot
adscanner
arquivo-web-crawler
arquivo.pt
check1.exe
clark-crawler
coccocbot
crawler.feedback
dataforseo.com
eCatch
linkdexbot
lwp-trivial
magpie-crawler
meanpathbot
ripz
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seocompany.store
serpstatbot
sogouspider
sp_auditbot
spyfu
tAkeOut
trendiction.de
webprosbot
zauba.io