nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-30 10:09:51 +00:00

250 lines
2.7 KiB
Text

404checker
404enemy
ALittle Client
Abonti
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
AlphaBot
Anarchie
Anarchy
Anarchy99
Anthill
Aspiegel
Asterias
BDCbot
BackDoorBot
BackStreet
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Blackboard
Brandprotect
BunnySlippers
CheTeam
Citoid
Claritybot
Cloud mapping
Copier
Crawling at Home Project
Crescent
CrunchBot
Curious
Custo
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Dirbuster
Dispatch
DnyzBot
DomainCrawler
Ebingbong
Exabot
Express WebPictures
ExtractorPro
FDM
Firefox/7.0
FlashGet
Freeuploader
FrontPage
GalaxyBot
Getintent
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
Grabber
GrapeFX
GridBot
HMView
HTTrack
HaosouSpider
Heritrix
Hloader
HonoluluBot
Humanlinks
Iblog
IlseBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoTekies
IstellaBot
JamesBOT
JennyBot
Jetty
Keybot Translation-Search-Machine
Keyword Density
Kinza
LWP::Simple
LeechFTP
LeechGet
Lftp
LinkScan
LinkWalker
Linkbot
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MJ12bot
MSIECrawler
Mag-Net
MeanPath Bot
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Mister PiX
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Musobot
NPbot
NearSite
Nessus
NextGenSearchBot
Nibbler
Nmap
Nuclei
Nutch
OnCrawl
OpenVAS
Openvas
OrangeBot
OrangeSpider
PHPCrawl
Page Analyzer
Pavuk
PeoplePal
Pi-Monster
Piepmatz
PleaseCrawl
ProPowerBot
ProWebWalker
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
RankurBot
Reaper
RepoMonkey
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SalesIntelligent
Scanbot
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
SeobilityBot
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
Snake
Snapbot
SocialRankIOBot
Sosospider
SpaceBison
Spanner
Sucuri
SuperBot
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesphorep
TheNomad
Toweyabot
Trendiction
Trendictionbot
Turingos
Twice
Typhoeus
Upflow
V-BOT
VCI
VeriCiteCrawler
VidibleScraper
WASALive-Bot
WPScan
WWW-Collector-E
WWW::Mechanize
WeSEE
Web Collage
Web Enhancer
Web Fetch
Web Sauger
Web Sucker
WebAuto
WebBandit
WebCopier
WebFuck
WebImageCollector
WebSucker
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Who.is Bot
WinHTTrack
Wotbox
Xaldon WebSpider
Xenu
YoudaoBot
ZoomBot
ZoominfoBot
archive.org_bot
autoemailspider
backlink-check
com.plumanalytics
crawl.sogou.com
dataforseo.com
evc-batch
heritrix
internetVista monitor
ips-agent
iubenda-radar
lwp-request
magpie-crawler
meanpathbot
muhstik-scan
oBot
pcBrowser
plumanalytics
probe-image-size
satoristudio.net
seocompany.store
sitechecker.pro
spyfu
sysscan
trendiction.de
webmeup-crawler
xpymep1.exe
zauba.io
zgrab