nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-14 22:07:21 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
ADmantX
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Anarchy
Atomseobot
AwarioRssBot
BDCbot
BackDoorBot
Backlink-Ceck
Bandit
BetaBot
Bigfoot
Black Hole
Blackboard
Bolt
Brandwatch
Bullseye
Calculon
Cegbfeieh
CheeseBot
ChinaClaw
Cliqzbot
Cloud mapping
Collector
Copyscape
Cosmos
CrazyWebCrawler
Curious
Custo
DBLBot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Digincore
Dirbuster
Disco
Dispatch
DomainAppender
DomainCrawler
DomainSigmaCrawler
Drip
EMail Siphon
EMail Wolf
EasyDL
Ecxi
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
Extractor
Extreme Picture Finder
EyeNetIE
Fimap
FrontPage
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetRight
Go-Ahead-Got-It
GoZilla
GrapeFX
HTMLparser
HTTP::Lite
HaosouSpider
Harvest
HonoluluBot
Humanlinks
IDBot
Iblog
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
Iria
Joomla
Jyxobot
Lftp
Libwhisker
Lightspeedsystems
Likse
LinkScan
LinkpadBot
LinqiaRSSBot
Lipperhey
Litemage_walker
Lmspider
MIIxpc
MQQBrowser
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor
Masscan
Mb2345Browser
MegaIndex.ru
Microsoft URL Control
Moblie Safari
Mr.4x3
NICErsPRO
NPbot
Nameprotect
Navroad
Needle
NetMechanic
NetSpider
NetZIP
Netcraft
NextGenSearchBot
Nimbostratus
Nmap
Nutch
Octopus
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
Openvas
OrangeSpider
POE-Component-Client-HTTP
PageGrabber
PageScorer
Pandalytics
Papa Foto
Pavuk
Petalbot
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
ProPowerBot
Probethenet
Pu_iN
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankingBot
RankingBot2
RankurBot
Re-re
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
ScreenerBot
Searchestate
Semrush
SeoSiteCheckup
Seomoz
Siphon
Site Sucker
SiteSucker
SocialRankIOBot
Sociscraper
Sottopop
Spanner
Sqlmap
Sqlworm
Sqworm
Steeler
Sucuri
SuperBot
Suzuran
Swiftbot
T0PHackTeam
Telesphoreo
TheNomad
TightTwatBot
Toata
Trendiction
TurnitinBot
Typhoeus
URLy Warning
Upflow
V-BOT
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voltron
WISENutbot
WPScan
WallpapersHD
WeSEE
Web Auto
Web Fetch
Web Sucker
WebFetch
WebGo IS
WebSauger
WebStripper
Webalta
Whack
Widow
Wonderbot
Woobot
Xaldon_WebSpider
Xenu
Zauba
Zeus
Zitebot
ZoomBot
ZumBot
adscanner
archive.org_bot
arquivo-web-crawler
autoemailspider
cah.io.community
coccocbot
demandbase-bot
eCatch
evc-batch
heritrix
internetVista monitor
ips-agent
linkdexbot
lwp-request
lwp-trivial
mediawords
muhstik-scan
oBot
page scorer
pcBrowser
probe-image-size
scalaj-http
seobility
seocompany.store
spyfu
trendiction.com
ubermetrics-technologies.com
webgains-bot
webprosbot
zauba.io
zgrab