nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-05 22:07:12 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
Abonti
Aboundex
Aboundexbot
Acunetix
Alexibot
Anarchy
Aspiegel
Asterias
AwarioSmartBot
BDCbot
BDFetch
BackDoorBot
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
Blow
BlowFish
Buddy
BunnySlippers
BuzzSumo
CherryPicker
ChinaClaw
Claritybot
Cogentbot
Collector
Craftbot
DTS Agent
Digincore
DigitalPebble
Discobot
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Dotbot
Ebingbong
EroCrawler
Exabot
Express WebPictures
Extractor
Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot
Fimap
Foobot
Freeuploader
Fyrebot
GT::WWW
GalaxyBot
Genieo
Go-Ahead-Got-It
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Harvest
Havij
Hloader
HonoluluBot
Humanlinks
IDBTE4M
Id-search
IlseBot
Image Fetch
Image Sucker
InfoTekies
InterGET
InternetSeer
Iria
Jbrofuzz
JennyBot
Jetty
Joomla
JustView
Kenjin Spider
Keyword Density
Larbin
Leap
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Linkbot
Lipperhey
Litemage_walker
Lmspider
MFC_Tear_Sample
MIIxpc
MJ12bot
MSIECrawler
Mag-Net
Majestic-SEO
MarkMonitor
Mata Hari
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Mister PiX
Mozlila
Musobot
Navroad
NetSpider
NetZIP
Nettrack
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Not
Nuclei
OpenVAS
Openfind
Openvas
OrangeSpider
OutclicksBot
OutfoxBot
PageAnalyzer
PageScorer
Panscient
PeoplePal
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
Pockey
ProPowerBot
ProWebWalker
Probethenet
Psbot
PyCurl
RankingBot2
Rankivabot
RankurBot
ReGet
Recorder
Ripper
SBIder
SEOkicks-Robot
SEOprofiler
ScanAlert
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
Seekport
Semrush
SeobilityBot
Seomoz
Shodan
Snake
Snoopy
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen
Spanner
Steeler
Sucuri
SurveyBot
T0PHackTeam
TeleportPro
Telesphoreo
TheNomad
TightTwatBot
Trendiction
Trendictionbot
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
URLy Warning
VB Project
VCI
VelenPublicWebCrawler
VidibleScraper
VoidEYE
Voil
WBSearchBot
WISENutbot
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers
WeSEE
Web Enhancer
WebAuto
WebBandit
WebCollage
WebImageCollector
WebSauger
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Whacker
Whatweb
WinHTTrack
WiseGuys Robot
Wprecon
Xenu
Zeus
ZoominfoBot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
clark-crawler
coccocbot
com.plumanalytics
crawl.sogou.com
crawler.feedback
domainsproject.org
internetVista monitor
isitwp.com
iubenda-radar
lwp-request
muhstik-scan
oBot
pcBrowser
ripz
scalaj-http
serpstatbot
sexsearcher
siteripz
sogouspider
spyfu
trendiction.com
trendiction.de
voyagerx.com
webpros.com
webprosbot
zgrab