nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-10 22:07:13 +00:00

250 lines
2.6 KiB
Text

404enemy
ADmantX
AIBOT
Abonti
Aboundex
AfD-Verbotsverfahren
AhrefsBot
AllSubmitter
Anarchy99
Ankit
Anthill
Asterias
Atomseobot
AwarioRssBot
BDFetch
Bandit
Barkrowler
Battleztar Bazinga
BlackWidow
Blackboard
BlowFish
Brandprotect
Buck
Buddy
CATExplorador
CODE87
CSHttp
Calculon
CheTeam
CherryPicker
Citoid
Cocolyzebot
Cogentbot
Copier
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
CyotekWebCopy
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Devil
Disco
Dispatch
DnBCrawler-Analytics
DomainAppender
Dotbot
Dragonfly
EasyDL
Ecxi
EirGrabber
Exabot
Extreme Picture Finder
Ezooms
FemtosearchBot
FlashGet
FrontPage
Fuzz
Fyrebot
GalaxyBot
Getintent
Go!Zilla
Gotit
GrapeFX
GridBot
HMView
HTTP::Lite
Harvest
Havij
Heritrix
HonoluluBot
Humanlinks
Iblog
Image Fetch
Indy Library
InfoNaviRobot
Internet Ninja
IstellaBot
JOC Web Spider
JetCar
JikeSpider
Joomla
Jyxobot
LNSpiderguy
Leap
LeechFTP
LeechGet
LexiBot
Lftp
LieBaoFast
Likse
LinkScan
Linkbot
LinkpadBot
LinqiaRSSBot
Lipperhey Spider
MFC_Tear_Sample
MJ12bot
MarkMonitor
Masscan
MauiBot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mozlila
Msrabot
NICErsPRO
Navroad
Needle
Net Vampire
NetLyzer
NetMechanic
NetZIP
Netcraft
Nettrack
Niki-bot
NimbleCrawler
Nimbostratus
Nuclei
Nutch
Offline Navigator
OpenLinkProfiler
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
Papa Foto
Pavuk
Pi-Monster
PictureFinder
Pimonster
Pockey
ProWebWalker
Probethenet
Psbot
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
RankurBot
Re-re
RealDownload
RedesScrapy
Ripper
Rogerbot
SBIder
SEOlyticsCrawler
SEOstats
SISTRIX
ScreenerBot
ScrepyBot
Seekport
Semrush
SemrushBot
SentiBot
SiteLockSpider
Siteimprove
Sitevigil
SlySearch
Sottopop
Spanner
Spbot
Sqlmap
Sqlworm
Sqworm
Steeler
Sucker
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
Swiftbot
Teleport
TeleportPro
Telesphoreo
The Intraformant
Toweyabot
Trendiction
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
Typhoeus
UnisterBot
Upflow
VB Project
Vacuum
VeriCiteCrawler
Voil
WBSearchBot
WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Enhancer
Web Fetch
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebCopier
WebFuck
WebGo IS
WebImageCollector
Webalta
Webshag
Website Quester
WebsiteExtractor
Webster
Who.is Bot
Widow
WinHTTrack
Wotbox
Zauba
ZyBorg
arquivo.pt
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
evc-batch
facebookscraper
iubenda-radar
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
plumanalytics
ripz
seocompany.store
seostar
serpstatbot
sitechecker.pro
siteripz
spyfu
tAkeOut
trendiction.de
webmeup-crawler
webprosbot
zgrab