nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-04 22:07:18 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404enemy
ADmantX
ALittle Client
Acunetix
Aipbot
Alexibot
Alligator
Anarchie
Ankit
Attach
AwarioSmartBot
BackDoorBot
BackStreet
Badass
Barkrowler
Battleztar Bazinga
BetaBot
Blackboard
Blow
Bolt
BotALot
Brandwatch
Buddy
CCBot
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CheeseBot
ChinaClaw
Claritybot
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
CrunchBot
Custo
DBLBot
DIIbot
DSearch
DataCha0s
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainSigmaCrawler
Dragonfly
Drip
ECCP/1.0
EMail Wolf
Ebingbong
EirGrabber
Exabot
Express WebPictures
ExtLinksBot
Ezooms
FlashGet
FrontPage
Fyrebot
G-i-g-a-b-o-t
Genieo
GermCrawler
GetWeb
GoZilla
Gotit
GrabNet
Grafula
HEADMasterSEO
Harvest
Havij
Heritrix
Hloader
HybridBot
IDBTE4M
IDBot
IRLbot
IlseBot
Image Fetch
InfoTekies
Intelliseek
Internet Ninja
Iskanie
JennyBot
Jetty
JikeSpider
Jorgee
JustView
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
LexiBot
Libwhisker
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MFC_Tear_Sample
MSFrontPage
Mag-Net
Majestic SEO
Majestic-SEO
Meanpathbot
Metauri
Mozlila
Musobot
NPbot
Name Intelligence
Nameprotect
NearSite
Net Vampire
NetLyzer
NetMechanic
NetSpider
NetZIP
Nettrack
Nikto
NimbleCrawler
Nmap
Not
Octopus
Offline Navigator
OnCrawl
Openvas
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
Pandalytics
Panscient
Papa Foto
Petalbot
Picsearch
Pixray
PleaseCrawl
ProPowerBot
Psbot
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankingBot2
Re-re
ReGet
Reaper
Recorder
RocketCrawler
Rogerbot
SBIder
SEOlyticsCrawler
SalesIntelligent
ScanAlert
ScoutJet
ScrepyBot
Searchestate
SemanticJuice
Semrush
SentiBot
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
SiteExplorer
SmartDownload
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
Sottopop
Spammen
Spbot
Stripper
Sucuri
SuperBot
Surfbot
Suzuran
T0PHackTeam
T8Abot
TeleportPro
Telesphorep
Thumbor
Titan
Tracemyfile
True_Robot
Turnitin
Twice
URLy Warning
URLy.Warning
Vagabondo
Voltron
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
Web Pix
Web Sauger
WebAuto
WebLeacher
WebReaper
WebSauger
WebStripper
Webshag
Whack
Whacker
Widow
WinHTTrack
WiseGuys Robot
Wotbox
Wprecon
Xenu
YoudaoBot
Zauba
Zermelo
Zitebot
ZoomBot
ZyBorg
adscanner
autoemailspider
clark-crawler
cognitiveseo
crawler.feedback
crawler4j
dataforseo.com
evc-batch
gopher
ips-agent
lwp-trivial
netEstate NE Crawler
oBot
pcBrowser
plumanalytics
probe-image-size
ripz
s1z.ru
scan.lol
serpstatbot
siteripz
tAkeOut
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
zgrab