nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-03 10:09:39 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
80legs
AIBOT
ASPSeek
Abonti
Aboundex
Acunetix
AhrefsBot
AiHitBot
AlphaBot
Ankit
Anthill
Aspiegel
Atomseobot
AwarioSmartBot
BBBike
BDFetch
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
Blow
Boardreader
Buck
Buddy
BuiltWith
BuzzSumo
CATExplorador
CazoodleBot
CheeseBot
Chlooe
Citoid
Claritybot
Cliqzbot
Cogentbot
Copier
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
CyotekWebCopy
DSearch
DTS Agent
DataCha0s
Digincore
Dirbuster
Disco
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DomainSigmaCrawler
ECCP/1.0
EMail Wolf
Ebingbong
Ecxi
EirGrabber
Exabot
Extractor
Extreme Picture Finder
EyeNetIE
FDM
FHscan
Fimap
Firefox/7.0
Foobot
FrontPage
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GetRight
Getintent
Havij
Heritrix
HonoluluBot
IDBTE4M
IlseBot
Image Fetch
Image Sucker
IndeedBot
Intelliseek
InternetSeer
JOC Web Spider
JamesBOT
JennyBot
JetCar
Joomla
JustView
Jyxobot
Keybot Translation-Search-Machine
Kozmosbot
LWP::Simple
Lftp
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lmspider
Ltx71
MQQBrowser
MSFrontPage
Magnet
Majestic SEO
MarkMonitor
MarkWatch
Masscan
MeanPath Bot
MegaIndex.ru
Microsoft Data Access
Mojeek
MolokaiBot
Mozlila
Mr.4x3
Musobot
Nameprotect
NearSite
Nessus
Net Vampire
NetAnts
NetLyzer
NetSpider
Nettrack
Ninja
Not
Octopus
Offline Explorer
PHPCrawl
Page Analyzer
PageAnalyzer
PageScorer
PageThing.com
Papa Foto
Pavuk
PeoplePal
Picscout
Picsearch
Piepmatz
PyCurl
Quick-Crawler
RSSingBot
RankActive
RankingBot2
Rankivabot
RealDownload
Reaper
RedesScrapy
Ripper
Rogerbot
SBIder
SEOkicks-Robot
SISTRIX
Screaming
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
Seekport
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
SiteCheckerBotCrawler
Sitebeam
Sitevigil
SlySearch
SmartDownload
Sociscraper
Spammen
Spanner
Spinn3r
SputnikBot
Sqlworm
Sqworm
SuperBot
Surfbot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Telesphoreo
TheNomad
Thumbor
TightTwatBot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
TurnitinBot
URLy Warning
URLy.Warning
V-BOT
Vagabondo
Voltron
WEBDAV
WWW::Mechanize
Web Auto
Web Fetch
Web Sucker
WebAuto
WebBandit
WebImageCollector
WebPix
WebStripper
WebSucker
WebWhacker
Website Quester
Whatweb
WinHTTrack
Wotbox
Xaldon_WebSpider
YoudaoBot
Zauba
ZoominfoBot
adscanner
archive.org_bot
arquivo-web-crawler
backlink-check
cah.io.community
check1.exe
clark-crawler
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
demandbase-bot
eCatch
facebookscraper
instabid
internetVista monitor
iubenda-radar
linkdexbot
mediawords
muhstik-scan
oBot
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
scan.lol
spyfu
trendiction.com
voyagerx.com
webgains-bot
xpymep1.exe
zauba.io
zgrab