nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-29 22:07:05 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
AIBOT
Aboundexbot
Aipbot
Alligator
AlphaBot
Anarchie
Anthill
BBBike
BDCbot
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
BlackWidow
Blackboard
BlowFish
Boardreader
Bolt
Brandwatch
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CCBot
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CheeseBot
Chlooe
Cliqzbot
CopyRightCheck
Cosmos
Craftbot
Crescent
DTS Agent
Deusu
Devil
Digincore
DigitalPebble
Domains Project
Download Wonder
Dragonfly
EMail Siphon
EasyDL
Ebingbong
EroCrawler
Exabot
FemtosearchBot
Foobot
Freeuploader
FrontPage
Fuzz
Genieo
GetRight
Getintent
Go!Zilla
GrabNet
HMView
HTMLparser
HTTrack
Haansoft
Harvest
Havij
Heritrix
Hloader
HonoluluBot
Humanlinks
IDBTE4M
IDBot
IRLbot
Iblog
Id-search
IlseBot
Indy Library
InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
IstellaBot
JetCar
JikeSpider
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
Kozmosbot
Lanshanbot
LeechGet
Likse
LinkScan
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
Ltx71
MFC_Tear_Sample
MSFrontPage
MSIECrawler
MTRobot
Magnet
MarkWatch
Metauri
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mozlila
Musobot
Navroad
Net Vampire
NetLyzer
NetSpider
Netcraft
Niki-bot
Nikto
Ninja
Not
OnCrawl
Openfind
OrangeBot
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Panscient
Petalbot
Pi-Monster
Picsearch
PictureFinder
Pimonster
Pixray
ProPowerBot
ProWebWalker
Probethenet
Pump
PxBroker
RSSingBot
RankActive
RankingBot
Rankivabot
RankurBot
ReGet
RealDownload
RedesScrapy
RepoMonkey
Rogerbot
SEOstats
ScanAlert
Scrapy
ScreenerBot
Searchestate
Seekport
SemrushBot
SeobilityBot
SiteExplorer
SiteSucker
SmartDownload
Snake
Snapbot
Snoopy
Sociscraper
Sosospider
Sottopop
SpaceBison
Spammen
SpankBot
Spanner
Spbot
Sucker
SuperBot
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
TeleportPro
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Turnitin
TurnitinBot
TwengaBot
Twice
URLy.Warning
Upflow
Vacuum
VeriCiteCrawler
Virusdie
VoidEYE
Voil
WISENutbot
WWW-Mechanize
WWW::Mechanize
WeSEE
Web Auto
Web Sauger
WebFetch
WebPix
WebStripper
WebSucker
Webalta
WebmasterWorldForumBot
Webshag
Whacker
Widow
Wonderbot
Wotbox
Xenu
YoudaoBot
Zauba
ZoomBot
ZoominfoBot
archive.org_bot
arquivo.pt
coccocbot
crawl.sogou.com
dataforseo.com
domainsproject.org
heritrix
iubenda-radar
lwp-trivial
magpie-crawler
mediawords
plumanalytics
s1z.ru
satoristudio.net
seoscanners
siteripz
sogouspider
sp_auditbot
spyfu
trendiction.com
ubermetrics-technologies.com
webgains-bot
x09Mozilla
xpymep1.exe