nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-02 22:07:03 +00:00

250 lines
2.7 KiB
Text

AIBOT
ALittle Client
Abonti
Aipbot
Alexibot
Anarchy
Anthill
Apexoo
Asterias
Atomseobot
Barkrowler
BetaBot
Bigfoot
BlackWidow
Blow
Boardreader
Brandwatch
Buddy
Bullseye
BuzzSumo
CODE87
CensysInspect
ChinaClaw
Cocolyzebot
Copyscape
Craftbot
Crawling at Home Project
CyotekWebCopy
DSearch
DatabaseDriverMysqli
DigitalPebble
Dirbuster
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Drip
ECCP/1.0
EasyDL
Ebingbong
EroCrawler
ExtLinksBot
Extractor
EyeNetIE
FHscan
Firefox/7.0
Flunky
Foobot
Freeuploader
FrontPage
Fuzz
GT::WWW
GalaxyBot
GermCrawler
GetRight
Go!Zilla
Go-Ahead-Got-It
Gotit
Grafula
GrapeFX
GrapeshotCrawler
HTMLparser
HTTrack
Heritrix
Hloader
HybridBot
IDBTE4M
Image Fetch
Image Sucker
Indy Library
Intelliseek
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
Joomla
Jorgee
Keybot Translation-Search-Machine
Kinza
Kozmosbot
LNSpiderguy
Leap
LeechFTP
LeechGet
Lftp
Lightspeedsystems
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool
MQQBrowser
Magnet
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Mata Hari
MauiBot
MeanPath Bot
MegaIndex.ru
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Msrabot
NICErsPRO
NPbot
Nessus
Net Vampire
NetLyzer
NetZIP
Niki-bot
Not
Octopus
OrangeSpider
PECL::HTTP
PageAnalyzer
Petalbot
Pi-Monster
Pimonster
Pixray
PleaseCrawl
ProPowerBot
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
ReGet
RealDownload
RepoMonkey
RocketCrawler
SEOkicks
SEOlyticsCrawler
SEOprofiler
SMTBot
SalesIntelligent
Scanbot
ScoutJet
ScreenerBot
ScrepyBot
SentiBot
SeobilityBot
SiteCheckerBotCrawler
SiteSnagger
Sitevigil
Sociscraper
Sogou web spider
SpaceBison
Spammen
SputnikBot
Sqlmap
Sqlworm
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Swiftbot
Telesoft
Telesphorep
TightTwatBot
Toata
Tracemyfile
Trendiction
True_Robot
Turnitin
TurnitinBot
TwengaBot
Twice
URLy.Warning
Upflow
VeriCiteCrawler
WBSearchBot
WWW-Mechanize
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Enhancer
Web Fuck
Web Pix
Web Sauger
Web Sucker
WebAuto
WebCollage
WebFetch
WebFuck
WebLeacher
WebReaper
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
WebsiteQuester
Whack
Who.is Bot
WiseGuys Robot
Wonderbot
Xaldon WebSpider
Zade
Zermelo
Zitebot
ZoominfoBot
ZumBot
adscanner
archive.org_bot
check1.exe
clark-crawler
coccocbot
cognitiveseo
dataforseo.com
domainsproject.org
eCatch
facebookscraper
heritrix
ips-agent
isitwp.com
lwp-request
meanpathbot
netEstate NE Crawler
page scorer
probe-image-size
ripz
satoristudio.net
scan.lol
seocompany.store
seostar
sexsearcher
sitechecker.pro
sp_auditbot
spyfu
sysscan
webgains-bot
webmeup-crawler
webprosbot
xpymep1.exe