nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-07 10:09:07 +00:00

250 lines
2.7 KiB
Text

404checker
ALittle Client
Abonti
Aboundex
Aboundexbot
AiHitBot
Aipbot
AllSubmitter
Alligator
AlphaBot
Anarchie
Ankit
Anthill
Aspiegel
Attach
AwarioSmartBot
BBBike
BLEXBot
BackDoorBot
BacklinkCrawler
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
BlackWidow
BlowFish
Bolt
Buck
BuiltBotTough
Bullseye
CATExplorador
CCBot
Calculon
CazoodleBot
ChinaClaw
Chlooe
Cogentbot
CopyRightCheck
Copyscape
Cosmos
CrazyWebCrawler
CrunchBot
Custo
CyotekWebCopy
DIIbot
DSearch
Devil
Digincore
Discoverybot
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
EMail Siphon
EroCrawler
Express WebPictures
ExtractorPro
Firefox/7.0
Freeuploader
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GermCrawler
Getintent
Go-Ahead-Got-It
Gotit
GrapeshotCrawler
HEADMasterSEO
Haansoft
HaosouSpider
Harvest
Heritrix
Humanlinks
IDBTE4M
Iblog
IlseBot
Image Fetch
IndeedBot
Indy Library
Intelliseek
InterGET
Iria
Iskanie
IstellaBot
JetCar
Joomla
Kozmosbot
LNSpiderguy
Larbin
LeechGet
LibWeb
LieBaoFast
Linkbot
Linkdexbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MJ12bot
MTRobot
Mag-Net
Magnet
Majestic-SEO
MarkWatch
Mass Downloader
MauiBot
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft Data Access
Mister PiX
Moblie Safari
Mojeek
Mojolicious
Musobot
NPbot
NetAnts
NetZIP
Netvibes
Niki-bot
Nimbostratus
OnCrawl
OpenLinkProfiler
Openfind
OutfoxBot
PageScorer
PeoplePal
PictureFinder
Piepmatz
Pixray
Pump
PxBroker
QueryN Metasearch
RankActive
RankFlex
RankingBot
ReGet
RebelMouse
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SalesIntelligent
ScanAlert
ScoutJet
Screaming
ScreenerBot
SearchmetricsBot
Semrush
SentiBot
SeobilityBot
Seomoz
Site Sucker
SiteExplorer
SmartDownload
Snapbot
Snoopy
SocialRankIOBot
Sosospider
Spanner
Sqlworm
Stripper
SuperBot
SuperHTTP
SurveyBot
TeleportPro
Telesphorep
Titan
Toata
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Typhoeus
URLy.Warning
V-BOT
Vacuum
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
WPScan
Wallpapers
WallpapersHD
Web Auto
Web Collage
Web Enhancer
Web Fetch
WebAuto
WebCollage
WebCopier
WebFetch
WebPix
WebReaper
WebStripper
WebWhacker
Webshag
Website Quester
WebsiteExtractor
Widow
WiseGuys Robot
Xenu
Zade
Zauba
Zermelo
Zitebot
ZmEu
ZoomBot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
coccocbot-web
cognitiveseo
com.plumanalytics
demandbase-bot
eCatch
evc-batch
facebookscraper
heritrix
ips-agent
lwp-request
netEstate NE Crawler
oBot
page scorer
probe-image-size
scan.lol
serpstatbot
sexsearcher
sitechecker.pro
siteripz
trendiction.com
ubermetrics-technologies.com
xpymep1.exe
zauba.io
zgrab