nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-18 14:22:33 +00:00

250 lines
2.6 KiB
Text

ADmantX
Abonti
Aboundexbot
AhrefsBot
AiHitBot
Alligator
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BDFetch
BackDoorBot
Backlink-Ceck
Badass
Bandit
BatchFTP
Black Hole
BlackWidow
Blow
BlowFish
BotALot
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Craftbot
CrazyWebCrawler
CyotekWebCopy
DIIbot
DTS Agent
DatabaseDriverMysqli
Demon
Devil
Discobot
DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dragonfly
ECCP/1.0
EasyDL
Ebingbong
EirGrabber
Evil
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
FlashGet
FrontPage
GalaxyBot
Genieo
GetRight
Gigabot
Go!Zilla
GoZilla
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTMLparser
Heritrix
Hloader
Humanlinks
IDBTE4M
IndeedBot
InfoNaviRobot
InterGET
InternetSeer
Iria
Iskanie
JetCar
JikeSpider
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
LNSpiderguy
LWP::Simple
Larbin
LibWeb
LieBaoFast
Likse
Linkdexbot
Litemage_walker
Ltx71
MSFrontPage
MTRobot
Mail.RU_Bot
Majestic SEO
MarkMonitor
Masscan
Mata Hari
MauiBot
Mb2345Browser
Mediatoolkitbot
Metauri
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Needle
NetLyzer
NetMechanic
NextGenSearchBot
Nimbostratus
Nutch
OPPO A33
Octopus
Offline Navigator
OpenVAS
Openvas
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Pandalytics
Papa Foto
PleaseCrawl
Pu_iN
PyCurl
RankActive
RankActiveLinkBot
RankingBot
Rankivabot
RepoMonkey
Rogerbot
SEOkicks
SEOkicks-Robot
SEOprofiler
Scanbot
Scrapy
Screaming
ScreenerBot
ScrepyBot
Semrush
SemrushBot
SentiBot
Site Sucker
SiteExplorer
Sitevigil
Snoopy
SocialRankIOBot
Sociscraper
Spammen
Spanner
Sqlworm
Sqworm
Steeler
SuperBot
SurveyBot
Szukacz
T8Abot
Teleport
TeleportPro
Telesphoreo
The Intraformant
TheNomad
Thumbor
Toata
Trendictionbot
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WASALive-Bot
WEBDAV
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
WallpapersHD
Web Collage
Web Fuck
Web Pix
WebAuto
WebCollage
WebCopier
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebPix
WebReaper
WebStripper
WebWhacker
Webalta
Webshag
WebsiteExtractor
Webster
Whack
Whacker
Whatweb
Widow
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zermelo
Zeus
Zitebot
ZmEu
ZoominfoBot
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
check1.exe
cognitiveseo
crawl.sogou.com
crawler.feedback
crawler4j
instabid
internetVista monitor
isitwp.com
muhstik-scan
oBot
page scorer
pcBrowser
polaris version
probe-image-size
s1z.ru
seobility
serpstatbot
sexsearcher
sogouspider
spyfu
sysscan
webmeup-crawler
x09Mozilla
xpymep1.exe
zauba.io
zgrab