nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-26 10:09:44 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
ALittle Client
Aboundexbot
Acunetix
AhrefsBot
Anarchie
Anarchy
Apexoo
Asterias
Atomseobot
Attach
AwarioRssBot
BDFetch
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
BlowFish
Boardreader
BuiltBotTough
Bullseye
BuzzSumo
CazoodleBot
Cegbfeieh
CheTeam
Chlooe
Citoid
Cliqzbot
CopyRightCheck
Craftbot
CrunchBot
Custo
CyotekWebCopy
DSearch
DTS Agent
DigitalPebble
Disco
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainSigmaCrawler
Dotbot
EMail Siphon
EMail Wolf
EasyDL
Exabot
Extreme Picture Finder
Ezooms
FemtosearchBot
Fimap
FlashGet
Foobot
Freeuploader
Fyrebot
GT::WWW
Genieo
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
Grafula
HEADMasterSEO
HMView
HTTrack
HaosouSpider
Havij
Humanlinks
IDBTE4M
IDBot
Id-search
Image Fetch
Image Sucker
IndeedBot
Internet Ninja
IstellaBot
JOC Web Spider
JetCar
JikeSpider
Joomla
Kinza
Larbin
LeechFTP
LeechGet
Lftp
LibWeb
Lightspeedsystems
LinkScan
LinkWalker
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MJ12bot
MTRobot
Mail.RU_Bot
Majestic SEO
MarkMonitor
Mass Downloader
Mb2345Browser
MeanPath Bot
Meanpathbot
Mojeek
Mojolicious
NPbot
Navroad
NearSite
NetLyzer
Netcraft
Nettrack
NextGenSearchBot
Niki-bot
Nikto
NimbleCrawler
Nmap
Not
Nuclei
Nutch
OpenLinkProfiler
Openvas
OutclicksBot
OutfoxBot
PageAnalyzer
PageGrabber
PageScorer
Panscient
Papa Foto
Pavuk
Pi-Monster
PictureFinder
Pimonster
Probethenet
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot2
Rankivabot
RankurBot
Recorder
RepoMonkey
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
Scanbot
ScreenerBot
ScrepyBot
Semrush
SeoSiteCheckup
Seomoz
Shodan
Site Sucker
SiteLockSpider
Sitevigil
Snake
Sociscraper
Sosospider
SpaceBison
Spanner
Spbot
SputnikBot
Sqlworm
Steeler
Stripper
SuperHTTP
SurveyBot
Szukacz
T0PHackTeam
TeleportPro
The Intraformant
Thumbor
Titan
Turingos
Turnitin
URLy Warning
URLy.Warning
Vacuum
Vagabondo
VelenPublicWebCrawler
Virusdie
VoidEYE
Voltron
WASALive-Bot
WEBDAV
WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebFetch
WebFuck
WebGo IS
WebLeacher
WebmasterWorldForumBot
Webshag
Whack
Whacker
Whatweb
Woobot
Wotbox
Xaldon WebSpider
Zade
Zitebot
ZmEu
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
check1.exe
clark-crawler
com.plumanalytics
crawl.sogou.com
crawler.feedback
demandbase-bot
evc-batch
facebookscraper
linkdexbot
lwp-trivial
meanpathbot
oBot
page scorer
s1z.ru
seoscanners
tAkeOut
trendiction.de
ubermetrics-technologies.com
webprosbot
x09Mozilla