nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-02 10:09:15 +00:00

250 lines
2.6 KiB
Text

404enemy
80legs
Aboundexbot
Acunetix
AhrefsBot
Aipbot
Alligator
Anarchie
Aspiegel
Asterias
Atomseobot
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
BatchFTP
Battleztar Bazinga
BlackWidow
Blackboard
BlowFish
Boardreader
Bolt
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CCBot
CODE87
CazoodleBot
Cegbfeieh
CheTeam
Chlooe
Copier
CopyRightCheck
Cosmos
CrazyWebCrawler
Crescent
Curious
DSearch
DTS Agent
Demon
Deusu
Devil
DigitalPebble
Disco
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainSigmaCrawler
Download Wonder
EMail Wolf
EasyDL
Ebingbong
EirGrabber
ExtractorPro
Extreme Picture Finder
FDM
FHscan
Firefox/7.0
FlashGet
Flunky
Freeuploader
FrontPage
Genieo
GermCrawler
GetRight
Gigabot
Go-Ahead-Got-It
Grabber
GrapeFX
HEADMasterSEO
HMView
HTMLparser
HTTrack
HaosouSpider
Harvest
Havij
Humanlinks
IDBTE4M
IRLbot
Id-search
InterGET
InternetSeer
Iria
Iskanie
IstellaBot
JamesBOT
JetCar
Jetty
JikeSpider
Keyword Density
LNSpiderguy
LWP::Simple
LeechFTP
Libwhisker
Lightspeedsystems
LinkScan
LinkWalker
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Lmspider
MQQBrowser
Meanpathbot
Metauri
Mojolicious
Mozlila
Mr.4x3
Musobot
NICErsPRO
Nameprotect
NetMechanic
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
Nikto
Nmap
Offline Explorer
OpenVAS
OrangeSpider
OutclicksBot
OutfoxBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
PeoplePal
Pockey
Psbot
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankingBot
Re-re
ReGet
RealDownload
RebelMouse
SEOkicks
SalesIntelligent
Scanbot
ScreenerBot
SearchmetricsBot
SemrushBot
SeoSiteCheckup
SiteExplorer
Sociscraper
Sosospider
Sottopop
SpaceBison
Spammen
Spanner
Spinn3r
Sqworm
Steeler
Stripper
Sucker
SuperBot
SuperHTTP
Surfbot
Suzuran
Swiftbot
Szukacz
Teleport
TeleportPro
Telesoft
Telesphoreo
TheNomad
TightTwatBot
Trendictionbot
True_Robot
TurnitinBot
Twice
UnisterBot
Upflow
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
WASALive-Bot
WISENutbot
WPScan
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fetch
Web Sucker
WebCollage
WebEnhancer
WebPix
WebWhacker
WebmasterWorldForumBot
Webshag
Webster
Whacker
Widow
Wonderbot
Woobot
YoudaoBot
Zeus
Zitebot
ZmEu
ZoomBot
ZumBot
arquivo-web-crawler
arquivo.pt
check1.exe
crawler.feedback
demandbase-bot
eCatch
facebookscraper
gopher
internetVista monitor
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
mediawords
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
plumanalytics
polaris version
probe-image-size
satoristudio.net
scan.lol
seobility
seocompany.store
sexsearcher
sitechecker.pro
siteripz
sogouspider
spyfu
sysscan
webpros.com
webprosbot
x22Mozilla
zauba.io
zgrab