nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-23 10:09:09 +00:00

250 lines
2.5 KiB
Text

AIBOT
ASPSeek
Aboundex
Acunetix
Aipbot
Anarchie
Anarchy
Aspiegel
BDCbot
BLEXBot
BacklinkCrawler
Bigfoot
BlackWidow
Blow
Brandwatch
Buck
Buddy
CODE87
Calculon
CheTeam
CheeseBot
CherryPicker
Cloud mapping
Cocolyzebot
Collector
Curious
DBLBot
DIIbot
DSearch
Devil
Digincore
Dispatch
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Drip
ECCP/1.0
EMail Wolf
EirGrabber
EroCrawler
Express WebPictures
ExtLinksBot
EyeNetIE
Ezooms
FDM
FemtosearchBot
Firefox/7.0
Flunky
Foobot
Fuzz
Genieo
GetWeb
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
Grafula
GrapeFX
GrapeshotCrawler
HTTP::Lite
HaosouSpider
Harvest
HybridBot
IDBTE4M
IDBot
IRLbot
IlseBot
Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
InternetSeer
Iskanie
Jbrofuzz
JetCar
Jetty
Joomla
Jorgee
Jyxobot
Kinza
LNSpiderguy
LWP::Simple
Lanshanbot
Leap
LeechFTP
LeechGet
Libwhisker
Likse
LinkScan
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
MIDown tool
MJ12bot
MQQBrowser
Mag-Net
Majestic-SEO
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
Mediatoolkitbot
Microsoft URL Control
Moblie Safari
NPbot
Navroad
NearSite
Needle
NetAnts
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
Ninja
Nuclei
Offline Explorer
Openvas
OrangeSpider
OutfoxBot
PHPCrawl
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
Pavuk
Picscout
PictureFinder
Piepmatz
Pimonster
Pixray
Psbot
Pump
RankActive
Rankivabot
RankurBot
Re-re
ReGet
Recorder
Ripper
RocketCrawler
SEOkicks-Robot
SEOprofiler
SMTBot
SalesIntelligent
Scanbot
ScoutJet
Semrush
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Siteimprove
SlySearch
Sottopop
Stripper
Sucker
Sucuri
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft
Telesphorep
TheNomad
Toata
Toweyabot
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
UnisterBot
Upflow
V-BOT
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Collage
Web Pix
Web Sucker
WebEnhancer
WebPix
WebSauger
WebSucker
WebmasterWorldForumBot
Webshag
Whack
WinHTTrack
WiseGuys Robot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zermelo
Zeus
ZoominfoBot
adscanner
clark-crawler
coccocbot-web
dataforseo.com
gopher
heritrix
internetVista monitor
ips-agent
netEstate NE Crawler
page scorer
pcBrowser
probe-image-size
ripz
satoristudio.net
scalaj-http
siteripz
sogouspider
sp_auditbot
spyfu
trendiction.com
webmeup-crawler
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io