nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-07 10:09:48 +00:00

250 lines
2.7 KiB
Text

Abonti
Acunetix
AiHitBot
Aipbot
Alexibot
Anarchy99
Anthill
Apexoo
Aspiegel
Atomseobot
AwarioSmartBot
BDFetch
BackStreet
BacklinkCrawler
Black Hole
BlackWidow
Blackboard
Bolt
Buck
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CSHttp
Cegbfeieh
ChinaClaw
Citoid
Collector
CopyRightCheck
Craftbot
Crawling at Home Project
CrunchBot
Custo
DBLBot
DIIbot
DSearch
DataCha0s
Deusu
Devil
Dispatch
DittoSpyder
Domains Project
Dotbot
Download Wonder
ECCP/1.0
EMail Siphon
EasyDL
Ebingbong
EirGrabber
EroCrawler
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FHscan
FemtosearchBot
Foobot
FrontPage
Fuzz
FyberSpider
Go-Ahead-Got-It
GoZilla
Gotit
GrapeshotCrawler
HEADMasterSEO
HTTrack
Harvest
Hloader
HonoluluBot
HybridBot
IDBTE4M
IDBot
IRLbot
Id-search
Image Fetch
Image Sucker
IndeedBot
Intelliseek
InterGET
InternetSeer
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JikeSpider
Jorgee
JustView
Kenjin Spider
Keyword Density
Kinza
LWP::Simple
Lanshanbot
LeechGet
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkScan
LinkextractorPro
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Ltx71
MFC_Tear_Sample
MIDown tool
MSFrontPage
MSIECrawler
Mag-Net
Mass Downloader
Masscan
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mister PiX
Mozlila
Msrabot
Navroad
Nessus
NetMechanic
Nettrack
Nikto
Nimbostratus
Nutch
Octopus
Openfind
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
PageThing.com
Papa Foto
Pavuk
Picscout
Piepmatz
ProPowerBot
Probethenet
Psbot
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
Re-re
ReGet
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SEOlyticsCrawler
ScreenerBot
Searchestate
Seomoz
SiteExplorer
SiteLockSpider
SiteSnagger
Sitevigil
SmartDownload
SocialRankIOBot
SpaceBison
Spanner
Sqlworm
Steeler
Stripper
Sucker
SuperHTTP
SurveyBot
Suzuran
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
The Intraformant
Thumbor
TightTwatBot
Toweyabot
Trendiction
Trendictionbot
Typhoeus
URLy.Warning
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
WASALive-Bot
WBSearchBot
WISENutbot
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Pix
Web Sucker
WebFetch
WebReaper
WebSauger
WebStripper
Webshag
Webster
WiseGuys Robot
Wotbox
Wprecon
Xaldon WebSpider
YoudaoBot
Zauba
Zeus
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
arquivo.pt
autoemailspider
backlink-check
clark-crawler
coccocbot
domainsproject.org
facebookscraper
instabid
internetVista monitor
iubenda-radar
linkdexbot
lwp-trivial
muhstik-scan
page scorer
pcBrowser
plumanalytics
polaris version
s1z.ru
seobility
seocompany.store
serpstatbot
sitechecker.pro
sogouspider
spyfu
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
x22Mozilla
xpymep1.exe
zauba.io