nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-20 10:09:20 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
AIBOT
Aboundex
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
AllSubmitter
AlphaBot
Anarchie
Anarchy
Aspiegel
Asterias
Atomseobot
AwarioRssBot
BDFetch
BLEXBot
BacklinkCrawler
BetaBot
Bitacle
BlackWidow
Blow
BotALot
Brandprotect
Bullseye
CODE87
CensysInspect
CheeseBot
CherryPicker
Cloud mapping
Collector
Cosmos
Crawling at Home Project
CrazyWebCrawler
Curious
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Digincore
Dirbuster
Discobot
DittoSpyder
DnyzBot
DomCopBot
DomainStatsBot
Dotbot
ECCP/1.0
EMail Wolf
Exabot
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Flunky
Freeuploader
Fuzz
FyberSpider
Getintent
Gigabot
Go-Ahead-Got-It
Gotit
GrabNet
GrapeshotCrawler
GridBot
HEADMasterSEO
HTTP::Lite
Harvest
Heritrix
Hloader
Humanlinks
HybridBot
IDBot
IRLbot
Iblog
IlseBot
InfoTekies
Intelliseek
Iskanie
JOC Web Spider
JennyBot
JetCar
Jetty
Kenjin Spider
Kinza
LNSpiderguy
Lanshanbot
Larbin
Leap
LexiBot
LibWeb
LieBaoFast
Lightspeedsystems
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool
MQQBrowser
Mag-Net
Magnet
Majestic SEO
Mass Downloader
MauiBot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Minefield
MolokaiBot
Mr.4x3
NICErsPRO
Name Intelligence
Navroad
Nessus
Net Vampire
NetLyzer
Nettrack
Netvibes
NextGenSearchBot
Nibbler
NimbleCrawler
Ninja
Offline Explorer
OnCrawl
OpenLinkProfiler
OrangeSpider
PECL::HTTP
Page Analyzer
PageGrabber
Papa Foto
Pavuk
Picscout
Picsearch
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankFlex
Recorder
SBIder
SEOkicks
SEOkicks-Robot
SMTBot
SalesIntelligent
ScanAlert
Screaming
ScrepyBot
Searchestate
Seekport
SeobilityBot
Seomoz
SiteCheckerBotCrawler
SiteSnagger
SlySearch
SmartDownload
Snapbot
Sosospider
SpaceBison
SpankBot
Spbot
SputnikBot
Sqlmap
Sqlworm
Steeler
Sucker
SuperHTTP
Surfbot
Suzuran
Szukacz
T0PHackTeam
Telesoft
TightTwatBot
Toata
True_Robot
Turnitin
TurnitinBot
Twice
Typhoeus
UnisterBot
V-BOT
VCI
Vagabondo
WBSearchBot
WISENutbot
WWW::Mechanize
WeSEE
Web Fetch
Web Pix
WebFuck
WebImageCollector
WebZIP
Webalta
WebsiteQuester
Whacker
Widow
WinHTTrack
WiseGuys Robot
Wotbox
YoudaoBot
Zade
Zauba
Zermelo
Zeus
ZmEu
ZyBorg
adscanner
arquivo.pt
cah.io.community
clark-crawler
coccocbot
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
facebookscraper
heritrix
instabid
iubenda-radar
oBot
page scorer
plumanalytics
polaris version
probe-image-size
ripz
s1z.ru
satoristudio.net
scalaj-http
seocompany.store
seoscanners
seostar
serpstatbot
sitechecker.pro
siteripz
spyfu
trendiction.de
ubermetrics-technologies.com
voyagerx.com
xpymep1.exe