nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-20 22:07:00 +00:00

250 lines
2.6 KiB
Text

404enemy
ASPSeek
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
Anarchy
Anthill
Asterias
BBBike
BDCbot
BDFetch
BackDoorBot
BackStreet
BacklinkCrawler
Barkrowler
Battleztar Bazinga
Bitacle
BlackWidow
Boardreader
Buck
Buddy
BuiltBotTough
BuiltWith
CATExplorador
CCBot
CODE87
Calculon
CazoodleBot
CheTeam
CheeseBot
CherryPicker
Cocolyzebot
Collector
Copier
CopyRightCheck
Curious
CyotekWebCopy
DIIbot
DataCha0s
DatabaseDriverMysqli
Deusu
Dispatch
DittoSpyder
DomCopBot
ECCP/1.0
EasyDL
Ebingbong
EroCrawler
ExtractorPro
FHscan
Fimap
FlashGet
Flunky
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GetRight
Gigabot
Go!Zilla
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
Grafula
GrapeFX
HTTrack
Haansoft
HaosouSpider
Havij
Hloader
HybridBot
IRLbot
IlseBot
Image Sucker
InfoTekies
InternetSeer
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
Joomla
JustView
Jyxobot
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin
LeechGet
LibWeb
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lmspider
MFC_Tear_Sample
MIIxpc
MJ12bot
MSFrontPage
MTRobot
Magnet
Mail.RU_Bot
Majestic-SEO
Mass Downloader
Mata Hari
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Moblie Safari
Mozlila
Name Intelligence
Nessus
Net Vampire
NetMechanic
NetSpider
Netcraft
Nibbler
NimbleCrawler
Not
Nuclei
Octopus
OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP
PHPCrawl
PageAnalyzer
Petalbot
Pi-Monster
Picscout
Picsearch
Pixray
Pockey
ProPowerBot
Psbot
Pu_iN
QueryN Metasearch
RankActive
RankingBot
RankurBot
RebelMouse
Recorder
Ripper
RocketCrawler
Rogerbot
SEOstats
SalesIntelligent
ScanAlert
Searchestate
SearchmetricsBot
Semrush
SentiBot
SeobilityBot
Seomoz
Shodan
SiteLockSpider
SiteSucker
Sitebeam
Siteimprove
Sitevigil
Snake
SocialRankIOBot
Sociscraper
Sogou web spider
Sottopop
Sqlmap
Sqlworm
Sqworm
Stripper
SuperBot
Suzuran
Teleport
The Intraformant
Thumbor
Titan
Toata
Trendiction
Turingos
Twice
URLy Warning
URLy.Warning
VB Project
VidibleScraper
Voltron
WASALive-Bot
WISENutbot
WWW-Collector-E
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Fuck
Web Pix
Web Sucker
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebStripper
WebSucker
WebZIP
Webshag
WebsiteExtractor
WebsiteQuester
Webster
Whack
Who.is Bot
WinHTTrack
WiseGuys Robot
Wotbox
YoudaoBot
Zauba
Zeus
Zitebot
adscanner
archive.org_bot
arquivo-web-crawler
backlink-check
check1.exe
cognitiveseo
crawl.sogou.com
crawler.feedback
crawler4j
domainsproject.org
eCatch
evc-batch
facebookscraper
heritrix
instabid
isitwp.com
lwp-trivial
meanpathbot
plumanalytics
polaris version
s1z.ru
scan.lol
seocompany.store
siteripz
sp_auditbot
spyfu
webmeup-crawler
webpros.com
webprosbot
zauba.io
zgrab