nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-21 22:09:00 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
AIBOT
Abonti
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot
Anarchy99
Apexoo
Aspiegel
BDFetch
BLEXBot
BackDoorBot
BacklinkCrawler
Badass
Bandit
BetaBot
Bitacle
Black Hole
BlackWidow
Blow
Boardreader
Bolt
BotALot
Brandprotect
BuiltWith
BunnySlippers
BuzzSumo
CCBot
CODE87
CSHttp
CazoodleBot
Cegbfeieh
CheeseBot
CherryPicker
Claritybot
Cocolyzebot
CopyRightCheck
Copyscape
Cosmos
Crescent
Custo
DSearch
DataCha0s
Deusu
Digincore
Dirbuster
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainSigmaCrawler
EMail Wolf
Exabot
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot
Fimap
Fuzz
FyberSpider
GT::WWW
Genieo
GermCrawler
GetWeb
Go!Zilla
Gotit
GrabNet
Grabber
GrapeshotCrawler
GridBot
HMView
HTTrack
Haansoft
Harvest
Heritrix
Humanlinks
HybridBot
IDBTE4M
IRLbot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InterGET
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
JustView
Kenjin Spider
LeechFTP
Lftp
LibWeb
LieBaoFast
Likse
LinqiaRSSBot
Litemage_walker
Ltx71
MIIxpc
MQQBrowser
Mag-Net
Majestic-SEO
Majestic12
Masscan
MeanPath Bot
MegaIndex.ru
Microsoft URL Control
Mojeek
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Needle
Nessus
NetAnts
NetLyzer
NetMechanic
NetSpider
Netcraft
Nettrack
Nimbostratus
Octopus
Offline Navigator
OnCrawl
Openvas
PECL::HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Papa Foto
PeoplePal
Picscout
Piepmatz
Pimonster
PleaseCrawl
Probethenet
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
ReGet
Reaper
Recorder
RepoMonkey
Ripper
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SMTBot
ScanAlert
ScoutJet
Scrapy
Screaming
ScreenerBot
Semrush
SemrushBot
Shodan
SiteSnagger
Sitebeam
Sitevigil
SlySearch
Snapbot
Snoopy
Sociscraper
Sosospider
Spammen
SpankBot
Spbot
SputnikBot
Sqlmap
Sqlworm
Sqworm
Teleport
TeleportPro
Telesphoreo
The Intraformant
Thumbor
TightTwatBot
Trendiction
Trendictionbot
True_Robot
Turingos
Twice
Typhoeus
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
WISENutbot
Wallpapers
Web Collage
Web Enhancer
Web Sucker
WebEnhancer
WebFuck
WebPix
WebReaper
WebsiteExtractor
Whack
Whacker
Widow
Wotbox
Xaldon_WebSpider
Xenu
Zade
Zermelo
Zitebot
ZmEu
ZoomBot
ZumBot
ZyBorg
arquivo.pt
autoemailspider
backlink-check
clark-crawler
coccocbot-web
com.plumanalytics
crawler.feedback
domainsproject.org
eCatch
gopher
internetVista monitor
magpie-crawler
netEstate NE Crawler
page scorer
plumanalytics
polaris version
s1z.ru
satoristudio.net
scalaj-http
seobility
serpstatbot
sp_auditbot
tAkeOut
ubermetrics-technologies.com
webmeup-crawler
webprosbot
x22Mozilla
xpymep1.exe