nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-06 22:07:10 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404checker
80legs
ADmantX
AIBOT
Abonti
AfD-Verbotsverfahren
Anarchie
Ankit
Anthill
Aspiegel
Attach
AwarioSmartBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
BlackWidow
BlowFish
Buck
Bullseye
CCBot
CODE87
Cegbfeieh
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Cloud mapping
Cocolyzebot
Collector
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crescent
CrunchBot
CyotekWebCopy
DIIbot
DSearch
DatabaseDriverMysqli
Demon
Deusu
Discobot
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainCrawler
DomainSigmaCrawler
EMail Wolf
Ebingbong
EroCrawler
Express WebPictures
Firefox/7.0
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
Getintent
Gigabot
Go-Ahead-Got-It
GrapeshotCrawler
GridBot
HEADMasterSEO
Heritrix
Humanlinks
IDBTE4M
IRLbot
Indy Library
InterGET
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JennyBot
Jetty
JikeSpider
Jorgee
Kinza
Larbin
LeechGet
Libwhisker
Lightspeedsystems
Likse
Linkbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MSFrontPage
MTRobot
Mag-Net
MarkMonitor
Mass Downloader
MauiBot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Moblie Safari
Morfeus Fucking Scanner
Mozlila
NICErsPRO
Name Intelligence
NearSite
Needle
NetAnts
NetLyzer
NetZIP
Nettrack
Netvibes
NextGenSearchBot
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nutch
Octopus
OpenLinkProfiler
Openfind
OrangeBot
OrangeSpider
OutclicksBot
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
Panscient
Picscout
ProWebWalker
Probethenet
Pu_iN
Pump
Quick-Crawler
RankFlex
Rankivabot
Re-re
ReGet
RebelMouse
RepoMonkey
Ripper
SMTBot
ScanAlert
Screaming
Searchestate
SentiBot
SeobilityBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Siteimprove
Sitevigil
Snake
Snoopy
Sociscraper
Sogou web spider
Sottopop
SpankBot
Spanner
Sqlmap
Steeler
Sucuri
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesoft
TheNomad
Thumbor
TightTwatBot
Trendiction
True_Robot
Turnitin
TurnitinBot
TwengaBot
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voil
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers
WeSEE
Web Fuck
Web Sucker
WebCopier
WebEnhancer
WebImageCollector
WebSauger
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
Webster
Whack
Whatweb
WinHTTrack
Wonderbot
Woobot
Xaldon_WebSpider
Xenu
Zade
Zauba
ZyBorg
backlink-check
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
facebookscraper
heritrix
internetVista monitor
ips-agent
lwp-trivial
magpie-crawler
pcBrowser
plumanalytics
s1z.ru
scalaj-http
seoscanners
siteripz
sp_auditbot
sysscan
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe
zauba.io
zgrab