nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-19 22:07:08 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
80legs
ADmantX
AIBOT
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
AllSubmitter
AlphaBot
Anarchie
Anarchy
Anarchy99
Apexoo
Asterias
BBBike
BDCbot
BackDoorBot
BackWeb
Backlink-Ceck
Barkrowler
Battleztar Bazinga
BetaBot
Black Hole
Blackboard
Blow
BlowFish
Buck
Buddy
Bullseye
BuzzSumo
CCBot
CODE87
CazoodleBot
Cegbfeieh
CheeseBot
Claritybot
Cogentbot
Copier
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
Custo
CyotekWebCopy
DIIbot
DatabaseDriverMysqli
Demon
Devil
Dirbuster
Discobot
DittoSpyder
DnBCrawler-Analytics
Dotbot
Download Wonder
Dragonfly
EirGrabber
Evil
Express WebPictures
EyeNetIE
Ezooms
FHscan
FlashGet
Flunky
Fuzz
FyberSpider
GT::WWW
GalaxyBot
GermCrawler
Getintent
Go-Ahead-Got-It
GrabNet
GridBot
Haansoft
Hloader
Humanlinks
HybridBot
IRLbot
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
Intelliseek
JennyBot
Jetty
Joomla
Jorgee
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LeechFTP
LibWeb
Libwhisker
LieBaoFast
LinkScan
LinkWalker
LinkextractorPro
Lipperhey
Lipperhey Spider
Litemage_walker
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Majestic12
Mass Downloader
Masscan
Mata Hari
MeanPath Bot
Meanpathbot
Metauri
Microsoft Data Access
Microsoft URL Control
Morfeus Fucking Scanner
Mr.4x3
NPbot
Nameprotect
Nessus
Net Vampire
Netcraft
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Nuclei
Nutch
Octopus
OpenLinkProfiler
OutclicksBot
POE-Component-Client-HTTP
Picsearch
Pimonster
Pixray
PleaseCrawl
ProPowerBot
RSSingBot
RankActiveLinkBot
RankingBot2
RankurBot
Reaper
Recorder
RepoMonkey
Ripper
Rogerbot
SEOstats
SalesIntelligent
ScoutJet
Scrapy
Screaming
ScreenerBot
SemrushBot
SeobilityBot
Shodan
Siphon
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Sitevigil
SlySearch
Snake
Sogou web spider
Sosospider
Sottopop
SpaceBison
Spammen
SpankBot
Spanner
Spinn3r
Sucker
SuperBot
SuperHTTP
TeleportPro
Toata
Trendiction
Twice
URLy.Warning
VB Project
Vacuum
VidibleScraper
VoidEYE
WEBDAV
WISENutbot
WPScan
WWW::Mechanize
WWWOFFLE
Web Pix
Web Sucker
WebCopier
WebEnhancer
WebFuck
WebImageCollector
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
Whacker
Whatweb
Widow
WinHTTrack
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zermelo
Zitebot
ZmEu
ZumBot
adscanner
arquivo.pt
backlink-check
cah.io.community
check1.exe
clark-crawler
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
eCatch
gopher
internetVista monitor
ips-agent
isitwp.com
lwp-trivial
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler
oBot
probe-image-size
seobility
serpstatbot
sexsearcher
sogouspider
sysscan
trendiction.com
webmeup-crawler
webpros.com
zauba.io