nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-12 22:07:16 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
AIBOT
Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
Alexibot
AllSubmitter
Anarchie
Anarchy
Aspiegel
Asterias
Atomseobot
BBBike
BDFetch
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Black Hole
BlackWidow
Bolt
Brandprotect
Buck
Bullseye
BunnySlippers
CCBot
CODE87
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
Cliqzbot
Cocolyzebot
CrazyWebCrawler
Crescent
Curious
CyotekWebCopy
DBLBot
DSearch
DTS Agent
DataCha0s
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
Dotbot
Download Wonder
Drip
EMail Siphon
EMail Wolf
EasyDL
EirGrabber
Evil
Exabot
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
FemtosearchBot
Fuzz
G-i-g-a-b-o-t
GT::WWW
Genieo
GetRight
Getintent
Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
GrapeshotCrawler
HEADMasterSEO
HMView
HTTP::Lite
HonoluluBot
Humanlinks
IDBot
IRLbot
Iblog
Image Sucker
Indy Library
InfoNaviRobot
InterGET
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Lanshanbot
Lftp
LinkextractorPro
LinkpadBot
LinqiaRSSBot
MQQBrowser
MTRobot
MarkMonitor
Mata Hari
MauiBot
Minefield
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
NPbot
Nameprotect
NetLyzer
NetSpider
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
Ninja
Nmap
Nutch
Octopus
Offline Explorer
OpenVAS
Openfind
OrangeSpider
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageThing.com
Papa Foto
PeoplePal
Picsearch
Piepmatz
Pixray
PleaseCrawl
Pump
RSSingBot
RankActiveLinkBot
RankFlex
RankurBot
RebelMouse
RedesScrapy
SBIder
SEOstats
SalesIntelligent
Scrapy
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
SemrushBot
SentiBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Siteimprove
Snake
Snapbot
Sociscraper
Spammen
Spinn3r
SputnikBot
Sqlworm
SuperBot
Surfbot
SurveyBot
Suzuran
T0PHackTeam
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Titan
Toweyabot
Trendictionbot
Turingos
Turnitin
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
Vagabondo
VidibleScraper
Virusdie
WASALive-Bot
WISENutbot
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Collage
Web Enhancer
Web Fetch
WebAuto
WebEnhancer
WebFuck
WebImageCollector
WebLeacher
WebsiteExtractor
Whatweb
Widow
WinHTTrack
Wprecon
Zitebot
ZmEu
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
crawl.sogou.com
eCatch
evc-batch
facebookscraper
gopher
instabid
internetVista monitor
isitwp.com
iubenda-radar
lwp-request
netEstate NE Crawler
pcBrowser
probe-image-size
scalaj-http
seocompany.store
serpstatbot
sexsearcher
siteripz
sogouspider
sysscan
trendiction.com
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla
zauba.io
zgrab