nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-31 14:11:35 +00:00

250 lines
2.5 KiB
Text

360Spider
80legs
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alligator
Anarchie
Anarchy
Anarchy99
Ankit
Apexoo
Asterias
Attach
BDFetch
BackStreet
Badass
BatchFTP
Battleztar Bazinga
Bitacle
Black Hole
BlowFish
Boardreader
Bolt
Brandprotect
Brandwatch
Buck
BuiltBotTough
CSHttp
CherryPicker
Chlooe
Claritybot
Cocolyzebot
Collector
CopyRightCheck
Cosmos
Craftbot
Curious
Custo
DIIbot
DTS Agent
Devil
Digincore
Disco
Discobot
Dispatch
DittoSpyder
DomCopBot
DomainStatsBot
Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
Ecxi
EirGrabber
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
Extractor
Extreme Picture Finder
FDM
Fimap
FlashGet
Foobot
Freeuploader
FrontPage
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetWeb
Gigablast
Gigabot
GrabNet
GrapeFX
HMView
HTTP::Lite
HaosouSpider
Havij
Heritrix
Hloader
Humanlinks
IRLbot
Id-search
InterGET
InternetSeer
Iskanie
IstellaBot
JamesBOT
JennyBot
Jetty
Jyxobot
Kozmosbot
LNSpiderguy
LeechFTP
LibWeb
Libwhisker
LieBaoFast
Likse
LinkScan
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MJ12bot
MSFrontPage
Magnet
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Mata Hari
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Msrabot
Musobot
NICErsPRO
NetLyzer
NetSpider
Nibbler
Niki-bot
Ninja
Nmap
Offline Explorer
Offline Navigator
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageScorer
PageThing.com
Petalbot
Pi-Monster
Pimonster
PleaseCrawl
Pockey
ProPowerBot
Probethenet
Pu_iN
RankActive
RankActiveLinkBot
Rankivabot
RealDownload
Reaper
Recorder
RepoMonkey
Ripper
SEOprofiler
SEOstats
SISTRIX
SalesIntelligent
Scanbot
Scrapy
Searchestate
Semrush
SemrushBot
Seomoz
Shodan
SiteCheckerBotCrawler
Sitebeam
Sitevigil
Snake
Sociscraper
Sosospider
Sottopop
SpaceBison
Spammen
Spanner
SputnikBot
Sqlmap
Sqworm
Sucuri
SurveyBot
Szukacz
T8Abot
TeleportPro
Telesphoreo
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
Twice
URLy Warning
V-BOT
VCI
Voltron
WASALive-Bot
WBSearchBot
WISENutbot
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Collage
Web Enhancer
Web Fuck
Web Pix
Web Sucker
WebBandit
WebCopier
WebFetch
WebFuck
WebReaper
WebSauger
WebSucker
WebWhacker
Webalta
Webshag
WebsiteQuester
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xenu
Zade
Zitebot
ZumBot
ZyBorg
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler.feedback
facebookscraper
heritrix
lwp-request
magpie-crawler
muhstik-scan
netEstate NE Crawler
oBot
plumanalytics
polaris version
ripz
s1z.ru
scalaj-http
sexsearcher
siteripz
trendiction.de
voyagerx.com
zauba.io