nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-19 10:09:07 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
ALittle Client
Abonti
Acunetix
Anarchy
Anthill
Aspiegel
Asterias
Attach
AwarioSmartBot
BBBike
BackStreet
BackWeb
Badass
Barkrowler
Battleztar Bazinga
Black Hole
Blow
Bolt
Brandprotect
BuiltBotTough
BunnySlippers
BuzzSumo
CCBot
CODE87
CazoodleBot
CheeseBot
ChinaClaw
Citoid
Cogentbot
Copier
CopyRightCheck
Cosmos
Crawling at Home Project
Custo
CyotekWebCopy
DBLBot
Demon
Deusu
Devil
Digincore
DigitalPebble
Dirbuster
DnBCrawler-Analytics
DomainStatsBot
Domains Project
Drip
Ebingbong
EirGrabber
EroCrawler
Evil
Exabot
ExtractorPro
Ezooms
FemtosearchBot
Flunky
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GermCrawler
Gigabot
Go!Zilla
GrabNet
GrapeshotCrawler
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Havij
HonoluluBot
IDBTE4M
IDBot
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
Intelliseek
InterGET
Iria
Iskanie
JetCar
Joomla
JustView
Lanshanbot
Larbin
Leap
LeechFTP
LibWeb
LieBaoFast
Lightspeedsystems
Likse
Linkbot
LinkpadBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Majestic-SEO
Majestic12
Mass Downloader
Masscan
Metauri
Minefield
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Nameprotect
NetMechanic
NetSpider
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
Ninja
Nutch
Openvas
OutclicksBot
OutfoxBot
PageAnalyzer
PageScorer
PageThing.com
Papa Foto
PeoplePal
Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
ProPowerBot
ProWebWalker
Pu_iN
PxBroker
Quick-Crawler
RankFlex
RankingBot2
RepoMonkey
Ripper
SEOkicks
SEOlyticsCrawler
SEOstats
SMTBot
ScoutJet
Screaming
Searchestate
SearchmetricsBot
SemrushBot
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
Site Sucker
Sitebeam
Sitevigil
SlySearch
Snake
Snapbot
Snoopy
Sociscraper
Sogou web spider
Sottopop
Spammen
SputnikBot
Sqworm
SuperBot
SurveyBot
Suzuran
Teleport
TeleportPro
TheNomad
Tracemyfile
True_Robot
Turingos
Turnitin
TurnitinBot
UnisterBot
VeriCiteCrawler
VoidEYE
WASALive-Bot
WEBDAV
WWWOFFLE
WeSEE
Web Collage
Web Fuck
Web Pix
Web Sauger
WebAuto
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFuck
WebGo IS
WebImageCollector
WebStripper
WebWhacker
WebZIP
Website Quester
WebsiteQuester
Webster
Whack
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wotbox
Xenu
YoudaoBot
Zermelo
adscanner
check1.exe
coccocbot
cognitiveseo
crawler.feedback
crawler4j
demandbase-bot
evc-batch
heritrix
instabid
ips-agent
isitwp.com
iubenda-radar
lwp-trivial
muhstik-scan
netEstate NE Crawler
plumanalytics
seobility
sexsearcher
sitechecker.pro
sogouspider
sysscan
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webprosbot
zauba.io