nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-29 10:09:06 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
80legs
Abonti
Aboundex
Aboundexbot
AhrefsBot
AiHitBot
AlphaBot
Anarchy
Anthill
Apexoo
AwarioSmartBot
BDCbot
BDFetch
BLEXBot
BackWeb
Backlink-Ceck
Barkrowler
BatchFTP
Bitacle
Blackboard
BlowFish
Bolt
BotALot
Buddy
Bullseye
BunnySlippers
BuzzSumo
CCBot
Chlooe
Cliqzbot
Copier
CopyRightCheck
CrazyWebCrawler
Crescent
CrunchBot
Custo
CyotekWebCopy
DSearch
DataCha0s
DatabaseDriverMysqli
Deusu
Devil
DigitalPebble
Disco
Discobot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainCrawler
DomainStatsBot
Download Wonder
Drip
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
EirGrabber
Express WebPictures
EyeNetIE
Firefox/7.0
G-i-g-a-b-o-t
GermCrawler
Gotit
Grafula
GrapeFX
HEADMasterSEO
HTTrack
Haansoft
Harvest
Heritrix
Hloader
HonoluluBot
IRLbot
Iblog
IlseBot
Image Sucker
InfoTekies
InterGET
Internet Ninja
InternetSeer
Iskanie
JennyBot
JetCar
Jetty
Kinza
Larbin
LeechFTP
LeechGet
LinkextractorPro
LinkpadBot
LinksManager
Lipperhey
Lipperhey Spider
Lmspider
MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Majestic SEO
MarkWatch
MauiBot
Mister PiX
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Msrabot
Musobot
Needle
Net Vampire
NetLyzer
NetMechanic
Nettrack
Netvibes
Nibbler
NimbleCrawler
Not
Nuclei
Nutch
Octopus
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeBot
Page Analyzer
PageAnalyzer
PageScorer
PageThing.com
Papa Foto
Picsearch
Pixray
PleaseCrawl
Psbot
PxBroker
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RankurBot
RealDownload
Reaper
RebelMouse
SBIder
SEOstats
SISTRIX
SMTBot
Scanbot
ScoutJet
Screaming
ScrepyBot
Searchestate
SearchmetricsBot
Seekport
SemrushBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
Snoopy
Sociscraper
Sottopop
SpaceBison
Spammen
Spanner
Sqlmap
Sqworm
Steeler
Sucker
SuperHTTP
Swiftbot
Szukacz
T0PHackTeam
Toata
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turnitin
Twice
Typhoeus
URLy Warning
URLy.Warning
VCI
VelenPublicWebCrawler
Virusdie
Voil
WASALive-Bot
WBSearchBot
WISENutbot
WWW-Collector-E
Wallpapers
Web Auto
Web Enhancer
Web Fetch
Web Sauger
WebAuto
WebFetch
WebImageCollector
WebSauger
WebStripper
WebSucker
WebZIP
Website Quester
Webster
Whack
Whacker
Widow
WinHTTrack
Wonderbot
Wotbox
Xaldon WebSpider
Xenu
Zade
autoemailspider
backlink-check
cah.io.community
clark-crawler
coccocbot
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
eCatch
instabid
internetVista monitor
ips-agent
isitwp.com
magpie-crawler
meanpathbot
oBot
probe-image-size
scalaj-http
scan.lol
seobility
seocompany.store
seoscanners
seostar
serpstatbot
sexsearcher
sp_auditbot
trendiction.de
webmeup-crawler
webpros.com
x22Mozilla