nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-13 22:07:03 +00:00

250 lines
2.6 KiB
Text

404enemy
ALittle Client
ASPSeek
Aboundexbot
AiHitBot
Alexibot
AllSubmitter
Anarchie
Anthill
Aspiegel
Atomseobot
AwarioRssBot
BDCbot
Backlink-Ceck
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BotALot
Brandprotect
Buck
Bullseye
BunnySlippers
CATExplorador
Calculon
Cegbfeieh
Citoid
Cliqzbot
Cogentbot
Collector
Cosmos
Craftbot
Crawling at Home Project
CrunchBot
Custo
DBLBot
DTS Agent
Devil
Dirbuster
Discobot
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomCopBot
DomainSigmaCrawler
Ebingbong
EirGrabber
Express WebPictures
ExtLinksBot
Extractor
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Flunky
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight
Getintent
GoZilla
Grabber
Grafula
GrapeFX
GridBot
HEADMasterSEO
HTTrack
Haansoft
Heritrix
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
Iblog
Id-search
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
IstellaBot
JOC Web Spider
Jbrofuzz
JetCar
Jetty
Jorgee
Jyxobot
Kozmosbot
LNSpiderguy
Lanshanbot
Leap
LeechFTP
LibWeb
Libwhisker
Likse
LinkextractorPro
LinqiaScrapeBot
MIDown tool
MIIxpc
MJ12bot
MTRobot
Majestic-SEO
Mata Hari
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft URL Control
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
NICErsPRO
Name Intelligence
Navroad
NearSite
Net Vampire
NetSpider
NetZIP
Nettrack
Nibbler
NimbleCrawler
Nmap
Not
Offline Navigator
OpenVAS
OrangeBot
OrangeSpider
PageGrabber
PageScorer
Pandalytics
Pi-Monster
PictureFinder
Piepmatz
Pimonster
Pixray
PleaseCrawl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankingBot
Rankivabot
RankurBot
ReGet
RealDownload
Reaper
RedesScrapy
RocketCrawler
SEOkicks-Robot
SEOstats
SISTRIX
SalesIntelligent
ScoutJet
Scrapy
Semrush
Seomoz
Siphon
SiteLockSpider
Sitebeam
Snake
Snapbot
Snoopy
Sogou web spider
SpaceBison
Spammen
SputnikBot
Steeler
Stripper
SuperHTTP
Suzuran
T0PHackTeam
Teleport
Telesoft
Telesphoreo
TheNomad
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
TurnitinBot
Typhoeus
URLy.Warning
VCI
Virusdie
WASALive-Bot
WWW-Mechanize
Wallpapers
Web Auto
Web Collage
Web Pix
Web Sauger
WebAuto
WebBandit
WebFetch
WebFuck
WebImageCollector
WebPix
WebStripper
WebSucker
Webalta
Webshag
Website Quester
Webster
WinHTTrack
Wonderbot
Woobot
Xaldon_WebSpider
YoudaoBot
ZmEu
ZoomBot
ZyBorg
archive.org_bot
autoemailspider
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com
domainsproject.org
facebookscraper
heritrix
ips-agent
isitwp.com
iubenda-radar
meanpathbot
netEstate NE Crawler
oBot
pcBrowser
polaris version
probe-image-size
ripz
seostar
sogouspider
sp_auditbot
spyfu
sysscan
voyagerx.com
webmeup-crawler
webprosbot
zauba.io
zgrab