nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-12 10:09:14 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
80legs
ASPSeek
Abonti
Acunetix
AiHitBot
Aipbot
AlphaBot
Anarchie
Anarchy
Ankit
Aspiegel
Atomseobot
AwarioRssBot
AwarioSmartBot
BLEXBot
BackDoorBot
BackStreet
Badass
BetaBot
Bitacle
BlackWidow
Blackboard
Boardreader
Brandprotect
Bullseye
BuzzSumo
CATExplorador
CheTeam
CherryPicker
ChinaClaw
Citoid
Cloud mapping
Cogentbot
CopyRightCheck
Cosmos
CrazyWebCrawler
Curious
Custo
DBLBot
DIIbot
DSearch
DTS Agent
Demon
Devil
Discobot
Discoverybot
DnyzBot
DomainCrawler
DomainSigmaCrawler
Domains Project
Ebingbong
Exabot
Express WebPictures
ExtractorPro
FDM
FemtosearchBot
Freeuploader
FrontPage
Fyrebot
G-i-g-a-b-o-t
Go!Zilla
Go-Ahead-Got-It
Gotit
Grabber
HEADMasterSEO
HMView
HTMLparser
Haansoft
Harvest
Hloader
HonoluluBot
IDBTE4M
Iblog
IlseBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InterGET
Internet Ninja
InternetSeer
Iskanie
JOC Web Spider
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
JustView
Kenjin Spider
Keybot Translation-Search-Machine
Kozmosbot
Lanshanbot
Larbin
LeechGet
LinqiaScrapeBot
MFC_Tear_Sample
MIDown tool
MJ12bot
Mag-Net
Magnet
Mail.RU_Bot
Majestic SEO
Majestic12
Masscan
Mb2345Browser
MeanPath Bot
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Moblie Safari
Mojolicious
MolokaiBot
Mr.4x3
Msrabot
NICErsPRO
NPbot
Nameprotect
Navroad
Net Vampire
NetLyzer
NetMechanic
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nmap
Not
Nutch
OnCrawl
OpenLinkProfiler
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
PeoplePal
Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
Pimonster
Probethenet
Psbot
Pu_iN
Pump
PxBroker
PyCurl
RankingBot2
RankurBot
Re-re
ReGet
Reaper
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
SISTRIX
SalesIntelligent
ScanAlert
Scrapy
Semrush
SeoSiteCheckup
Siphon
SiteCheckerBotCrawler
SiteLockSpider
Siteimprove
Sitevigil
Snoopy
Sogou web spider
SpankBot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Stripper
SuperHTTP
Surfbot
Szukacz
Teleport
Telesoft
Titan
Trendiction
Trendictionbot
Turnitin
TwengaBot
URLy Warning
VCI
Vagabondo
VelenPublicWebCrawler
WASALive-Bot
WEBDAV
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
WeSEE
Web Collage
WebAuto
WebBandit
WebCopier
WebEnhancer
WebFuck
WebsiteExtractor
Webster
Whacker
Widow
WinHTTrack
Woobot
Xaldon_WebSpider
Zermelo
ZumBot
adscanner
arquivo-web-crawler
backlink-check
check1.exe
coccocbot
crawl.sogou.com
eCatch
evc-batch
isitwp.com
iubenda-radar
lwp-trivial
magpie-crawler
netEstate NE Crawler
pcBrowser
ripz
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seoscanners
seostar
sexsearcher
siteripz
spyfu
trendiction.com
trendiction.de
webprosbot
x09Mozilla
x22Mozilla