nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-26 22:07:00 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
80legs
AIBOT
Abonti
Aboundex
AhrefsBot
AiHitBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchy
Ankit
Anthill
Asterias
Attach
AwarioSmartBot
BBBike
BDCbot
BLEXBot
Badass
Bandit
Barkrowler
BatchFTP
BetaBot
Bigfoot
Blow
BlowFish
Bolt
Buck
Buddy
BuiltBotTough
CSHttp
CazoodleBot
Cegbfeieh
Chlooe
Citoid
Cloud mapping
Cocolyzebot
CopyRightCheck
CrunchBot
Curious
DIIbot
DSearch
DTS Agent
Demon
Digincore
Dirbuster
Discoverybot
DittoSpyder
DnyzBot
DomCopBot
Domains Project
EMail Wolf
Exabot
ExtLinksBot
ExtractorPro
Extreme Picture Finder
Ezooms
FlashGet
Freeuploader
FrontPage
GetRight
GetWeb
Gigabot
Go!Zilla
Gotit
GrabNet
GridBot
HEADMasterSEO
HMView
HTTrack
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
HonoluluBot
HybridBot
IDBTE4M
IDBot
IRLbot
Image Fetch
InfoNaviRobot
Iria
JennyBot
JetCar
Joomla
Jorgee
Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
Lanshanbot
Leap
LeechFTP
LexiBot
LibWeb
LieBaoFast
LinkScan
Linkbot
LinkextractorPro
LinqiaScrapeBot
Lipperhey
MIDown tool
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Magnet
Majestic-SEO
MarkMonitor
Mata Hari
Meanpathbot
MegaIndex.ru
Metauri
Microsoft Data Access
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Mr.4x3
Msrabot
NICErsPRO
Nameprotect
NearSite
Needle
Net Vampire
NetAnts
NetSpider
Nikto
Not
Nuclei
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Papa Foto
PeoplePal
Pi-Monster
Piepmatz
Pimonster
Probethenet
Pump
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot2
Rankivabot
ReGet
RealDownload
Reaper
Recorder
RepoMonkey
Ripper
SEOstats
SMTBot
Scanbot
ScoutJet
Scrapy
ScreenerBot
SemanticJuice
SeobilityBot
Seomoz
Shodan
SiteSnagger
Siteimprove
Sitevigil
Snapbot
SocialRankIOBot
Sociscraper
Sogou web spider
SpankBot
Spanner
Sqlmap
Sqlworm
Steeler
Stripper
Swiftbot
Szukacz
Telesphoreo
TheNomad
Toata
Trendiction
Trendictionbot
TurnitinBot
TwengaBot
URLy.Warning
Vagabondo
VidibleScraper
Voil
Voltron
WEBDAV
WWWOFFLE
Web Pix
Web Sauger
Web Sucker
WebAuto
WebBandit
WebCollage
WebCopier
WebGo IS
WebLeacher
WebReaper
WebSucker
WebWhacker
WebZIP
Webshag
WebsiteQuester
Whack
Whacker
Whatweb
Widow
Woobot
Wotbox
Xenu
Zade
Zermelo
Zitebot
ZyBorg
adscanner
archive.org_bot
arquivo.pt
cah.io.community
com.plumanalytics
crawl.sogou.com
evc-batch
gopher
heritrix
internetVista monitor
isitwp.com
iubenda-radar
lwp-request
lwp-trivial
magpie-crawler
oBot
polaris version
serpstatbot
sexsearcher
sp_auditbot
spyfu
sysscan
trendiction.de
xpymep1.exe