nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-29 11:15:30 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
Abonti
Aboundex
AhrefsBot
Alexibot
AllSubmitter
Anarchie
Apexoo
Aspiegel
AwarioSmartBot
BackStreet
Barkrowler
Battleztar Bazinga
BetaBot
Bitacle
Blackboard
BlowFish
Boardreader
Bolt
Buck
Bullseye
BuzzSumo
CazoodleBot
CensysInspect
CheeseBot
CherryPicker
Cliqzbot
Cogentbot
Collector
Copyscape
Custo
DIIbot
DataCha0s
DatabaseDriverMysqli
Dirbuster
Discobot
Discoverybot
DittoSpyder
DomainCrawler
DomainStatsBot
Drip
Express WebPictures
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GermCrawler
GetRight
Gigabot
Go!Zilla
Grabber
Grafula
GrapeFX
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
Haansoft
Havij
Heritrix
HybridBot
IDBTE4M
IRLbot
Id-search
IlseBot
InfoTekies
Intelliseek
InterGET
InternetSeer
IstellaBot
JetCar
Jetty
JikeSpider
Keyword Density
Kozmosbot
LNSpiderguy
Lanshanbot
Larbin
LeechGet
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
MIIxpc
MSIECrawler
Magnet
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mass Downloader
Mata Hari
MauiBot
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Msrabot
Musobot
Name Intelligence
Nameprotect
Net Vampire
NetAnts
NetZIP
Netcraft
Niki-bot
Nikto
Nmap
Nuclei
Nutch
Offline Explorer
Offline Navigator
OpenVAS
Openvas
OrangeSpider
OutclicksBot
PECL::HTTP
PHPCrawl
PageThing.com
Panscient
Papa Foto
Petalbot
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
Pump
PxBroker
Quick-Crawler
RankActiveLinkBot
Rankivabot
RankurBot
Re-re
RealDownload
Reaper
RedesScrapy
RepoMonkey
RocketCrawler
SEOlyticsCrawler
SEOstats
SMTBot
Scanbot
Scrapy
SearchmetricsBot
Siphon
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
SpaceBison
Spammen
SputnikBot
Sqlworm
Sqworm
Steeler
Sucker
Sucuri
SuperHTTP
Suzuran
Telesoft
Telesphorep
Toata
Tracemyfile
Trendiction
TurnitinBot
Upflow
VelenPublicWebCrawler
Virusdie
WASALive-Bot
WEBDAV
WISENutbot
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
WeSEE
Web Collage
Web Fetch
Web Fuck
Web Sauger
WebAuto
WebGo IS
WebLeacher
WebPix
WebSauger
WebWhacker
Website Quester
Whack
Whacker
Whatweb
Who.is Bot
Widow
Wonderbot
Wotbox
Wprecon
Xaldon_WebSpider
Zauba
ZyBorg
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
check1.exe
crawler.feedback
crawler4j
demandbase-bot
facebookscraper
heritrix
ips-agent
isitwp.com
lwp-request
lwp-trivial
meanpathbot
oBot
page scorer
pcBrowser
polaris version
probe-image-size
s1z.ru
scan.lol
seobility
sexsearcher
sitechecker.pro
siteripz
sogouspider
tAkeOut
xpymep1.exe
zauba.io