nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-19 22:07:06 +00:00

250 lines
2.6 KiB
Text

80legs
AIBOT
ALittle Client
Abonti
Aboundex
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
AlphaBot
Anarchie
Anarchy99
Ankit
Anthill
Apexoo
Attach
BDFetch
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Bandit
Battleztar Bazinga
Bitacle
Black Hole
Bolt
Buddy
BuiltWith
Bullseye
CODE87
CSHttp
CheeseBot
CherryPicker
Chlooe
Citoid
CopyRightCheck
Cosmos
Craftbot
Crescent
DBLBot
DSearch
DTS Agent
Demon
Deusu
DigitalPebble
DittoSpyder
DomCopBot
DomainAppender
DomainStatsBot
Dragonfly
Drip
ECCP/1.0
Ebingbong
EirGrabber
Express WebPictures
ExtractorPro
Extreme Picture Finder
Ezooms
FemtosearchBot
Firefox/7.0
FlashGet
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
Genieo
GetWeb
GoZilla
Grafula
GridBot
HEADMasterSEO
HMView
Haansoft
HaosouSpider
IDBot
Iblog
Id-search
IlseBot
Image Fetch
IndeedBot
Internet Ninja
InternetSeer
Iria
JamesBOT
Jorgee
JustView
Jyxobot
Keyword Density
Kozmosbot
LNSpiderguy
Lanshanbot
LeechGet
Lightspeedsystems
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
Majestic SEO
Majestic-SEO
Mozlila
Mr.4x3
Msrabot
NICErsPRO
Nameprotect
Net Vampire
NetLyzer
Netcraft
Nettrack
Nibbler
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nmap
Not
Nuclei
OpenLinkProfiler
Openvas
OutclicksBot
PECL::HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Panscient
Papa Foto
Pavuk
Picscout
Picsearch
PictureFinder
Pixray
PleaseCrawl
Pu_iN
Pump
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankurBot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
Recorder
RepoMonkey
RocketCrawler
ScanAlert
Scanbot
Scrapy
ScreenerBot
ScrepyBot
Searchestate
SemanticJuice
SemrushBot
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Siteimprove
SmartDownload
SpaceBison
Spammen
Sqlmap
Sqlworm
Sqworm
Steeler
Sucuri
SuperBot
SuperHTTP
Surfbot
T0PHackTeam
Teleport
Telesoft
Telesphorep
TheNomad
Titan
Toata
Trendiction
Turnitin
TwengaBot
Typhoeus
URLy.Warning
UnisterBot
Upflow
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voltron
WBSearchBot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
WallpapersHD
WeSEE
Web Auto
Web Sauger
WebAuto
WebCollage
WebEnhancer
WebFetch
WebGo IS
WebLeacher
WebPix
WebZIP
WebsiteQuester
Whacker
Whatweb
Widow
Wprecon
Xaldon WebSpider
Zauba
Zermelo
Zitebot
ZumBot
adscanner
arquivo-web-crawler
backlink-check
cah.io.community
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
facebookscraper
ips-agent
isitwp.com
iubenda-radar
magpie-crawler
mediawords
netEstate NE Crawler
probe-image-size
s1z.ru
seostar
serpstatbot
sexsearcher
trendiction.de
ubermetrics-technologies.com
zgrab