nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-05-04 10:09:34 +00:00

250 lines
2.6 KiB
Text

AIBOT
ASPSeek
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Alligator
Anarchy
Atomseobot
Attach
AwarioSmartBot
BDFetch
BLEXBot
BacklinkCrawler
Barkrowler
Battleztar Bazinga
Black Hole
Bolt
BuiltBotTough
BuiltWith
CATExplorador
CCBot
CSHttp
Chlooe
Cocolyzebot
Collector
Copier
CrazyWebCrawler
Crescent
CrunchBot
Curious
Custo
DIIbot
DSearch
Demon
Deusu
Devil
Discobot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
DomainSigmaCrawler
Download Wonder
Drip
ECCP/1.0
EMail Wolf
Ecxi
ExtLinksBot
FDM
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Flunky
G-i-g-a-b-o-t
GermCrawler
GetRight
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
GridBot
HEADMasterSEO
HTMLparser
HTTP::Lite
Harvest
Heritrix
HonoluluBot
Humanlinks
IDBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
Intelliseek
InternetSeer
Iskanie
IstellaBot
JetCar
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
LNSpiderguy
LWP::Simple
LeechFTP
Lftp
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
Ltx71
MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Majestic-SEO
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft Data Access
Minefield
Mister PiX
Moblie Safari
Mojolicious
Mozlila
Msrabot
Name Intelligence
Needle
NetAnts
NetLyzer
NetZIP
Netcraft
Nettrack
Nibbler
NimbleCrawler
Nmap
Nuclei
Nutch
Octopus
OnCrawl
PHPCrawl
PageAnalyzer
PageGrabber
Papa Foto
PeoplePal
Picsearch
PictureFinder
Pu_iN
PxBroker
Quick-Crawler
RankActive
RankFlex
RankingBot2
RankurBot
Re-re
ReGet
RealDownload
Reaper
Recorder
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
Scanbot
Screaming
ScreenerBot
Seekport
Semrush
SemrushBot
Shodan
SiteExplorer
SiteSnagger
SlySearch
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
SpaceBison
Spanner
Spbot
Spinn3r
Sqlmap
Surfbot
SurveyBot
T8Abot
Teleport
Thumbor
Tracemyfile
Turingos
Turnitin
URLy Warning
Vacuum
VeriCiteCrawler
VoidEYE
Voil
WBSearchBot
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Enhancer
Web Fetch
Web Fuck
WebBandit
WebCollage
WebCopier
WebFetch
WebLeacher
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
Website Quester
WebsiteQuester
Whacker
Whatweb
Widow
WinHTTrack
Woobot
Wotbox
Xaldon_WebSpider
Xenu
ZmEu
ZoominfoBot
arquivo-web-crawler
arquivo.pt
cah.io.community
clark-crawler
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
gopher
heritrix
instabid
internetVista monitor
isitwp.com
linkdexbot
magpie-crawler
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
oBot
page scorer
probe-image-size
ripz
seobility
sogouspider
sysscan
x22Mozilla
zauba.io