nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-10-18 10:11:12 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
ADmantX
AIBOT
ASPSeek
Abonti
Aboundex
AhrefsBot
AiHitBot
AllSubmitter
Anarchie
Aspiegel
Attach
AwarioRssBot
AwarioSmartBot
Badass
Barkrowler
BetaBot
Bigfoot
BlackWidow
Blackboard
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CSHttp
CazoodleBot
Cegbfeieh
Chlooe
Claritybot
Cliqzbot
Collector
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
Crescent
CyotekWebCopy
DatabaseDriverMysqli
Deusu
Devil
DigitalPebble
Dirbuster
DnBCrawler-Analytics
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dragonfly
Drip
EMail Wolf
ExtractorPro
Extreme Picture Finder
Ezooms
FyberSpider
GT::WWW
GermCrawler
GoZilla
Gotit
Grafula
GridBot
HMView
HTMLparser
HTTP::Lite
HTTrack
Haansoft
Heritrix
Humanlinks
IDBot
IRLbot
IlseBot
Image Fetch
Image Sucker
IndeedBot
Intelliseek
InternetSeer
Iria
Iskanie
JennyBot
Jetty
Kenjin Spider
Kozmosbot
LeechGet
LibWeb
Libwhisker
Likse
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
Ltx71
MSFrontPage
MTRobot
Mag-Net
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
MicroMessenger
MolokaiBot
Morfeus Fucking Scanner
NearSite
Needle
Net Vampire
NetSpider
NetZIP
NextGenSearchBot
Nibbler
Nmap
Not
Nutch
Octopus
OnCrawl
Openvas
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Papa Foto
PictureFinder
Pixray
PleaseCrawl
Probethenet
Psbot
Pu_iN
QueryN Metasearch
RankActive
RankFlex
Rankivabot
RankurBot
Ripper
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
ScanAlert
Scanbot
ScoutJet
SearchmetricsBot
Seekport
SemanticJuice
SentiBot
SeobilityBot
Seomoz
Shodan
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
Sitevigil
SlySearch
SmartDownload
Snapbot
SocialRankIOBot
Sogou web spider
SpaceBison
Spanner
Spbot
Spinn3r
SputnikBot
Stripper
Sucuri
Surfbot
SurveyBot
Swiftbot
T8Abot
Teleport
Telesoft
Telesphoreo
Telesphorep
TheNomad
Titan
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
URLy.Warning
UnisterBot
VoidEYE
Voil
Voltron
WASALive-Bot
WPScan
Wallpapers/3.0
Web Auto
Web Collage
Web Enhancer
Web Fuck
Web Sucker
WebEnhancer
WebFetch
WebPix
WebSauger
WebSucker
Webalta
Website Quester
WebsiteExtractor
Whack
Who.is Bot
WinHTTrack
Woobot
Wotbox
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zitebot
ZmEu
ZoomBot
archive.org_bot
arquivo-web-crawler
cah.io.community
crawl.sogou.com
crawler4j
eCatch
evc-batch
heritrix
ips-agent
isitwp.com
lwp-request
lwp-trivial
netEstate NE Crawler
oBot
pcBrowser
ripz
s1z.ru
seoscanners
serpstatbot
sexsearcher
sitechecker.pro
spyfu
tAkeOut
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webpros.com
zgrab