nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-13 22:07:29 +00:00

250 lines
2.5 KiB
Text

404checker
404enemy
80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Abonti
Aboundex
Aboundexbot
AhrefsBot
AiHitBot
Anarchie
Apexoo
Aspiegel
Asterias
AwarioRssBot
BBBike
BDCbot
BLEXBot
BackDoorBot
Badass
Black Hole
Blackboard
Blow
Boardreader
Bolt
BotALot
Buck
Buddy
BuiltBotTough
BuiltWith
CATExplorador
CCBot
CODE87
Calculon
CazoodleBot
CheTeam
CherryPicker
ChinaClaw
Copyscape
Cosmos
Craftbot
Curious
DBLBot
DIIbot
DTS Agent
Demon
Devil
DigitalPebble
Discoverybot
Dispatch
DittoSpyder
DomCopBot
DomainSigmaCrawler
Dotbot
Download Wonder
Drip
EMail Wolf
Ecxi
EirGrabber
EroCrawler
Exabot
ExtLinksBot
FDM
Fimap
Freeuploader
FrontPage
GT::WWW
GermCrawler
GetRight
Gigablast
Gigabot
Go-Ahead-Got-It
Grabber
GrapeFX
GridBot
Havij
Hloader
Humanlinks
IDBot
IlseBot
Image Sucker
InfoNaviRobot
InterGET
InternetSeer
JikeSpider
LWP::Simple
Lanshanbot
LeechGet
LexiBot
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Ltx71
MFC_Tear_Sample
MIDown tool
MJ12bot
MQQBrowser
Majestic SEO
Majestic-SEO
MarkWatch
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Mr.4x3
NICErsPRO
NPbot
Navroad
Needle
Net Vampire
NetSpider
Nettrack
Netvibes
Nikto
Nutch
Octopus
Offline Explorer
Openfind
OrangeSpider
OutfoxBot
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
Petalbot
Picscout
Picsearch
Pimonster
Probethenet
Psbot
Pump
PxBroker
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankFlex
ReGet
Recorder
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
SEOlyticsCrawler
SMTBot
ScanAlert
ScoutJet
Scrapy
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
SentiBot
Seomoz
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
Siteimprove
Sitevigil
SlySearch
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
SpaceBison
SpankBot
Spanner
Spbot
Spinn3r
SputnikBot
Sqlworm
Sqworm
Sucker
TeleportPro
Telesphorep
The Intraformant
TheNomad
Titan
Toata
Toweyabot
True_Robot
UnisterBot
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voil
Voltron
WWW-Collector-E
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Enhancer
Web Sauger
Web Sucker
WebCopier
WebFuck
WebGo IS
WebLeacher
WebWhacker
WebZIP
Webshag
Whack
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Wotbox
Xaldon_WebSpider
Zade
Zauba
Zermelo
Zeus
ZumBot
autoemailspider
backlink-check
cah.io.community
check1.exe
cognitiveseo
crawler.feedback
facebookscraper
gopher
lwp-trivial
magpie-crawler
muhstik-scan
oBot
page scorer
scalaj-http
serpstatbot
sexsearcher
sysscan
trendiction.de
voyagerx.com
webmeup-crawler
x22Mozilla