nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-04 22:07:25 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404checker
404enemy
AIBOT
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Alligator
AlphaBot
Anarchie
Anarchy99
Anthill
Asterias
Attach
AwarioRssBot
BDCbot
BLEXBot
BackStreet
Backlink-Ceck
Badass
Barkrowler
Battleztar Bazinga
Bigfoot
Black Hole
Blow
BlowFish
BotALot
BuiltBotTough
BuiltWith
BuzzSumo
CATExplorador
CSHttp
CheeseBot
CherryPicker
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Cosmos
Craftbot
Curious
CyotekWebCopy
DSearch
DTS Agent
Deusu
DigitalPebble
Dirbuster
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
Dotbot
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
EroCrawler
Evil
ExtLinksBot
Extreme Picture Finder
Firefox/7.0
Foobot
Freeuploader
FrontPage
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GetRight
GetWeb
Gigablast
Go-Ahead-Got-It
Grafula
HEADMasterSEO
HTMLparser
HTTP::Lite
HaosouSpider
Harvest
Heritrix
IDBTE4M
IDBot
Id-search
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iskanie
IstellaBot
Jbrofuzz
JetCar
Jetty
Jorgee
Kenjin Spider
LeechFTP
LeechGet
LexiBot
LibWeb
Lightspeedsystems
Likse
LinkScan
LinkWalker
Linkdexbot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MFC_Tear_Sample
MQQBrowser
MTRobot
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Metauri
Moblie Safari
Morfeus Fucking Scanner
Msrabot
NearSite
Net Vampire
NetMechanic
NetZIP
NimbleCrawler
Octopus
OpenLinkProfiler
OpenVAS
Openvas
OrangeSpider
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
PageScorer
PageThing.com
Papa Foto
Pavuk
Picscout
Picsearch
PictureFinder
PleaseCrawl
ProWebWalker
Pu_iN
Pump
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
Rankivabot
RankurBot
RealDownload
Reaper
Recorder
SBIder
SEOprofiler
ScoutJet
Scrapy
ScreenerBot
SeoSiteCheckup
SeobilityBot
Site Sucker
SiteExplorer
SiteSucker
SlySearch
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
Spanner
Sqlmap
Sqworm
Steeler
Stripper
SuperBot
Swiftbot
T0PHackTeam
T8Abot
Teleport
TeleportPro
The Intraformant
Thumbor
Turnitin
Twice
Typhoeus
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
WBSearchBot
WWW::Mechanize
WallpapersHD
WeSEE
Web Auto
Web Enhancer
Web Pix
WebAuto
WebCopier
WebFetch
WebStripper
WebWhacker
WebmasterWorldForumBot
Webster
Whatweb
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zeus
Zitebot
ZmEu
ZoominfoBot
ZumBot
archive.org_bot
autoemailspider
check1.exe
coccocbot-web
cognitiveseo
crawler4j
domainsproject.org
eCatch
facebookscraper
isitwp.com
mediawords
netEstate NE Crawler
page scorer
pcBrowser
polaris version
probe-image-size
ripz
satoristudio.net
scalaj-http
scan.lol
seoscanners
seostar
sysscan
trendiction.com
voyagerx.com
x09Mozilla