vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-14 09:09:49 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.02.2896 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-02-03 22:07:23 +00:00
parent de82bb1b6c
commit c201315905
47 changed files with 84658 additions and 84648 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2895 #### Version: V4.2022.02.2896
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2895 #### Version: V4.2022.02.2896
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.02.2895 #### Version: V4.2022.02.2896
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10444
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.02.2895 #### Version: V4.2022.02.2896
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10448
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10448
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10448
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10448
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 1; 10.1.1.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 0; 10.1.1.74 0;
127.0.0.1 0; 127.0.0.1 0;

10448
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 1; 10.1.1.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 0; 10.1.1.74 0;
127.0.0.1 0; 127.0.0.1 0;

10448
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 1; 10.1.1.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 0; 10.1.1.74 0;
127.0.0.1 0; 127.0.0.1 0;

10448
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2895 2896

10448
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10448
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.87.42.57 0; 20.127.17.191 0;

10448
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 1; 10.1.1.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 0; 10.1.1.74 0;
127.0.0.1 0; 127.0.0.1 0;

10448
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 1; 10.1.1.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 0; 10.1.1.74 0;
127.0.0.1 0; 127.0.0.1 0;

10448
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 1; 10.1.1.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 0; 10.1.1.74 0;
127.0.0.1 0; 127.0.0.1 0;

10448
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.87.42.57 0; 20.127.17.191 0;

10448
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.87.42.57 0; 20.127.17.191 0;

10448
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 1; 10.1.1.74 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Alligator DSearch
CheeseBot DnyzBot
Harvest Download Wonder
LinksManager GalaxyBot
PyCurl LWP::Simple
RepoMonkey Moblie Safari
WEBDAV ProWebWalker
webmeup-crawler Sqworm
webpros.com Swiftbot
x09Mozilla sysscan

320
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 01h4x.com
404checker
80legs 80legs
ADmantX ADmantX
AIBOT ALittle Client
ASPSeek ASPSeek
Abonti
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter AllSubmitter
Alligator AlphaBot
Anarchy Anarchy
Anarchy99 Ankit
Anthill Attach
Asterias AwarioRssBot
BDCbot AwarioSmartBot
BDFetch
BLEXBot
BackDoorBot BackDoorBot
Backlink-Ceck
BacklinkCrawler
Badass Badass
Barkrowler
BatchFTP
Battleztar Bazinga
Bitacle Bitacle
Black Hole
Blackboard Blackboard
BlowFish Blow
Brandprotect
Brandwatch Brandwatch
BuiltWith Buck
BuiltBotTough
BunnySlippers
BuzzSumo
CATExplorador CATExplorador
CCBot CODE87
CSHttp
Calculon Calculon
CazoodleBot
Cegbfeieh
CensysInspect CensysInspect
CheTeam
CheeseBot
CherryPicker
ChinaClaw ChinaClaw
Chlooe
Citoid
Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
Craftbot CrunchBot
Crawling at Home Project
Crescent
Curious
Custo Custo
CyotekWebCopy DBLBot
DSearch DTS Agent
Demon DataCha0s
DigitalPebble DatabaseDriverMysqli
Discoverybot Digincore
DomCopBot DomCopBot
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Dragonfly Domains Project
Dotbot
Download Wonder
EMail Siphon
EMail Wolf EMail Wolf
EasyDL EasyDL
EroCrawler
Exabot Exabot
Ezooms ExtLinksBot
FemtosearchBot Extreme Picture Finder
Firefox/7.0 Firefox/7.0
FlashGet FlashGet
Flunky GT::WWW
Foobot
Freeuploader
Fyrebot
GalaxyBot GalaxyBot
Genieo Genieo
Gigabot GetRight
GrabNet Getintent
Grabber Go-Ahead-Got-It
Grafula Gotit
GrapeFX GrapeFX
GrapeshotCrawler
GridBot GridBot
HMView HTTrack
HTTP::Lite HaosouSpider
Haansoft
Havij Havij
Humanlinks
HybridBot HybridBot
IRLbot Iblog
Image Fetch
Image Sucker Image Sucker
IndeedBot Intelliseek
Indy Library InterGET
Internet Ninja InternetSeer
Iskanie JamesBOT
JOC Web Spider
Jbrofuzz Jbrofuzz
JetCar
JikeSpider JikeSpider
Jorgee
Jyxobot
Kenjin Spider Kenjin Spider
Kozmosbot Keyword Density
LNSpiderguy
LWP::Simple LWP::Simple
Lanshanbot LeechFTP
Larbin
LeechGet LeechGet
LexiBot Libwhisker
Lftp LieBaoFast
Lightspeedsystems Linkdexbot
LinkextractorPro
LinkpadBot LinkpadBot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
Lipperhey Spider MJ12bot
Litemage_walker MSFrontPage
Lmspider Mail.RU_Bot
Ltx71
MIDown tool
MIIxpc
MSIECrawler
MTRobot
Mag-Net
Majestic SEO
Majestic-SEO
Majestic12 Majestic12
MarkMonitor MarkWatch
Masscan
MauiBot MauiBot
MeanPath Bot
Meanpathbot Meanpathbot
Metauri MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
Microsoft URL Control Minefield
MolokaiBot Mister PiX
Morfeus Fucking Scanner Moblie Safari
Mozlila Mojeek
Mr.4x3 Mojolicious
Msrabot
Musobot Musobot
NPbot Name Intelligence
Nameprotect
Navroad
Needle Needle
Nessus Nessus
NetLyzer NetLyzer
Netcraft NetSpider
NimbleCrawler NetZIP
Not Nettrack
Nibbler
Nuclei
Nutch
Offline Navigator
OutclicksBot OutclicksBot
OutfoxBot
PECL::HTTP PECL::HTTP
PHPCrawl POE-Component-Client-HTTP
PageAnalyzer
PageScorer PageScorer
Papa Foto PageThing.com
Pavuk Pandalytics
Petalbot Petalbot
Picscout
Picsearch Picsearch
Pixray PictureFinder
Pockey Pockey
ProWebWalker Psbot
Pu_iN Pu_iN
Pump PxBroker
PyCurl RSSingBot
RankActive RankActiveLinkBot
RankFlex RankingBot2
Rankivabot RealDownload
Recorder Recorder
RepoMonkey RocketCrawler
Ripper
Rogerbot
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler SalesIntelligent
SISTRIX ScanAlert
ScoutJet ScoutJet
Scrapy
Screaming
Searchestate Searchestate
SemanticJuice Semrush
SentiBot SemrushBot
SeoSiteCheckup SeoSiteCheckup
Shodan Seomoz
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteLockSpider SiteSucker
Snake Siteimprove
SocialRankIOBot SlySearch
Snapbot
Snoopy
Sociscraper Sociscraper
Sogou web spider Sosospider
Sottopop Sottopop
SpankBot Spanner
Spbot
Sqlmap
Sqlworm
Sucuri Sucuri
SuperBot SuperHTTP
SurveyBot Surfbot
Szukacz Suzuran
T8Abot
TeleportPro TeleportPro
Telesoft
Telesphoreo Telesphoreo
Telesphorep
TheNomad TheNomad
Thumbor TightTwatBot
True_Robot Toweyabot
Turingos Tracemyfile
Turnitin
TurnitinBot
TwengaBot TwengaBot
Twice Twice
Typhoeus URLy Warning
Upflow URLy.Warning
VB Project V-BOT
Vacuum VeriCiteCrawler
VelenPublicWebCrawler
VoidEYE VoidEYE
WWW-Collector-E Voil
WWW::Mechanize Voltron
Wallpapers WBSearchBot
Web Auto WPScan
Web Collage WWW-Mechanize
Web Enhancer
Web Fetch Web Fetch
Web Fuck Web Pix
Web Sauger
Web Sucker Web Sucker
WebAuto WebCopier
WebFetch WebFetch
WebReaper WebGo IS
WebLeacher
WebPix
WebSauger WebSauger
WebZIP WebmasterWorldForumBot
Webshag WebsiteQuester
WebsiteExtractor Webster
Whack
Whacker
Whatweb
WiseGuys Robot
Wonderbot
Wprecon Wprecon
Zeus Zauba
Zitebot Zitebot
ZmEu
ZoominfoBot ZoominfoBot
ZyBorg
adscanner adscanner
arquivo.pt arquivo-web-crawler
backlink-check backlink-check
cah.io.community cah.io.community
cognitiveseo check1.exe
crawler4j clark-crawler
dataforseo.com coccocbot-web
evc-batch crawl.sogou.com
facebookscraper crawler.feedback
heritrix demandbase-bot
lwp-trivial eCatch
magpie-crawler instabid
isitwp.com
muhstik-scan
netEstate NE Crawler
page scorer page scorer
plumanalytics plumanalytics
polaris version probe-image-size
scalaj-http s1z.ru
scan.lol satoristudio.net
seobility
seocompany.store
seoscanners seoscanners
seostar
serpstatbot serpstatbot
sexsearcher siteripz
sitechecker.pro
sp_auditbot
sysscan
tAkeOut tAkeOut
trendiction.de trendiction.de
ubermetrics-technologies.com voyagerx.com
webgains-bot
webpros.com webpros.com
x09Mozilla x09Mozilla
x22Mozilla
xpymep1.exe xpymep1.exe
zauba.io
zgrab zgrab

300
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 01h4x.com
404enemy 404enemy
80legs 80legs
ADmantX
ALittle Client
Abonti Abonti
Acunetix Acunetix
AiHitBot Alexibot
Anarchie Anarchy
Ankit Apexoo
Aspiegel Atomseobot
Attach AwarioSmartBot
AwarioRssBot
BBBike
BLEXBot BLEXBot
BackWeb BackStreet
Battleztar Bazinga Battleztar Bazinga
BetaBot BetaBot
Bigfoot
BlackWidow
Blackboard
BlowFish BlowFish
Bolt
BotALot
Brandwatch Brandwatch
Buck Buck
Buddy
Bullseye
BunnySlippers BunnySlippers
BuzzSumo CCBot
CODE87
CensysInspect CensysInspect
CheeseBot CheeseBot
ChinaClaw ChinaClaw
Citoid Chlooe
Cliqzbot Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Copyscape Copyscape
Craftbot
CrazyWebCrawler
Crescent Crescent
CrunchBot
Curious
Custo
DBLBot DBLBot
DSearch DSearch
DTS Agent DataCha0s
DatabaseDriverMysqli Devil
Deusu
Digincore Digincore
DigitalPebble DigitalPebble
Dirbuster Dispatch
Disco DittoSpyder
Discobot
DnBCrawler-Analytics DnBCrawler-Analytics
DomainSigmaCrawler DomCopBot
DomainAppender
DomainCrawler
Domains Project Domains Project
Dotbot
Dragonfly Dragonfly
EasyDL ECCP/1.0
Ebingbong
Ecxi Ecxi
Evil EroCrawler
Exabot ExtLinksBot
Extractor
ExtractorPro ExtractorPro
FHscan FHscan
FemtosearchBot Flunky
Firefox/7.0
FlashGet
Freeuploader Freeuploader
GT::WWW FrontPage
GalaxyBot Fuzz
FyberSpider
Genieo Genieo
GetRight GetRight
Getintent
Gigabot Gigabot
HTMLparser Go!Zilla
HTTP::Lite GoZilla
GrabNet
GrapeFX
GrapeshotCrawler
HMView
HTTrack
Havij
Hloader
HonoluluBot
HybridBot
IDBTE4M IDBTE4M
IRLbot
Iblog Iblog
Image Fetch
Image Sucker Image Sucker
Indy Library
InfoTekies InfoTekies
InterGET Internet Ninja
InternetSeer
Iskanie
IstellaBot IstellaBot
Jbrofuzz Jbrofuzz
Jetty JetCar
JikeSpider JikeSpider
Jorgee
JustView JustView
Jyxobot Jyxobot
Kenjin Spider
Kinza
Kozmosbot
LWP::Simple LWP::Simple
Leap Larbin
LeechFTP LeechFTP
LexiBot LeechGet
Lftp Lftp
LieBaoFast LibWeb
Lightspeedsystems
Likse Likse
Linkbot
LinkextractorPro
LinkpadBot LinkpadBot
LinksManager LinksManager
Litemage_walker LinqiaRSSBot
Lmspider MIDown tool
MIIxpc Majestic-SEO
MJ12bot
MQQBrowser
Majestic SEO
Majestic12
MarkMonitor MarkMonitor
MarkWatch MarkWatch
Mass Downloader
MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Metauri Metauri
MicroMessenger
Microsoft Data Access Microsoft Data Access
Mister PiX Microsoft URL Control
Mojolicious Moblie Safari
Mozlila MolokaiBot
Nameprotect NICErsPRO
NearSite Navroad
Needle
Net Vampire
NetLyzer NetLyzer
NextGenSearchBot NetZIP
Netcraft
Nibbler
Nikto Nikto
NimbleCrawler Offline Explorer
Nimbostratus
Nuclei
OpenVAS
Openvas Openvas
OutclicksBot OutfoxBot
PHPCrawl
Page Analyzer Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com PageThing.com
Pandalytics Pandalytics
Pavuk Panscient
PeoplePal PeoplePal
Piepmatz Picscout
Pimonster Pimonster
Pixray
PleaseCrawl
Pockey
ProPowerBot ProPowerBot
Probethenet Probethenet
Pu_iN
Pump Pump
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex RankFlex
RankingBot RankingBot
RankingBot2 RankurBot
Re-re
RealDownload
RebelMouse
Recorder Recorder
Ripper RepoMonkey
SEOkicks-Robot Rogerbot
SEOstats SBIder
SISTRIX SEOlyticsCrawler
SMTBot SEOprofiler
ScreenerBot Scanbot
Scrapy
ScrepyBot
SearchmetricsBot SearchmetricsBot
SemanticJuice SemanticJuice
Semrush SemrushBot
SentiBot
Seomoz
Shodan Shodan
Siphon Siphon
Site Sucker Site Sucker
SiteSnagger SiteExplorer
Snapbot Sitebeam
SlySearch
Snoopy
SocialRankIOBot
Sociscraper Sociscraper
Sosospider Sogou web spider
SpaceBison SpaceBison
SpankBot Spammen
Spanner Spanner
Spbot Sqlmap
Sqlworm Stripper
Sucker Sucker
SuperHTTP SuperHTTP
Surfbot Surfbot
Suzuran SurveyBot
T8Abot Szukacz
Teleport T0PHackTeam
Telesoft Telesoft
Telesphorep Telesphorep
The Intraformant The Intraformant
Thumbor
TightTwatBot TightTwatBot
Toata
Toweyabot Toweyabot
Trendiction Tracemyfile
True_Robot Trendictionbot
Turingos
Turnitin Turnitin
TurnitinBot
TwengaBot
Twice Twice
URLy.Warning UnisterBot
V-BOT
VB Project
Vacuum
Vagabondo Vagabondo
VidibleScraper
Virusdie
VoidEYE
Voil Voil
WISENutbot WWW-Mechanize
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE WWWOFFLE
Wallpapers WeSEE
WebBandit Web Collage
WebCollage Web Enhancer
WebFetch Web Fetch
WebImageCollector Web Pix
WebLeacher WebAuto
WebCopier
WebFuck
WebGo IS
WebPix
WebReaper
WebSauger WebSauger
WebSucker WebStripper
WebWhacker
WebZIP WebZIP
Webalta
WebmasterWorldForumBot
Webshag Webshag
WebsiteExtractor Whatweb
Whacker Who.is Bot
WinHTTrack Wonderbot
WiseGuys Robot
Wotbox Wotbox
Xenu Xaldon WebSpider
YoudaoBot Xaldon_WebSpider
Zermelo Zauba
Zeus Zitebot
ZoomBot ZmEu
ZyBorg ZyBorg
adscanner
archive.org_bot archive.org_bot
com.plumanalytics cognitiveseo
crawler4j crawl.sogou.com
dataforseo.com demandbase-bot
domainsproject.org
eCatch eCatch
evc-batch heritrix
internetVista monitor internetVista monitor
ips-agent iubenda-radar
lwp-request
lwp-trivial lwp-trivial
muhstik-scan
oBot oBot
pcBrowser plumanalytics
polaris version
probe-image-size probe-image-size
satoristudio.net s1z.ru
seobility scalaj-http
seostar scan.lol
sexsearcher sexsearcher
sitechecker.pro tAkeOut
siteripz
sysscan
trendiction.de trendiction.de
ubermetrics-technologies.com
webgains-bot
x09Mozilla x09Mozilla
x22Mozilla x22Mozilla
zauba.io xpymep1.exe
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
customerguru.in acmebtn.ml
golden-catalog.pro amazingninja.com
ixora.pro cenokos.ru
job.icivil.ir esnm.ru
mega-polis.biz.ua forex.osobye.ru
nomuos.it gallery.rennlist.com
picturesify.com kambasoft.com
shop-electron.ru mirtorrent.net
unblocksit.es vozbujdenie.com
vereo.eu zskdla.site

938
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00author.com 100searchengines.com
03p.info 14b.info
1001desert.com 1bet.com
101raccoon.ru 2000k.ru
1hwy.com 202ch.com
1qingdao.com 5000-cotydzien.com
21h2o.com 777-club.ru
4kplayer.pl 83net.jp
4rent.ru
5kstore.com
7xc4n.com
8kisses.eu
9med.net 9med.net
aac500b7a15b2646968f6bd8c6305869d7.com a.frcls.fr
aac52006ec82a24e08b665f4db2b5013f7.com abcguru.xyz
actionnooz.com abusora.com
adsland.men acads.net
agysya.ru accessoires-mode.in
ahrntal.verymes.xyz adloads.com
alborzan.com admanaerofoil.com
alert.scansafe.net admitad.com
alkoravto.ru adsref.men
allnews24.in adtology.com
alta-realestate.com adverster.com
altamayoztourism.com adzerg.com
am-se.com ahrefs.com
amanda-porn.ga airlandsea.info
ampower.me aktobe.xkaz.org
ananumous.ru albumsuper.info
apartment.ru albuteroli.com
apiallgeniusinfo-a.akamaihd.net allmarketsnewdayli.gdn
apidigidocketnet-a.akamaihd.net allnews.md
appiq.mobi allproblog.com
applyneedy.xyz allwomen.info
appsecurityr.com apessay.com
ardimobileinfo.ml apibetweenlinesn-a.akamaihd.net
arraty.altervista.org apibrowsesmartne-a.akamaihd.net
artparquet.ru apilinkswiftco-a.akamaihd.net
apimossnetinfo-a.akamaihd.net
apiwebwebgetcom-a.akamaihd.net
apple.com-webbrowsing-security.review
appleid-verification.com
applicationg29.com
arcadeplayhouse.com
ascat.porn ascat.porn
asrvrep-a.akamaihd.net atout-energie-69.com
atdedinotuho.tk auto-moto-elektronika.cz
australia-opening-times.com autobudpostach.club
autobrennero.it
avkzarabotok.info
avramstroy.ru avramstroy.ru
avtochehli.by avtolombard-krasnodar.com
awaybird.ru azbukafree.com
babs.com.ua
backiee.com backiee.com
balla-boo.se baixar-musicas-gratis.com
bannerbank.ru bannertesting.com
bbtec.net bbtec.net
beauty-bracelet.com berlininsl.com
belinka.com.ua bestofpicture.com
belstaffstore.online blackle.com
bestcoin.cc blog.f00kclan.de
bestmobilityscooterstoday.com blue-square.biz
bestwebsiteawards.com bluesalt.co
bet365.com boleznikogi.com
bfz.biz boltalko.xyz
bgviagrachrx.com bongacams.com
bidr.trellian.com bosman.pluto.ro
big-boards.info brainxs.us
blogig.org brewdom.ru
bluejays-jerseys.us brianhenry.co
boazpower.com budilneg.xyz
boeuklad.com bum.com.ru
bonanza-fortune.men
brakehawk.com
bupropion-sr-150-mg.us bupropion-sr-150-mg.us
business-suggested.tk burger-imperia.com
buypuppies.ca buy-cheap-online.info
canoncdriverq3.pen.io buydissertation.net
cardsharp1.ru buzzonclick.com
cartierbraceletsreplica.pw buzzzg.men
cartierlovebraceletreplica.xyz bycontext.com
cartierwatch.xyz camel-beach.com
cashonads.com carloans.com
cdncash.net cartierlove2u.xyz
celebsopics.com cartierreplica.pw
cementaresearch.se casablancamanor.co.za
cezartabac.ro cashkitten-a.akamaihd.net
charmstroy.info cbb1smartlist12.click
chatroulette.video cctva.tv
check-this-out-now.online cfsrating.sonicwall.com
checktext.org chastnoeporno.com
chimiver.info cheapjerseysap.com
chinacheapelitejerseys.com cherrypointplace.ca
christianlouboutinsaleonline.us chinaelitecheapjerseys.com
cialis-samples.com cleanallspyware.com
cinemaflix.website clickintext.net
ciproandtizanidine.blogspot.com clickso.com
citetick.com cobaltpro.ru
citysecurity.nu commoncrawl.org
clickbanksites.info compliance-john.top
clicksor.com
clippingphotoindia.com
collegerentals.com
com-secure.download
compliance-andrew.xyz
compliance-don.xyz
compliance-george.xyz
compliance-julianna.top compliance-julianna.top
contentsexpress.com connectionstrenth.com
contextualyield.com cookielawblog.wordpress.com
coolbar.pro coolwallpapers4k.info
copyrightclaims.org copro.pw
cornerstone-countertops.com
cougfan.info
country-chic.ru country-chic.ru
courtshipgift.com cowlmash.com
cpabegins.ru crackguru.tk
cpajunkies.com cscwtalkto.site
crd.clan.su customcatchcan.com
custom-product-labels.com customerpromos-a.akamaihd.net
cyclobenzaprinevstizanidine.blogspot.com
danschawbel.com
darkbooks.org
datadepths.com datadepths.com
davebestdeals.com davebestdeals.com
dcj-nn.ru
ddsoldes.fr ddsoldes.fr
diffbot.com delitime.info
djekxa.ru deutschland123.de
dmmspy.com dieswaene.com
docs4all.com digital-video-processing.com
docsportal.net dirtpics.pw
dojki365.online dividendo.ru
domain.webkeyit.com divku.ru
downloaddy.net diy-handmade-ideas.com
downloadme.life dnepr-avtospar.com.ua
downloads-whatsapp.com documentbase.net
dprtb.com dollartree.info
dustyorate.com domaineaneblanc.com
dvd-famille.com dominterior.org
ebonyporn.site downloadeer.net
ednorxmed.com downvids.net
efnor-ac.com dstroy.su
egvar.net dverimegapolis.ru
ekn-art.se eandsgallery.com
eldiariodeguadalajara.com easync.io
elektrischezigarette1.onsugar.com edge.sharethis.com
eduinfosite.com
ee77ee.com
electricwheelchairsarea.com
electronicadirect.com
elektrischezigarette2.devhub.com elektrischezigarette2.devhub.com
elektrozigaretten1.webs.com elektroniksigaraankara.info
elmacho.xyz elektrozigarettekaufen1.devhub.com
eloxal.ru eloconcream.blogspot.com
enbersoft.com erectile.bid
engines-usa.com escortplius.com
englishdictionaryfree.com escortslet.net
esopini.com euroskat.ru
espaceinventoristes.com everflora.ru
essay-writing.work ezigarettenshop2.postbit.com
eugenevaultstorage.com family1st.ca
evehemming.blogspot.com.au fashion-mk.net
expdom.com fba-mexico.com
extrabot.com fertilitetsradgivningen.se
ezaz.info fettefrauen.net
ezigarettenshop2.myblog.de ff30236ddef1465f88547e760973d70a.com
familyholiday.ml filmci.pro
farmingworm.com filmfanatic.com
fashion.stellaconstance.co filmidivx.com
fast-wordpress-start.com fishingwholesale.us
fefo.gdn flirt4free.com
fermersovet.ru food.dtu.dk
fetroshok.ru forex-procto.ru
fighrofacciufreesig.ga foto-basa.com
find1friend.com free-social-buttons.com
finstroy.net freeseedsonline.com
firstdrugmall.ru freetangodownload.com
fivedwld.cf freewhatsappload.com
fodelsedagspresenter.nu frivgame250.com
forsex.info fuck-paid-share-buttons.xyz
fortwosmartcar.pw
forum20.smailik.org
forums.d2jsp.org
fotopop.club
fotoxxxru.com
frameimage.org
fres-news.com
fun2cell.net
fungirlsgames.net
funnypica.com
fx-brokers-review.com
fyl.com.ru
fyxabomiw.ru fyxabomiw.ru
game-mmorpg.net game300.ru
gameplexcity.com gaz-voshod.ru
garciniaxt.us ge0ip.com
generalporn.org gembird.com
generic-pills-online.com genericviagrasildenafiled.net
get-free-social-traffic.com get-your-social-buttons.info
goldandcard.ru getoutofdebtfree.org
goldpanningtools.com ghernnqr.skyrock.com
goodwriterssales.com gkvector.ru
grizzlysgrill.com glasof.es
gstatey.net go2mike.ru
guod.me goldadpremium.com
hamilton.ca goo.ne.jp
hasfun.com greatzip.com
hauleddes.com gsmlab.pl
hdxnxxtube.mobi guiadeserraazul.com
heartofbeijing.blogspot.com gyffu.com
heroz.fr hao123.com
hotblognetwork.com hetmanship.xyz
hoverboard360.at highland-homes.com
hplaserjetpdriver8y.pen.io hobbyhuren24.net
homedo.fabpage.com
homemature.net
hotdl.in
hotgirlhdwallpaper.com
houseofrose.com
hoverboard360.de
howopen.ru
hubbble.com
humanelydrew.com
iflycapetown.co.za iflycapetown.co.za
imediadesk.com ifmo.ru
ilovevitaly.ru
imgarit.pw
impisr.ru impisr.ru
import-sales.com incep.imagine-ex.co
inet-traffic.com inclk.com
innoslicon.com infazavr.ru
intelhdgraphicsgtdrive6w.metroblog.com inspiring-desperate.tk
irkutsk.zrus.org intim-uslugi.info
iron-age.info iqbazar.ru
itservicesthatworkforyou.com iqs.biz.ua
jamiembrown.com irkutsk.online-podarki.com
janettabridal.com itch.io
javatex.co.id iwanttodeliver.com
javspace.net jabimgo.pw
javxxx18.com japfm.com
jerseyssportsshop.com javlibrary.cc
jolic2.com kazan.xrus.org
jwss.cc kerei.ru
kakadu-interior.com.ua keyhantercume.com
kalandranis.gr keyword-suggestions.com
kalb.ru keywordsuggests.com
kamalsinha.com kinobest.pl
kchaxton.com kinoduh.ru
kerwinandcariza.com kinogolos.ru
kevblog.top knogg.net
keywordsdoctor.com koral.se
khafre.us koronirealestate.gr
kino-filmi.com kozhniebolezni.com
kino2018.club kreativperlen.ch
kiwi237au.tk kskjco.club
kliksaya.com kumuk.info
koptims.tiu.ru kuzinsp.ru
koversite.info kwzf.net
krafte.ru lafourmiliaire.com
kraljeva-sutjeska.com lafriore.ru
kredit-blog.ru lancheck.net
ku6.com landinez.co
kursy-ege.ru landoftracking.com
laserpen.club landscaping.center
laudit.ru laxob.com
leadn.pl lazy-z.com
lenpipet.ru lenpipet.ru
life.biz.ua lesbian.xyz
linkbolic.com liran-locks.com
live-cam6.info lirunet.ru
liver-chintai.org lkbennettoutlet.online
lizace.com lockerz.com
localmatchbook.com lodki-pvh.dp.ua
locustdesign.co lotto6888.com
lookingglassemb.com magicplayer-s.acestream.net
louboutinreplica.pw maglid.ru
m.b00kmarks.com mainlinehobby.net
m3gadownload.pl make-money-online.com
mantramusic.ru makemoneyonline.com
map028.com mamasuper.prom.ua
marketingvici.com mansiondelrio.co
marketingtechniques.info
marmotstore.online marmotstore.online
medicines-choice.com mcar.in.ua
medicovi.com mebel-ekb.com
medispainstitute.com.au mebelcomplekt.ru
megaindex.ru mediafresh.online
member-quiz.com megahdporno.net
message-warning.net memberty.com
meteostate.com mesto-x.com
minharevisao.com
mir-limuzinov.ru
mixx.com
mobioffertrck.com mobioffertrck.com
modenamebel.ru mobplayer.net
moomi-daeri.com moi-glazki.ru
moroccosurfadventures.com moje-recenze.cz
movies-in-theaters.net mole.pluto.ro
mp3downloadhq.com monclercoats.xyz
moncleroutletonline.pw
morpicert.pw
moscow-region.ru
mostantikor.ru
mototsikl.org
mountainstream.ms
mp3films.ru
msfsaar.de
mtmtv.info
mttwtrack.com mttwtrack.com
mustwineblog.com mural.co
mwtpludn.review musirc.com
mybackgroundlandscape.blogspot.com muz-shoes.ru
mydirtystuff.com mygameplus.ru
myyour.eu mypornfree.ru
negociosdasha.com myseoconsultant.com
neodownload.webcam myxdate.info
netpics.org nerudlogistik.ru
networkad.net newstaffadsshop.club
new-post.tk nibbler.silktide.com
newhairstylesformen2014.com niroo.info
nosecret.com.ua notasprensa.info
noumeda.com novosibirsk.xrus.org
novgorod.xrus.org novosti-hi-tech.ru
nvformula.ru nudepatch.net
o-dachnik.ru onko-24.com
o-o-6-o-o.com online-x.ru
o.light.d0t.ru online7777.com
obesidadealgarve.com onstrapon.purplesphere.in
obiavo.kz ontargetseo.us
odywpjtw.bloger.index.hr onthemarch.co
offtime.ru ooo-gotovie.ru
okeinfo.online owohho.com
okuos.com oyster-green.com
old-rock.com paleohub.info
olvanto.ru palocco.it
olympescort.com parlament.biz
omsk.xrus.org pavlodar.xkaz.org
online-hd.pl pcgroup.com.uy
online-podarki.com
online247.ml
onlinetvseries.me
onlyporno.ru
orel-reshka.net
ossmalta.com
ourville.info
outclicks.net
paidonlinesites.com
pandarastore.top
parajumpersjakkesalgnorge.info
partner-pop.men
parvezmia.xyz
pcimforum.com
penisvergrotendepillennl.ovh penisvergrotendepillennl.ovh
petedrummond.com perfectplanned.com
picswe.com perosan.com
plastweb.ru pertlocogasilk.tk
photo-clip.ru
picsforkeywordsuggestion.com
pinkduck.ga
piratecams.com
pizda.lol
pk-pomosch.ru
pladform.ru
play-movie.pl
playlott.com
pojdelo.weebly.com
popserve.adscpm.net popserve.adscpm.net
poptool.net pornhub-forum.ga
popugauka.ru pornobrazzers.biz
porno-raskazy.ru pornokorol.com
pornohd1080.online pornstartits.xblog.in
pornzone.tv pourvous.info
portside.xyz pp-budpostach.com.ua
poshiv-chehol.ru prize44.com
posible.net prodess.ru
powenlite24.ru proekt-gaz.ru
praisong.net professionalwritingservices15.blogspot.ru
pro-okis.ru prointer.net.ua
prospekt-st.ru promoforum.ru
psvita.ru prosperent.com
pulseonclick.com prostitutki-belgoroda.org
purplesphere.in pufip.com
puteshestvennik.com pyrodesigns.com.au
qwesa.ru quality-traffic.com
rainbowice.ru quelle.ru
randalljhoward.com quickbuck.com
rating-casino2021.ru quickcashlimited.com
refads.pro ranksonic.com
relax.ru rczhan.com
renecaovillasale.online realtytimes.com
rent2spb.ru redirectingat.com
rentehno.ru reeyanaturopathy.com
resellerclub.com referencemoi.com
rethinkwasteni.info regdefense.com
riralmolamsaca.tk respublica-otel.ru
rubbed.us restaurantlescampi.com
rutor.vip revistaindustria.com
samara.rosfirm.ru rff-cfal.info
savememoney.co.za rfid-locker.co
rniaeba.ga
rogervivierforsale.com
rosbalt.com.ua
rusvideos.su
sabizonline.com
sanatorrii.ru
santasgift.ml
sardinie.us
sashagreyblog.ga
savefrom.com
savingsslider-a.akamaihd.net
sbf441.com
sbprabooks.com sbprabooks.com
sc-specialhost.com scmor.ilxc.cc
scanner-elena.top scoopquest.com
scanner-jessica.top seeresultshub-a.akamaihd.net
schalke04fc.info seminarykansas904.ml
sdelai-prosto.ru seoexperimenty.ru
searchkut.com serdcenebolit.com
seksvideoonlain.com sergiorossistore.online
seorank.info sexkrasivo.net
servethis.com sexreliz.com
sevenstars7.com
sex-pr.net
sex-tracker.com
sexsearch.com
sextracker.be
sextracker.com
shama-rc.net shama-rc.net
sharebutton.net sibtest.ru
shiksabd.com simple-share-buttons.com
shohanb.com sims-sims.ru
sierraapps.com
signal03.ru
simple-image.com.ua
sispe.com.br sispe.com.br
sitevalued.com skylta.com
skytraf.xyz
slavia.info
slimcdn.com
sneakyboy.com sneakyboy.com
soc-econom-problems.ru social-vestnik.ru
socas.pluto.ro socialbutton.xyz
socialbuttons.xyz socialmediasuggest.com
solmarket.by solinf.co
soserfis.com spywarespy.com
souvenir.cc
sovetogorod.ru
spb-plitka.ru
spin2016.cf
spl63.fr
spywarebegone.com
sribno.net sribno.net
steebook.com sstroy44.ru
storehouse.ua stop-zavisimost.com
stroydetali.ru suchenindeutschland.com
studworks.org superiends.org
styro.ru supers.com.ua
sucsesofinspiration.com survival.betteroffers.review
suggest-keywords.com suture.co
supermesta.ru syndicate.fun
supervesti.ru tabakur77.com
suralink.com takeprofitsystem.com
svtrd.com tdsing.ru
tagil.zrus.org tedxrj.com
tam-gde-more.ru telefonsex-ohne0900.net
tattomedia.com template-kid.com
the-usa-games.blogspot.com testbotprocessor44.com
thebluffs.com thaisamkok.com
thefds.net thecoral.com.br
thegalerie.eu thegioixekhach.com
theporndude.com theheroes.ru
tilido.com themestotal.com
timdreby.com thewebsitetemplate.info
timer4web.com thewomenlife.com
tizanidineformigraines.blogspot.com tizanidinedosage.blogspot.com
tizanidinehydrochloride2mg.blogspot.com tizanidinepills.blogspot.com
tizanidinenarcotic.blogspot.com tnaionline.org
tk-assortiment.ru toloka.hurtom.com
tksn.ru
todohr.com
tongkatmadura.info tongkatmadura.info
toondinsey.com torrentgamer.net
top-deal.com.pl touchmods.fr
top10registrycleaners.com trackmedia101.com
topanasex.com tracksurf.daooda.com
totu.us traffic2money.com
tour-line.net
track112.site
traffpartners.com traffpartners.com
trailer.cinemaflix.website tramadolandtizanidine.blogspot.com
trainoffend.ml triplepanda.xyz
trustaffs.com tuberkulezanet.ru
tuckpointingmasonrysystems.com tubo360.com
tv-spoty.info tupper-shop.ru
typimga.pw turizmus.us
tzritel.tk udayavani.com
ublaze.ru umityangin.net
uginekologa.com
uhodzalijami.ru
ukrtextbook.com
ukrtvir.com.ua
unblocksit.es unblocksit.es
unece.org unrealcommander.org
urccvfmc.bloger.index.hr url2image.com
utrolive.ru urlopener.com
vadimkravtcov.ru v24s.net
vandrie-ict.nl v720hd.ru
vasileostrovsky-rayon.ru vancleefreplica.pw
vegascosmetics.ru vbikse.com
viagra.pp.ua vduplo.ru
viven.host.sk via-energy-order.com
vkontaktemusic.ru viagraneggrx.com
vksex.ru videojam.tv
vykupavto-krasnodar.ru videokrik.net
vzglyadriv.kg vipps.com.my
w3javascript.com vitalads.net
wallpaperaccess.com vrotike.ru
wdrake.com vzubah.com
websiteaccountant.de waysbetter.cn
websitevaluebot.com wcb.su
weclipart.com webads.co.nz
wesharepics.com webcamdevochka.com
whipme.yopoint.in webenlace.com.ar
wholesalejerseychinaoutlet.com weboptimizes.com
wineration.com website-analyzer.info
word-vorlagen.net website-audit.com.ua
wordpress-crew.net wfb.hatedriveapart.com
world-mmo.com while.cheapwebsitehoster.com
ws.ampower.me whiteelephantwellington.com
x69ty.ru windowssearch-exp.com
xingzi-vision.com wma-x.com
xlolitka.com woman-orgasm.ru
xn----7sbho2agebbhlivy.xn--p1ai wonderfulflowers.biz
xn----7sbifcamovvfggw9d.xn--p1ai works.if.ua
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai worldinternetauthority.com
xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai worldoffiles.ru
xn--80aikhbrhr.net writingservices17.blogspot.ru
xn--b1ag5cfn.xn--p1ai wrona.it
wufak.com
www.bookmaker-bets.com
www.event-tracking.com
www.get-free-traffic-now.com
www.pinnacle-bets.com
x-musics.com
xcc24.pl
xev.ru
xfire.com
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xn--c1acygb.xn--p1ai
xn--d1abj0abs9d.in.ua xn--d1abj0abs9d.in.ua
xwatt.ru xn--e1aggki3c.xn--80adxhks
xxxkaz.org xportvusbdriver8i.snack.ws
yebocasino.co.za xsion.net
yellowads.men xvideospornoru.com
yes-com.com yaderenergy.ru
youbloodyripper.com yougotanewdomain.com
yougame.biz yoursearch.me
youjizz.vc youtubedownload.org
youporn-ru.com yuweng.info
yourothersite.com za-music.mymobiplanet.com
zeroredirect5.com zahvat.ru
zirondelli.it zaimite.ru
zkjovpdgxivg.ga zaloadi.ru
zetmaster.ru
znakomstvaonlain.ru
znaniyapolza.ru
zona-aqua.ru zona-aqua.ru
zoogdiesney.com
zoogdinsney.com
zrelaya.pw
zscaler.net
zx6.ru

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
12u.info 03p.info
202ch.com 1000n1.ru
256bit.by 13tabs.com
2drittel.de 4kepics.com
6128786.com 57883.net
aa14ab57a3339c4064bd9ae6fad7495b5f.com 7yue.org
abcguru.xyz a.frcls.fr
absolute-s.ru accessoires-mode.in
activecampaign.dreamhosters.com actionnooz.com
adrenalin-stk.ru adimmix.com
agahinameh.com ahrntal.verymes.xyz
agapovdg.ru akita.kz
akama.com akusherok.ru
alborzan.com all-streaming-media.com
alf-img.com anal-acrobats.hol.es
all4invest.ru android4fun.org
animali.deagostinipassion.it animali.deagostinipassion.it
animebox.com.ua anlimebel.kiev.ua
apelsinnik.website ascat.porn
apiallgeniusinfo-a.akamaihd.net atmovs.com
apparel-offer.com audiobangout.com
atmagroup.ru auto4style.ru
autoloans.com autobrennero.it
babieca.com autogrep.ru
avek.ru
aversis.net
axbocz.net
babyguns.ru babyguns.ru
backgroundpictures.net bedandbreakfast.com
beachdriveblog.com bestcoin.cc
becuo.com bestpornuha.com
bestmarriages.com bet365.com
bestmobilityscooterstoday.com bezlimitko.xyz
betteroffers.review bimmerpost.com
bezcmexa.ru bioinnovate.co
bg6s0.com bolezniorganov.ru
bidbuy.co.kr bongacams.com
biznesluxe.ru boole.onlinewebshop.net
blackbabesporn.com bouda.kvalitne.cz
boobsimge.com brainsandeggs.blogspot.com
break-the-chains.com brandimensions.com
bvlgaribracelet.xyz brk-rti.ru
cam-kontakte.org brokergid.ru
cayado.snn.gr builtwith.com
ceotrk.com butstrap.space
chatroulette.world buyclomidonlaine.com
clayvasedesigns.tk buytizanidineonlinenoprescription.blogspot.com
comissionka.net carson.getenjoyment.net
compliance-andrew.xyz cascadelink.org
compliance-john.top cb.iphantom.com
computernetworksonline.com ccbill.com
daydream-studio.ru cdncash.com
design-lands.ru checkpagerank.net
dividendo.ru cialis-samples.com
divisioncore.com cialischmrx.com
dostavimvdom.ru cialiswithoutadoctor.net
dosugrostov.site compliance-ivan.xyz
downloaddy.net compliance-josh.top
compliance-julia.top
compliance-julianna.top
cosmeticswomens-womensports.rhcloud.com
counter.bloke.com
creams.makeforum.eu
dafatiri.com
damedingel.ya.ru
degerlund.net
detmebel.su
dfwu1013.info
dimaka.info
dinosaurus.site
divku.ru
docsportal.net
dosug-lux.ru
dotnetdotcom.org
download-of-the-warez.blogspot.com
droidlook.net
e-biznes.info e-biznes.info
econom.co ec-file.info
ecookna.com.ua ee77ee.com
elektrischezigarette2.onsugar.com electro-prom.com
elektrozigarettekaufen2.blogse.nl elektrozigaretten1.postbit.com
elstal.com.pl elitepcgames.com
enge-fotzen.info elvenmachine.com
enpolis.ru eu-cookie-law.blogspot.com
epngo.bz executehosting.com
essayservicewriting.org fbdownloader.com
evening-dating-club.info fellowshipoftheminds.com
exportshop.us flavors.me
fil.ru footballfarrago.com
fix-website-errors.com freelinkbuilding.website.tk
foxinsocks.ru fuck-paid-share-buttons.xyz
free-share-buttons.com ge0ip.net
freeuploader.ml ghostvisitor.com
freewebs.com greenzaim.ru
fres-news.com growshop.es
gavuer.ru grtyi.com
gilsonchiro.xyz gsasearchenginerankerdiscount.com
gk-atlant.info guildebzh.info
goldandcard.ru h2monline.com
goldenggames.com hdwalls.xyz
gsmlab.pl hermesreplica.pw
hao123.com highspeed5.net
hdhc.ru hotelcrocenzi.sm
hdxnxxtube.mobi hully.altervista.org
hermesbelts.xyz hunterboots.online
hermesbracelets.xyz husky-shop.cz
herokuapp.com ibb.com.ua
heroz.fr infodocsportal.com
hosting-tracker.com intellekt21.ru
hotcore.info irkutsk.zrus.org
howtowhitenteethfast.xyz ispaniya-costa-blanca.ru
ibmdatamanagement.co istmira.ru
igadgetsworld.com job.icivil.ir
ikearugs.xyz
ilbe.club
images-graphics-pics.com
inbabes.sexushost.com
infoupdate.org
intervsem.ru
iptool.xyz
janerikholst.se
javidol.site
jerseywholesalebizchina.com
jumptap.com
jurajskie.info
kabbalah-red-bracelets.com kabbalah-red-bracelets.com
kellyonline.xyz kambasoft.com
kino-filmi.com kerei.ru
kinoplen.ru ketrzyn.pl
kit-opt.ru kfon.eu
kometars.xyz kinky-fetishes.com
kvartir-remont.biz kinoduh.ru
lacapilla.info kinofak.net
lashstudia.ru kol-energo.ru
linkbux.ru lacloop.info
lancheck.net
letsrepair.in
lider-zhaluzi.kiev.ua
light.ifmo.ru
lineshops.biz
linkdebrideur.xyz
liumimgx.pw
livejasmin.com
lkbennettoutlet.online
lmrauction.com
longlifelomilomi.info
louboutinreplica.xyz louboutinreplica.xyz
mafa-free.com mabdoola.blogspot.com
magicalfind-a.akamaihd.net magda-gadalka.ru
makedo.ru mainlinehobby.net
mansiondelrio.co map028.com
manualterap.roleforum.ru mararoom.ru
mathgym.com.au maximpartnerspr.com
medicovi.com me-ke.com
megaindex.ru meendo-free-traffic.ga
mesto-x.com mesto-x.com
mindeyegames.com mixtapetorrent.com
minecraft-neo.ru mmgq.ru
mobifunapp.weebly.com mmstat.com
moesexy.com moscow.online-podarki.com
monclercoats.xyz motherboard.vice.com
morpicert.pw moxo.com
moz.com mp3ritm.top
mwtpludn.review muztops.ru
myftpupload.com myra.top
myxdate.info nagdak.ru
nakozhe.com nailsimg.com
nibbler.silktide.com naturtreenspicerx.pw
no-fuel.org news-speaker.com
nsatc.net ngps1.ru
nudejapan.net nuup.info
obiavo.in o-o-8-o-o.ru
online-zaymy.ru oddamzadarmo.eu
onstrapon.purplesphere.in omoikiri-japan.ru
ooo-olni.ru onescreen.cc
openfrost.net onlinewritingjobs17.blogspot.ru
page2rss.com outshop.ru
parfusale.se panchro.co.uk
pcads.ru paparazzistudios.com.au
peugeot-club.org parvezmia.xyz
phormchina.com platesauto.com
pictures-and-images.net play-movie.pl
pila.pl poffet.net
pinsdaddy.com pons-presse.com
pinwallpaper.xyz portnoff.od.ua
piter.xrus.org powc.r.ca.d.sendibm2.com
pk-pomosch.ru
pl-vouchers.com
poiskzakona.ru
popserve.adscpm.net
porngalleries.top
pornosmola.info
prohoster.info prohoster.info
proxyradar.com prostitutki-belgoroda.org
ranksonic.info quizzitch.net
redirectme.net rank-checker.online
rapidokbrain.com
remontvsamare.su
renecaovillasale.online
respublica-otel.ru respublica-otel.ru
retreatia.com runtnc.net
russian-postindex.ru ruscoininvest.company
rusvideos.su russia-today-video.ru
sa-live.com sammlungfotos.online
saddiechoua.com satoristudio.net
sayyoethe.blogspot.co.za sbricur.com
scanner-george.top scanner-alex.top
scanner-marwin.top scanner-mary.top
scansafe.net searchkut.com
scopich.com seccioncontrabajo.com
search.1and1.com secret.xn--oogle-wmc.com
searchaddis.com
sex-dating.co sex-dating.co
sexstream.pl sex-foto.pw
sexvideo-sex.com shama-rc.net
shodanhq.com sharebutton.net
shop-electron.ru signx.info
silvermature.net siha.de
simply.net snip.tw
site-speed-check.site socas.pluto.ro
siteripz.net softxaker.ru
sitevaluation.org studiofmp.com
sizeplus.work subj.ukr-lit.com
skanninge.se swinginwithme.ru
sloopyjoes.com symphonyintegratedhealthcare.com
smstraf.ru szamponrevita.pl
social-s-ggg.xyz t-bygg.com
soft-program.com tdsing.ru
softomix.com teletype.in
souvenirua.com testbotprocessor44.com
spaceshipad.com tizanidine4mgstreetvalue.blogspot.com
speeddream.xyz tizanidineforopiatewithdrawal.blogspot.com
sports-supplements.us tizanidinehclsideeffects.blogspot.com
stromerrealty.com tizanidinemusclerelaxant.blogspot.com
surfbuyermac.com tizanidinepills.blogspot.com
svnuppsalaorebro.se tmtrck.com
swimpool.ca top10registrycleaners.com
td-33.ru topappspro.com
teesdaleflyballclub.co.uk topbestgames.com
thebestweightlosspills.ovh totu.info
thebluenoodle.com twitlinks.com
thegalerie.eu typimga.pw
theplacetoupdating.pw uggsale.online
thruport.com umaseh.com
timeallnews.ru univerfiles.com
tizanidinehcl2mg.blogspot.com vesnatehno.ru
tonerbox.kz vodkoved.ru
triplepanda.xyz
txxx.com
ugguk.online
underthesite.com
uni.me
universals.com.ua
uptime-delta.net
vacuumcleanerguru.com
vduplo.ru
viagengrarx.com
viagra.pp.ua
videochat.cafe
videogamesecrets.com
videositename.com
vipromoffers.com
virus-schutzmasken.de
vksex.ru
voloslove.ru
voluumtrk.com
vonradio.com
voronezh.xrus.org
vpnmouse.com
watracker.net
webads.co.nz webads.co.nz
weprik.ru website-speed-checker.site
wholesalejerseychinaoutlet.com withstandingheartwarming.com
wma-x.com wormix-cheats.ru
wwwadultcheck.com wrz0iuebwhp5fg.freeddns.com
x-lime.com x-diesel.biz
xtraffic.plus xcombear.ru
xz618.com xdoza.com
yebocasino.com xgftnlrt.bloger.index.hr
youbloodyripper.com xmladserver.com
zebramart.ru xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
zigarettenonlinekaufen.tumblr.com xn--80ak6aa92e.com
zigzog.ru xn--lifehacer-1rb.com
zscalertwo.net xuki.us
zvuker.net xvideosporn.biz
xxxtubesafari.com
yebocasino.co.za
yginekologa.com
youtoner.it
zocaparj.kz
zoodrawings.com
zrus.org

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,4 +1,14 @@
<!DOCTYPE html>
<html> <html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.176 0; 10.1.1.74 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2895 ### Version: V4.2022.02.2896
### Updated: Thu Feb 3 10:03:34 UTC 2022 ### Updated: Thu Feb 3 22:01:34 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2895 ### Version: V4.2022.02.2896
### Updated: Thu Feb 3 10:03:34 UTC 2022 ### Updated: Thu Feb 3 22:01:34 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##