vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 06:15:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.08.3289 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-08-14 10:09:43 +00:00
parent eaf522eef7
commit bcf46fd70a
46 changed files with 79254 additions and 79254 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3288 #### Version: V4.2022.08.3289
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3288 #### Version: V4.2022.08.3289
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.08.3288 #### Version: V4.2022.08.3289
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9772
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.08.3288 #### Version: V4.2022.08.3289
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9776
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9776
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

9776
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9776
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

9776
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

9776
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

9776
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3288 3289

9776
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

9776
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.7.73.203 0; 20.245.43.252 0;

9776
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

9776
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

9776
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

9776
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.7.73.203 0; 20.245.43.252 0;

9776
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.7.73.203 0; 20.245.43.252 0;

9776
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 1; 10.1.0.229 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Aboundex AfD-Verbotsverfahren
BuiltWith DIIbot
Humanlinks Jyxobot
NimbleCrawler MauiBot
Searchestate Seomoz
Stripper WeSEE
Web Fetch ZoomBot
YoudaoBot ZumBot
Zade archive.org_bot
polaris version x09Mozilla

290
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404checker
404enemy 404enemy
ADmantX ADmantX
Abonti Abonti
AiHitBot Aboundex
Aipbot Aboundexbot
Alexibot Alligator
AllSubmitter AlphaBot
Anarchie
Anarchy
Ankit Ankit
Attach Anthill
AwarioSmartBot Atomseobot
BBBike BLEXBot
BDCbot BacklinkCrawler
BackDoorBot Black Hole
Backlink-Ceck
Badass
Barkrowler
Battleztar Bazinga
Bitacle
BlackWidow BlackWidow
Bolt Boardreader
BotALot BotALot
Buddy Brandwatch
BuzzSumo BuiltBotTough
CATExplorador Bullseye
CODE87
CSHttp CSHttp
CazoodleBot
CensysInspect CensysInspect
CheTeam
CheeseBot
ChinaClaw ChinaClaw
Chlooe Chlooe
Claritybot Citoid
Cocolyzebot Cocolyzebot
CopyRightCheck Cogentbot
Copyscape Crescent
Craftbot
Crawling at Home Project
CrunchBot CrunchBot
CyotekWebCopy Curious
DSearch Custo
Demon Deusu
Devil Devil
Digincore Digincore
DittoSpyder Disco
DnyzBot Dispatch
DnBCrawler-Analytics
DomCopBot DomCopBot
DomainAppender DomainCrawler
DomainStatsBot DomainSigmaCrawler
Domains Project
Dotbot Dotbot
Dragonfly Drip
EMail Siphon
EMail Wolf EMail Wolf
EasyDL Ebingbong
Evil EroCrawler
Exabot Exabot
Ezooms ExtractorPro
Foobot Extreme Picture Finder
Freeuploader EyeNetIE
Fimap
Fyrebot Fyrebot
G-i-g-a-b-o-t G-i-g-a-b-o-t
GT::WWW
GermCrawler GermCrawler
Gotit Getintent
GrapeFX Gigabot
Haansoft Go-Ahead-Got-It
HaosouSpider GoZilla
Havij Grafula
Hloader GrapeshotCrawler
IDBot GridBot
HEADMasterSEO
HMView
HTMLparser
HonoluluBot
HybridBot
IRLbot IRLbot
Id-search Id-search
Image Fetch
Image Sucker Image Sucker
IndeedBot IndeedBot
InfoTekies InfoTekies
Intelliseek InterGET
InternetSeer InternetSeer
Iria Iskanie
JOC Web Spider Jetty
JennyBot
Jyxobot Jyxobot
Keybot Translation-Search-Machine Kenjin Spider
Kinza
Kozmosbot Kozmosbot
LNSpiderguy
LWP::Simple LWP::Simple
Lanshanbot Lanshanbot
Larbin
Lftp Lftp
LinkWalker LibWeb
LinksManager Lightspeedsystems
LinqiaMetadataDownloaderBot LinkScan
Linkbot
LinkextractorPro
Lipperhey Lipperhey
Ltx71 Lipperhey Spider
Litemage_walker
Lmspider
MFC_Tear_Sample MFC_Tear_Sample
MIDown tool MIDown tool
MJ12bot MIIxpc
MQQBrowser MQQBrowser
MSFrontPage MSFrontPage
MSIECrawler MSIECrawler
Mag-Net MTRobot
Majestic-SEO Mail.RU_Bot
Majestic12 Majestic12
MarkMonitor MarkMonitor
MarkWatch
Masscan Masscan
MauiBot MauiBot
Meanpathbot MeanPath Bot
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Microsoft URL Control Microsoft Data Access
Minefield Mister PiX
Moblie Safari
Mojolicious
MolokaiBot MolokaiBot
Mozlila Morfeus Fucking Scanner
Mr.4x3 Mr.4x3
Musobot Musobot
NICErsPRO NICErsPRO
Name Intelligence Nameprotect
Navroad Navroad
NearSite
Needle Needle
Nessus
NetAnts NetAnts
NetMechanic NetMechanic
NetSpider Netcraft
Netvibes Netvibes
Nibbler Nikto
NimbleCrawler Ninja
Octopus Openfind
OnCrawl Openvas
OpenLinkProfiler PHPCrawl
OpenVAS PageAnalyzer
OutclicksBot PageGrabber
OutfoxBot
PECL::HTTP
PageThing.com PageThing.com
Pandalytics
Papa Foto
Pavuk Pavuk
PictureFinder PictureFinder
Pixray Pixray
ProPowerBot Pockey
ProWebWalker Pu_iN
Probethenet PyCurl
Pump
PxBroker
Quick-Crawler Quick-Crawler
RSSingBot
RankActive RankActive
RankingBot2 RankFlex
RankurBot Reaper
Recorder Recorder
RedesScrapy RedesScrapy
Ripper Rogerbot
RocketCrawler SBIder
SEOprofiler SEOprofiler
SEOstats
SISTRIX
SMTBot SMTBot
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Screaming Screaming
ScrepyBot ScreenerBot
Searchestate
SearchmetricsBot SearchmetricsBot
Seekport
SemanticJuice
Semrush Semrush
SentiBot
SeoSiteCheckup SeoSiteCheckup
SeobilityBot SeobilityBot
Seomoz Seomoz
SiteCheckerBotCrawler
SiteLockSpider SiteLockSpider
Sitevigil SiteSucker
SmartDownload Sitebeam
Snapbot Siteimprove
Snoopy
Sociscraper Sociscraper
Sogou web spider Sosospider
Sottopop
SpaceBison SpaceBison
SpankBot
Spbot Spbot
Spinn3r
SputnikBot SputnikBot
Steeler Steeler
Stripper
SuperBot
SuperHTTP
SurveyBot SurveyBot
TheNomad Szukacz
Thumbor T0PHackTeam
Tracemyfile TeleportPro
Telesoft
Titan
Toata
Trendiction Trendiction
True_Robot
Turingos Turingos
TurnitinBot
TwengaBot TwengaBot
Twice Typhoeus
URLy Warning URLy Warning
URLy.Warning
UnisterBot UnisterBot
Upflow Vagabondo
VeriCiteCrawler VeriCiteCrawler
VidibleScraper VoidEYE
Virusdie
WASALive-Bot WASALive-Bot
WBSearchBot Web Auto
WEBDAV
Wallpapers
Wallpapers/3.0
Web Collage Web Collage
Web Sucker Web Enhancer
Web Fetch
Web Fuck
WebBandit WebBandit
WebCollage WebEnhancer
WebFetch WebFetch
WebGo IS WebFuck
WebLeacher WebImageCollector
WebSauger
WebStripper WebStripper
WebSucker WebSucker
WebWhacker
WebZIP WebZIP
WebmasterWorldForumBot Webshag
WebsiteQuester WebsiteQuester
Whack
Whatweb Whatweb
Who.is Bot
WinHTTrack WinHTTrack
WiseGuys Robot WiseGuys Robot
Xaldon WebSpider Wonderbot
Xaldon_WebSpider Woobot
Zauba Xenu
YoudaoBot
Zermelo Zermelo
Zitebot ZoominfoBot
ZoomBot ZyBorg
arquivo-web-crawler adscanner
check1.exe backlink-check
cognitiveseo cognitiveseo
crawler.feedback crawler.feedback
heritrix crawler4j
dataforseo.com
demandbase-bot
evc-batch
instabid
internetVista monitor internetVista monitor
ips-agent
isitwp.com
lwp-request lwp-request
lwp-trivial
magpie-crawler
meanpathbot meanpathbot
netEstate NE Crawler mediawords
oBot oBot
ripz plumanalytics
s1z.ru
scalaj-http
scan.lol
seocompany.store seocompany.store
seoscanners
serpstatbot serpstatbot
sexsearcher
sitechecker.pro sitechecker.pro
siteripz siteripz
sogouspider trendiction.com
sysscan
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
x09Mozilla x09Mozilla
xpymep1.exe xpymep1.exe

298
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404enemy 404checker
ALittle Client 80legs
ASPSeek
Aboundexbot Aboundexbot
AfD-Verbotsverfahren
AiHitBot AiHitBot
Alexibot AlphaBot
AllSubmitter
Anarchie Anarchie
Anthill
Aspiegel
Atomseobot Atomseobot
Attach
AwarioRssBot AwarioRssBot
BDCbot AwarioSmartBot
BackDoorBot
Backlink-Ceck Backlink-Ceck
Badass Badass
Bandit Bandit
Barkrowler Barkrowler
BatchFTP
Battleztar Bazinga Battleztar Bazinga
BotALot Bigfoot
Brandprotect Black Hole
BlackWidow
Blackboard
Brandwatch
Buck Buck
Bullseye Buddy
BuiltWith
BunnySlippers BunnySlippers
CATExplorador CCBot
Calculon CODE87
Cegbfeieh CazoodleBot
Citoid CheTeam
ChinaClaw
Claritybot
Cliqzbot Cliqzbot
Cogentbot Cloud mapping
Collector Collector
Cosmos Cosmos
Craftbot Curious
Crawling at Home Project
CrunchBot
Custo Custo
DBLBot DIIbot
DTS Agent
Devil Devil
DigitalPebble
Dirbuster Dirbuster
Discobot
Discoverybot
Dispatch Dispatch
DittoSpyder DnBCrawler-Analytics
DnyzBot
DomCopBot DomCopBot
DomainSigmaCrawler DomainStatsBot
Domains Project
Dotbot
EasyDL
Ebingbong Ebingbong
EirGrabber Evil
Express WebPictures
ExtLinksBot ExtLinksBot
Extractor ExtractorPro
Ezooms
FHscan FHscan
FemtosearchBot
Fimap Fimap
Firefox/7.0 Fuzz
Flunky
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight GetRight
Getintent Getintent
GoZilla Gigabot
Go-Ahead-Got-It
Gotit
GrabNet
Grabber Grabber
Grafula GrapeshotCrawler
GrapeFX HTTP::Lite
GridBot
HEADMasterSEO
HTTrack
Haansoft Haansoft
HaosouSpider
Harvest
Heritrix Heritrix
HonoluluBot
Humanlinks
HybridBot
IDBTE4M IDBTE4M
Iblog IDBot
Id-search
Image Fetch Image Fetch
IndeedBot IndeedBot
Indy Library InternetSeer
InfoNaviRobot Iskanie
InfoTekies
Intelliseek
InterGET
IstellaBot IstellaBot
JOC Web Spider JOC Web Spider
Jbrofuzz
JetCar JetCar
Jetty JikeSpider
Jorgee
Jyxobot Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot Kozmosbot
LNSpiderguy LNSpiderguy
Lanshanbot LeechGet
Leap Lftp
LeechFTP
LibWeb LibWeb
Libwhisker Libwhisker
Lightspeedsystems
Likse Likse
LinkWalker
LinkextractorPro LinkextractorPro
LinqiaScrapeBot LinqiaMetadataDownloaderBot
MIDown tool
MIIxpc MIIxpc
MJ12bot MSIECrawler
MTRobot Mag-Net
Majestic-SEO Majestic12
MarkMonitor
Mass Downloader
Mata Hari Mata Hari
MeanPath Bot MauiBot
Meanpathbot Mb2345Browser
MicroMessenger Mediatoolkitbot
Microsoft URL Control Mister PiX
Mojeek Moblie Safari
Mojolicious MolokaiBot
Morfeus Fucking Scanner Morfeus Fucking Scanner
Mozlila Mr.4x3
NICErsPRO
Name Intelligence
Navroad Navroad
NearSite Nessus
Net Vampire NetLyzer
NetSpider NetMechanic
NetZIP
Nettrack Nettrack
Netvibes
Nibbler Nibbler
NimbleCrawler Niki-bot
Nmap Nimbostratus
Not
Offline Navigator Offline Navigator
OpenVAS OpenVAS
OrangeBot Openfind
OrangeSpider OrangeSpider
PageGrabber Page Analyzer
PageScorer PageAnalyzer
PageThing.com
Pandalytics Pandalytics
Pi-Monster Panscient
Papa Foto
Pavuk
Petalbot
Picsearch
PictureFinder PictureFinder
Piepmatz
Pimonster Pimonster
Pixray Pixray
PleaseCrawl Pockey
QueryN Metasearch ProPowerBot
Quick-Crawler Psbot
RSSingBot Pu_iN
Pump
RankActiveLinkBot
RankingBot RankingBot
Rankivabot RankingBot2
RankurBot RankurBot
ReGet ReGet
RealDownload
Reaper Reaper
RebelMouse
RedesScrapy RedesScrapy
RocketCrawler Rogerbot
SBIder
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOstats SEOlyticsCrawler
SISTRIX SISTRIX
SalesIntelligent SMTBot
ScoutJet Scanbot
Scrapy ScreenerBot
Semrush SemanticJuice
Seomoz SemrushBot
Shodan
Siphon Siphon
SiteExplorer
SiteLockSpider SiteLockSpider
Sitebeam
Snake
Snapbot Snapbot
Snoopy Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider Sogou web spider
SpaceBison
Spammen Spammen
SputnikBot SpankBot
Steeler Sqlmap
Sqlworm
Stripper Stripper
SuperHTTP SuperHTTP
Suzuran Swiftbot
T0PHackTeam Szukacz
Teleport Telesphorep
Telesoft
Telesphoreo
TheNomad
Thumbor
Titan Titan
Toata
Toweyabot
Tracemyfile Tracemyfile
Trendiction Trendictionbot
True_Robot
Turingos Turingos
Turnitin Turnitin
TurnitinBot
Typhoeus Typhoeus
URLy.Warning
VCI VCI
Virusdie Voil
WASALive-Bot WEBDAV
WWW-Mechanize WWW-Collector-E
Wallpapers Wallpapers
Web Auto WallpapersHD
Web Collage WeSEE
Web Pix Web Fuck
Web Sauger Web Sucker
WebAuto WebAuto
WebBandit WebBandit
WebCopier
WebFetch WebFetch
WebFuck WebGo IS
WebImageCollector WebImageCollector
WebPix WebLeacher
WebStripper WebSauger
WebSucker WebSucker
WebWhacker
WebZIP
Webalta Webalta
Webshag WebmasterWorldForumBot
Website Quester Website Quester
Webster Whack
WinHTTrack Whatweb
Wonderbot Wonderbot
Woobot Woobot
Xaldon_WebSpider Xaldon_WebSpider
Xenu
YoudaoBot YoudaoBot
Zauba
Zermelo
ZmEu ZmEu
ZoomBot ZoomBot
ZyBorg ZumBot
archive.org_bot backlink-check
autoemailspider cah.io.community
check1.exe coccocbot
cognitiveseo
com.plumanalytics
crawl.sogou.com crawl.sogou.com
crawler.feedback
crawler4j crawler4j
dataforseo.com dataforseo.com
domainsproject.org eCatch
facebookscraper
heritrix heritrix
ips-agent instabid
isitwp.com internetVista monitor
iubenda-radar iubenda-radar
lwp-trivial
meanpathbot meanpathbot
netEstate NE Crawler muhstik-scan
oBot
pcBrowser
polaris version polaris version
probe-image-size probe-image-size
ripz s1z.ru
satoristudio.net
scalaj-http
scan.lol
seobility
seoscanners
seostar seostar
sogouspider
sp_auditbot sp_auditbot
spyfu tAkeOut
sysscan trendiction.com
voyagerx.com ubermetrics-technologies.com
webmeup-crawler webmeup-crawler
webprosbot webpros.com
zauba.io x09Mozilla
zgrab x22Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
apccargo.com ananumous.ru
ausmepa.org.au ednorxmed.com
azazaporn.com goodnightjournal.com
custom-electric-guitar.com hidefiles.org
dvrlists.com lexiangwan.com
exonline.info mainlinehobby.net
googst2.ru nextrent-crimea.ru
online.ktc45.ru pornofiljmi.com
rank-checker.online sex-tracker.com
taihouse.ru sofit-dmd.ru

942
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
12u.info 03e.info
1314dh.com 03p.info
1millionusd.xyz 123any.com
23kw.ru 1kinobig.ru
3rbseyes.com 1stat.ru
45en.ru 2drittel.de
4kplayer.pl 2itech.ru
4rent.ru 2kata.ru
3weekdiet.com
3xforum.ro
4k-player.pl
4kepics.com
4ureyesonly.com
5tey7463.weebly.com 5tey7463.weebly.com
5ws.dating-app.ru 7zap.com
7yue.org 883zy.com
8558l.jobs.net 98oi.ru
8kisses.eu a14download.com
a.frcls.fr aa14ab57a3339c4064bd9ae6fad7495b5f.com
aa81bf391151884adfa3dd677e41f94be1.com abcdeg.xyz
aa8780bb28a1de4eb5bff33c28a218a930.com abusora.com
aa8b68101d388c446389283820863176e7.com actices.com
activepr.ru adult-shop.com.ua
addblueoff.com.ua adultfullhd.com
adexprts.com advancedsoftwaresupport.com
adminshop.com affordablewebsitesandmobileapps.com
adsfresh.men aimayangzhi.com
adsland.men air-edem.ru
adtech.fr alert-jdh.xyz
adviceforum.info alif-ba-ta.com
advocatemsk.ru alive-ua.com
afora.ru
agadelha.com.br
ageofclones.com
ahrntal.verymes.xyz
aktivator-windows10.blogspot.com
akusherok.ru
alert.scansafe.net
alfa-medosmotr.ru
alfapro.ru
all-number.com all-number.com
alphahoverboards.com allblogroll.com
alphavisions.net allesohnegirls.net
alvtank.se allornamenti.com
angry-fermi-7633.arukascloud.io allwomen.info
animali.deagostinipassion.it anaksma.info
animalrank.com android-vsem.org
anonymous-redirect.com androids-store.com
anticrawler.org apartmentratings.com
apiluckyleapnet-a.akamaihd.net apidiamondatanet-a.akamaihd.net
apimountainbikei-a.akamaihd.net apiwoodensealcom-a.akamaihd.net
apisecretsaucebi-a.akamaihd.net arkartex.ru
apparel-offer.com arkkivoltti.net
applyneedy.xyz arquivo.pt
approvedlocal.co.za articlesdirectoryme.info
apptester.tk artpicso.com
aramaicmedia.org asiavirtualsolutions.com
artavenuegardenstudios.com asrvrep-a.akamaihd.net
asseenontvonline.ru
atout-energie-69.com atout-energie-69.com
aussie-prizes.com australia-opening-times.com
autoloans.com auto4style.ru
autorn.ru automatic-seo.com
avtochehli.by aviav.ru.com
ayodhya.co avitocars.ru
azbukadiets.ru avto-oligarh.ru
b2b-lounge.com azadnegar.com
baikaleminer.com azartmsl.com
baladur.ru bagsonsale.online
balitouroffice.com bambi.ck.ua
bashtime.ru bannerconnect.net
beachfix.co beachdriveblog.com
beauby.ru beachpics.com
beauty-clinic.ru
beauty-things.com beauty-things.com
bestadbid.com beget.tech
bestkfiledxd.cf belinvestdom.by
betterscooter.com beremenyashka.com
beztuberkuleza.ru betterhdporn.com
bif-ru.info bezcmexa.ru
binaryoptionscops.info big-boards.info
bingo8888.com bigcities.org
bitcoinpile.com bio-japan.net
bloggerads.net biocn.dx.am
bloglag.com bizru.info
bonanza-fortune.men blackplanet.com
bouda.kvalitne.cz blobar.org
brainzpod.win blog.koorg.ru
brk-rti.ru blog.remote-computer.de
brothers-smaller.ru blue-square.biz
buckspar.gq bluerobot.info
bugshoot.cn bochemit.com.ua
businescoop.men boom-celebs.com
butstrap.space braintobe.win
buybest1.biz brianhenry.co
calcularpagerank.com btnativenav.com
candypeople.se buigas.00it.com
canrole.com bupropion-sr-150-mg.us
canvas.gloverid.site buscarfoto.com
cartechnic.ru buttons-for-your-website.com
cartierreplica.xyz buydissertation.net
ceotrk.com buyviagraa.blogspot.com
certifywebsite.win buzzurl.jp
cfacarrosserie74.com bvlgaribracelet.xyz
cgi2.nintendo.co.jp californianews.cf
cheapbelstaff.online callmd5map.com
camsex.xxx-cam.webcam
cartierlovestore.com
caveavins.fr
ccjp.eu
cctva.tv
centrumcoachingu.com
cerev.info
cheapestjerseys-wholesale.com cheapestjerseys-wholesale.com
christianlouboutinsaleonline.us cheapjerseysbizwholesale.us
ci.ua cheapjerseysfootballshop.com
cinemaflix.website check-host.net
classicakuhni.ru checkhit.com
cleansearch.net christianlouboutinshoes.xyz
clodo.ru cibpenonptib.flu.cc
club-samodelkin.ru cineacademy.ru
coccoc.com clarithromycin500mg.com
com-onlinesupport.host cleanpcnow.com
compliance-alex.xyz cntravelre.com
compliance-barak.top coinsspb.com
compliance-fred.top coldfilm.ru
contentsexpress.com collegeessay19.blogspot.ru
cookielawblog.wordpress.com compiko.info
cordstrap.cc compliance-brian.xyz
cupday.com compliance-checker-7.info
customerguru.in compliance-elena.top
dailystrength.org cornomase.win
damasarenai.info cosmetic.donna7753191.ru
danschawbel.com cpabegins.ru
darkages.info cracksplanet.com
data-ox.com cypernhuset.se
datsun-do.com cyse.tk
ddospanel.com dandiyabeats.in
decorationspcs.com datract.com
dealighted.com
degerlund.net
delta-line.men delta-line.men
dengi-pod-zalog-nedvizhimosti.ru den-noch24.ru
detskie-konstruktory.ru derevesendeco.com
dev33.dioniqlabb.se deutschehobbyhuren.net
diarioaconcagua.com digital-video-processing.com
diffbot.com discountliv.com
dimkino.ru diy-handmade-ideas.com
dipstar.org djonwatch.ru
dividendo.ru
doctormakarova.ru
dogbreedspicture.net
dogoimage.com dogoimage.com
domain-submit.info downloader12.ru
dominateforex.ml doxyporno.com
domination.ml
downloads-whatsapp.com
doxysexy.com
dstroy.su dstroy.su
dumuelave.xyz e-commerce-seo.com
dyshagi.ru editmedios.com
easyshoppermac.com education-cz.ru
eduinfosite.com eets.net
elvel.com.ua ege-russian.ru
energy-ua.com ekspertmed.com
energydiet24.ru elitepcgames.com
eng-lyrics.com enskedesquashclub.se
erectile.bid enthuse.computernetworksonline.com
erotiktreff24.info envaseslotusama.com
eupornstar.info essaypro.com
europeanwatches.ru etenininrade.ga
euroskat.ru euromasterclass.ru
evrotekhservis.ru european-torches.ru
exchanges-bet.com evehemming.blogspot.com.au
eyes-on-you.ga evening-dating-club.info
facecup.top excitacion.info
fast-wordpress-start.com exmasters.com
fenoyl.batcave.net extremez.net
fetishinside.com ezigaretteshop2.mywapblog.com
fil.ru family1st.ca
finteks.ru fellowshipoftheminds.com
firesub.pl filmania-x.ru
forminecrafters.ru findsexguide.com
fortevidyoze.net fireads.men
forzeronly.com floating-share-buttons.com
foxinsocks.ru foodcrafts.website
foxweber.com forums.d2jsp.org
free-deals.faith fotoxxxru.com
freelifetimefuckbook.com franecki.net
froggytube.com franklinfire.co
gambarkatabaru.com freshdz.com
gamerextra.com freshsuperbloop.com
gamingspark.com fsalas.com
gemara.com fuckmill.com
getpopunder.com funnymama.com
gigixo.com funtoonez.com
glavprofit.ru fyxabomiw.ru
glopages.ru gameprimary.com
goforexvps.com gazobeton-p.com.ua
goosefishpost.bid generousdeal-a.akamaihd.net
getmyads24.com
girlsfuckdick.com
gnuetella.com
go2jump.org
goatse.ru
goblacked.com
gojiberriess.apishops.ru
gopixdatabase.com gopixdatabase.com
gosmeb.ru gpirate.com
greatidea.marketing greatfind-a.akamaihd.net
greenidesign.co gungamesz.com
gsasearchengineranker.pw handicapvansarea.com
habermetre.com hawaiielectriclight.com
hacktougroup.ru hdimagegallery.net
hatdc.org hdpixion.com
hchha.com healmytrauma.info
hdseriale.pl hentai-manga.porn
hermesreplica.pw herehloadibs.cf
home.myplaycity.com hermesbelts.xyz
homemature.net hit-kino.ru
hotblognetwork.com home-task.com
house.sieraddns.com hopeonthestreet.co.uk
hoverboard360.se hornymatches.com
hoztorg-opt.ru hotgirlhdwallpaper.com
hspline.com hotshoppymac.com
humanelydrew.com housekuba.org
i-service.kz hybrid.ru
ideoworld.org i4track.net
incest-ru.com ifirestarter.ru
incomekey.net iflycapetown.co.za
indetiske.ya.ru igithab.com
indiakino.net igtools.club
infodocsportal.com imagine-ex.co
informatiecentro.be imediadesk.com
infostatsvc.com immobiliaremassaro.com
intimshop-fantasy.ru imperiafilm.ru
importchinacoach-teach.com
infowarcraft.ru
insurple.com
integritylandscapeservices.com
intermesh.net
investsuccess.org
iopeninghours.co.uk iopeninghours.co.uk
iplogger.org
iplusbit.blogspot.co.za iplusbit.blogspot.co.za
iptool.xyz iqs.biz.ua
islandminingsupply.wordpress.com itag.pw
ispaniya-costa-blanca.ru itservicesthatworkforyou.com
istizanidineacontrolledsubstance.blogspot.com jaxcube.info
istizanidineanopiate.blogspot.com jumptap.com
istripper.com kakadu-interior.com.ua
j33x.com keenoutlet.online
jackwolfskinoutlet.online keki.info
johannesburgsingles.co.za keywesthideaways.co
johnnyhaley.top keyword-suggestions.com
junketjuice.blogspot.com kichenaid.ru
kanimage.com kidskunst.info
katadhin.co kinoduh.ru
kinofak.net knigonosha.net
klosetkitten.com krassh.ru
koleso24.com.ua ktotut.net
konteiner24.com lashstudia.ru
krasivoe-hd.com lifehacĸer.com
kriokomora.info linkarena.com
lacasamorett.com liquimondo.com
lafourmiliaire.com live-sexcam.tk
landmania.ru lmrauction.com
landscapebackgrounds.blogspot.com
lapitec.eu
larger.io
laulini.soclog.se
layola.biz.tc
lemon-ade.site
levaquin750mg.blogspot.com
lexaprogeneric.link
lidoradio.com
lifeinsurancekb.com
limtu.ifmo.ru
linkpulse.com
lion.playtap.us
liran-locks.com
llastbuy.ru
localflirtbuddies.com localflirtbuddies.com
loftdigital.eu longgreen.info
lol-smurfs.com lookingglassemb.com
lombardfinder.ru louisvuittonoutletstore.net
luciddiagnostics.in mackeeper-center.club
luckyshop.net.ua mackeeper-land-672695126.us-east-1.elb.amazonaws.com
lumb.co magento-crew.net
magiadinamibia.blogspot.com
magicdiet.gq magicdiet.gq
magnetic-bracelets.ru
magnetpress.sk
makemoneyonline.com makemoneyonline.com
mamasuper.prom.ua mantramusic.ru
marcogrup.com manve.info
mediaoffers.click markjaybeefractal.com
meet-flirt-dating.com masserect.com
megagrabber.ru mbiologi.ru
mebelcomplekt.ru
medicine-4u.org
megavolt.net.ua
memberty.com memberty.com
menhealed.net
mezaruk.info
mhtr.be mhtr.be
mikozstop.com middlerush-a.akamaihd.net
mindbox.co.za miniature.io
minneapoliscopiers.com minyetki.ru
mmgq.ru mirmedinfo.ru
modnie-futbolki.net mmstat.com
monsterdivx.tv mobplayer.net
moomi-daeri.com moetomnenie.com
morepoweronmac.trade moje-recenze.cz
mrbitsandbytes.com morpicert.pw
musicktab.com moscow.xrus.org
myhydros.org motherboard.vice.com
myindospace.com multgo.ru
mystats.xyz musicstock.me
myxdate.info my-floor.in.ua
naperehresti.info mycaf.it
nash-krym.info myfreemp3.eu
nelc.edu.eg mylesosibirsk.ru
newstudio.tv narkologiya-orel.ru
nikitabuch.com narkologiya-penza.ru
nomuos.it nastroyke.net
nordvpn.com navalwiki.info
o-o-6-o-o.com netallergy.ru
o.light.d0t.ru networkad.net
ochistka-stokov.ru networkcheck.xyz
oconto.ru newyorkhotelsmotels.info
omgtnc.com nibbler.silktide.com
noclegonline.info
notasprensa.info
oballergiya.ru
odywpjtw.bloger.index.hr
okayimage.com
okmedia.sk
onemantrip.com onemantrip.com
onlinetvseries.me online-hd.pl
onlyforemont.ru online-templatestore.com
ovirus.ru onlinedomains.ru
pathwhelp.org ontargetseo.us
patol01.pw orgasmatrix.com
pb-dv.ru osagonline.ru
pdfprof.com otbelivanie-zubov.com
pendelprognos.se paintingplanet.ru
pepperstyle.ru panchro.co.uk
pflexads.com partnersafe.men
photorepair.ru pearlisland.ru
phpdevops.com perfection-pleasure.ru
picturesfrom.com picanalyzer.data-ox.com
pigrafix.at picturesmania.com
pills24h.com plaff-go.ru
pipki.r.acdnpro.com play-movie.pl
piuminiita.com play.leadzupc.com
pizdopletka.club pokemon-go-play.online
pizza-tycoon.com pooleroadmedicalcentre.co.uk
playlott.com popugauka.ru
podshipniki-ntn.ru popunder.net
pogodnyyeavarii.gq porno-play.net
pogosh.com pornoinn.com
pojdelo.weebly.com posible.net
porn555.com pospr.waw.pl
porndairy.in powitania.pl
pornhub-forum.ga pozdrawleniya.ru
porno-raskazy.ru pr-ten.de
porodasobak.net
poshiv-chehol.ru
privat-girl.net
privatamateure.com privatamateure.com
prizestohandle.club
productarium.com
profitfx.online profitfx.online
projectforte.ru progress-upakovka.ru
proposal-engine.com promoheads.com
proprostatit.com promover.org
prostitutki-tyumeni.org
prpops.com prpops.com
qor360.com pwwysydh.com
questionmarque.ch rada.ru
quick-offer.com rankings-analytics.com
quickbuck.com razamicroelectronics.com
quickloanbank.com razyboard.com
rainbowice.ru registrydomainservices.com
ranksonic.org rent2spb.ru
rcpmda.ikan1080.xyz robotixix.com
rebrand.ly rome2rio.com
refererx.com romhacking.ru
remontbiz.ru royalvegascasino.com
remybutler.fr ru-dety.ru
rewardit.com rubbed.us
rff-cfal.info runofilms.ru
rfid-locker.co rusexy.xyz
rfserial.net
roofers.org.uk
royal-betting.net
rp9.ru
ruclicks.com
running-line.ru
ruscopybook.com
sad-torg.com.ua sad-torg.com.ua
sadaholding.com samara.rosfirm.ru
sarf3omlat.com satoristudio.net
sbt-aqua.ru sawin.beth.webd.pl
scanmyphones.com
scanner-brian.top scanner-brian.top
scanner-ivan.top scenarii-1-sentyabrya.uroki.org.ua
scanner-nelson.top
scansafe.net
schlampen-treffen.com
scmor.ilxc.cc scmor.ilxc.cc
searchencrypt.com scoopquest.com
seasonvar.ru scopich.com
securityallianceservices.com sdelatmebel.ru
seemoreresultshu-a.akamaihd.net search.alot.com
sel-hoz.com semrush.com
seoboxes.com semxiu.com
seoholding.com seoheap.com
serdcenebolit.com seokicks.de
service.adtech.us seotoolsagency.com
seryeznie-znakomstva.ru sevenstars7.com
sexgalleries.top sexy-pings.com
sexpornotales.com shareyards.com
sexstream.pl shitting.pro
sexvporno.ru sinel.info
sexyebonyteen.com
shtaketniki.kz
signx.info
simply.net
simul.co
site-speed-checker.site site-speed-checker.site
sitechecker.pro skuteczna-dieta.co.pl
siteexpress.co.il skypasss.com
slavic-magic.ru skyway24.ru
smallseotools.com slimcdn.com
smstraf.ru soblaznu.net
snegozaderzhatel.ru soc-econom-problems.ru
socialseet.ru softwaretrend.net
solinf.co soheavyblog.com
spabali.org sonnikforme.ru
spaceshipad.com soviet-portal.do.am
sports-supplements.us space-worry.ml
srecorder.com spbchampionat.ru
ssconstruction.co stathat.com
stair.registrydomainservices.com stickers-market.ru
starpages.net stroydetali.ru
startufa.ru surcentro.com
steebook.com surintech.ac.th
streetfooduncovered.com susanholtphotography.com
stroy-portal22.ru svarkagid.com
surgut.zrus.org taaaak.com
svetlotorg.ru tampabaywatch.org
sygraem.com taxi-v-eisk.ru
tacbelarus.ru tecnoteakviareggio.it
tarad.com testingads.pro
tasteidea.com textads.men
tds-advert005.info thebestweightlosspills.ovh
tengohydar.tk thenews-today.info
thegameriders.com timhost.ru
thewomenlife.com titslove.yopoint.in
tizanidinedosage.blogspot.com tizanidinecost.blogspot.com
tizanidinedruginteractions.blogspot.com tizanidinehcl2mg.blogspot.com
tizanidineforopiatewithdrawal.blogspot.com tizanidinevscyclobenzaprine.blogspot.com
tizanidinehcl2mgtablet.blogspot.com tmtrck.com
toonfamilies.net token-lab.org
top10-way.com topmira.com
top250movies.ru tracklead.net
torrent-newgames.com trackzapper.com
torrents-tracker.com trafficcentr.xyz
torrents.life trafficfactory.biz
tradedeals.biz trainoffend.ml
traffic-club.info treasuretrack-a.akamaihd.net
traffic100.com trudogolik.net
trafficmp.com tsyndicate.com
trafficstars.com tuberkuleznik.ru
traxdom.ru turizmus.us
trk-4.net turn-up-life.life
truck-addzilla.life twittruth.com
trucri.me twojebook.pl
tt-ipd.info twu.com.ua
turkeyreport.tk uggbootsoutletsale.us
tversvet.ru unimodemhalfduplefw.pen.io
tzritel.tk
udsgame.online
ukrtextbook.com
ultramart.biz
underthesite.com
unitygame3d.com
univerfiles.com univerfiles.com
universals.com.ua uptime.com
unlimitdocs.net uroffer.link
unrealcommander.org us-america.ru
url-extractor.xyz usadacha.net
userequip.com utiblog.fr
usswrite.com vapeface.club
uytmaster.ru vashsvet.com
vektorpress.ru
venerologiya.com venerologiya.com
videochat.bz vesnatehno.com
videochat.mx vgoloveboli.net
videochat.world via-gra.webstarts.com
vipcallsgirls.com video-chat.love
visa-china.ru videojam.tv
viven.host.sk villakohlanta.nu
vkgaleria.com vipromoffers.com
vrnelectro.ru virus-respirators.com
w3javascript.com vizitki.net
wallpaperstock.net vremya.eu
watchmygf.net vrotike.ru
vtcdns.com
vvpg.ru
warningwar.ru
watch-movies.ru
waterefficiency.co
watracker.net
web-analytics.date web-analytics.date
webadvance.club web.cvut.cz
website-speed-up.top webshoppermac.com
weightatraining.com website-analyzer.info
windowssearch-exp.com website-speed-check.site
wnoz.de wechatdownload10.com
woman-h.ru whatistizanidinehclusedfor.blogspot.com
wovis.site whatsupinfoley.com
wpsecurity.website whipme.yopoint.in
www.solartek.ru wholesalejerseyscheapjerseys.us.com
wikes.20fr.com
wildnatureimages.com
worldinternetauthority.com
wrz0iuebwhp5fg.freeddns.com
ws.ampower.me
www.ehscloud.cn
www.wohnkabinen-shop.de
xblog.in
xev.ru xev.ru
xgames-04.com xgftnlrt.bloger.index.hr
xingzi-vision.com xitjw.info
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai xn----7sbho2agebbhlivy.xn--p1ai
xn----9sbebi2bvzr7h.xn--p1ai xn----btbdvdh4aafrfciljm6k.xn--p1ai
xn----itbkqkfiq.xn--p1ai xn--80ajbshivpvn2i.xn--p1ai
xn--80atua3d.xn--p1ai xn--b1addnj3cah.xn--p1ai
xn--d1acah0c.xn--p1ai xpresscare.ru
xnxx699.com yachts-cruise.info
xtube.com yellowfootprints.com
xxx-treker.ru yes-com.com
xxxtubesafari.com yourtemplatefinder.com
yottos.com youthreaders.com
youghbould.wordpress.com zahvat.ru
youjizz.com zajm-zalog-krasnodar.ru
youresponsive.com zaloro.com
yubikk.info zapiszto.pl
yun56.co zarabotat-na-sajte.ru
zarabotok--doma.ru
zazagames.org zazagames.org
zeg-distribution.com zeroredirect1.com
zeroredirect12.com zoolubimets.ru
zigarettenonlinekaufen1.bloog.pl zoosexart.com
zolotoy-lis.ru zootravel.com
zoogdisany.com zskdla.site

474
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
2x2fan.ru 101billion.com
45en.ru 1webmaster.ml
4kepics.com 3dracergames.com
72-news.com 7a2rnuey1tw9ar.ru
7wind.ru 999webdesign.com
DomainStatsBot abctoppictures.net
aab94f698f36684c5a852a2ef272e031bb.com activecampaign.dreamhosters.com
aac52006ec82a24e08b665f4db2b5013f7.com activepr.ru
adrunnr.com adf.ly
adsloads.com adnotbad.com
advancedmassagebysara.com adultmeetonline.info
ageofclones.com adzerg.com
air-edem.ru alif-ba-ta.com
alert-jdh.xyz allesohnegirls.net
anal-acrobats.com allnews.md
animal36.com ameblo.top
aosheng-tech.com amt-k.ru
architecturebest.com androids-store.com
apper.de
arcteryxstore.online
aruplighting.com aruplighting.com
asscenihotosidea.blogspot.co.za atmovs.com
autotop.com.ua azarttoto.com
aviva-limoux.com azbuka-mo.ru
azazaporn.com balkanfarma.ru
azbukafree.com baltgem.com
big-cash.net bannerbank.ru
bildsuche.ru belsetirehafi.tk
binaryoptionscops.info bestofpicture.com
bloggerads.net bigcities.org
blogrankers.com billiard-classic.com.ua
boanonihaca.tk binomo.com
brateg.xyz blackbabesporn.com
buzz-porno.info bobinoz.com
buy-meds24.com
buzzonclick.com
candcstuccoandstone.com candcstuccoandstone.com
capture-room.com
carsdined.org
cctva.tv
cdnnetwok.xyz cdnnetwok.xyz
cfsrating.sonicwall.com cherubinimobili.it
chelyabinsk.xrus.org chinaelitecheapjerseys.com
choice-credit.ru cialisndbrx.com
cialisovercounteratwalmartusa.com cognitiveseo.com
cialiswithoutadoctor.net compliance-checker-7.info
cleanersoft.com compliance-irvin.xyz
clickaider.com compliance-ivan.xyz
clubfashionista.com contextualyield.com
collegeessay19.blogspot.ru coolwallpapers-hd.com
coolyarddecorations.com customerguru.in
copypaste.traderzplanet.in dangphoto.trade
custom-electric-guitar.com decorazilla.com
customergrowthsystems.com deshevo-nedorogo.ru
cyprusbuyproperties.com divku.ru
delitime.info dollartree.info
designdevise.com drugspowerstore.com
dirtpics.pw drugstoreforyou.com
dosug-lux.ru drupa.com
downtuptv.gq dscaas.website
druzhbany.ru e-buyeasy.com
elektrischezigarettekaufen2.cowblog.fr eager-nash.188-93-233-196.plesk.page
elektronischezigarette2.mex.tl electro-prom.com
elektrozigarette2.wordpressy.pl elektrischeziga.livejournal.com
elmifarhangi.com elektronischezigarettekaufen1.beeplog.com
energydiet24.ru elektrozigarette1.dreamwidth.org
etenininrade.ga eluxer.net
event-tracking.com eredijovon.com
evidencecleanergold.com esfchat.tk
ezigarettekaufen.myblog.de falcon-images.blogspot.com
feorina.ru family1st.ca
financehint.eu fanpagerobot.com
findpik.com flauntyoursite.com
fishingwholesale.us foto-basa.com
fm-upgrade.ru fotopop.club
forums.d2jsp.org foxweber.com
free-social-buttons.xyz freenom.link
free-today.com freewebs.com
freefoto.ca freewhatsappload.com
freemags.cc fun2cell.net
freenode.info funnel.co.za
fxtips.ru funponsel.com
g.starmoe.xyz
gamezblox.com
gamingspark.com gamingspark.com
googlsucks.com gg-arena.ru
gratis-sexkontakte.com ghazel.ru
gyffu.com ghernnqr.skyrock.com
havepussy.com gktt.ru
holidaypics.org goodly.pro
hopeonthestreet.co.uk googlepositions.com
hotsocialz.com growshop.es
hoverboardforsaledirect.com guiadeserraazul.com
hreade.com handicapvantoday.com
igadgetsworld.com hasfun.com
insomniagamingfestival.com hildinghr.se
intellego.info hoste.octopis.com
intellektmedia.at hothor.se
internet-apteka.ru hoverboard360.at
iqupdatetmz.win humanelydrew.com
hystersister.com
innodgfdriverhm.aircus.com
intimshop-fantasy.ru
investpamm.ru
iqoption.pro
isitpaleo.info isitpaleo.info
istizanidinelikexanax.blogspot.com itronics.ca
istmira.ru jagg.info
istripper.com jerseychinabizwholesale.com
javlibrary.cc jerseyssportsshop.com
jovencitas.gratis jerseywholesalechinabiz.com
junketjuice.blogspot.com jo24news.com
kamorel.com jofucipiku.tk
karusel-market.ru justucalling32211123456789.tk
keki.info kadashihotel.com
kmd-pto.ru kaliningrad.zrus.org
kollesa.ru karachev-city.ru
komp-pomosch.ru koopilka.com
lalalove.ru kurwa.win
landreferat.ru kuzinsp.ru
laxdrills.com la-fa.ru
lexaprogeneric.link leadwayau.com
lifeinsurancekb.com linkbuddies.com
liky.co.ua lirunet.ru
liveinternet.ro littlecity.ch
loftdigital.eu liveu.infoteka.hu
makenahartlin.com lolnex.us
manuscript.su machicon-ueno.info
marblestyle.ru maju.bluesalt.co
mebel-ekb.com mall.uk
medispainstitute.com.au
mexicotravelnet.com mexicotravelnet.com
mobplayer.ru militarysale.pro
mp3films.ru minecraft-neo.ru
mrwhite.biz mir-limuzinov.ru
musflashtv.com misandesign.se
musicas.baixar-musicas-gratis.com mixtapetorrent.com
mydownloadengine.com mouselink.co
mrvideospornogratis.xxx
msk.afora.ru
mundoaberrante.com
muzaporn.com
myhydros.org myhydros.org
myphotopipe.com myseoconsultant.com
net-radar.com mysexpics.ru
nevansk.ru narco24.me
nfljerseyscheapbiz.us narkologiya-voronezh.ru
nina.az ngps1.ru
nuker.com notfastfood.ru
nw-servis.ru nzfilecloud.weebly.com
o-dachnik.ru one-gear.com
oconto.ru onstrapon.purplesphere.in
offer.camp osb.se11.ru
oivcvx.website outpersonals.com
oneshotdate.com paceform.com
ooomeru.ru parfusale.se
openmediasoft.com pcgroup.com.uy
openstat.com
oranga.host.sk
paphoselectricianandplumber.com
partner-stop.men
pdamods.ru
pdn-4.com pdn-4.com
pechikamini.ru pewit.pw
phuketscreen.com pixgood.com
pic-re.blogspot.com plastweb.ru
pinup-casino1.ru play.leadzupc.com
piulatte.cz playtap.us
plohaya-kreditnaya-istoriya.ru plohaya-kreditnaya-istoriya.ru
popads.net polimga.pw
pornhub-ru.com
pornofiljmi.com
pornonik.com
pornophoto.xyz pornophoto.xyz
pornoplen.com pornosemki.info
porto.abuilder.net preparevideosafesystem4unow.site
printie.com privatefx-in.ru
privat-girl.net profitsport.club
pro-tec.kz projectforte.ru
profolan.pl pts163.ru
puserving.com pulseonclick.com
puteshestvennik.com pushdata.sendpulse.com
pwwysydh.com qitt.ru
qcstrtvt.bloger.index.hr qor360.com
rebuildermedical.com radiodigital.co
rednise.com rapidokbrain.com
referencemoi.com ratemodels.net
registrysweeper.com rating-bestcasino.com
reklama1.ru refads.pro
remybutler.fr replica-watch.ru
rethinkwasteni.info roll123.com
risparmiocasa.bz.it sabaapress.com
rosbalt.com.ua saneitconsulting.com
rozalli.com savefrom.com
ruscopybook.com sbprabooks.com
rusprostitute.com scanner-jess.top
rybalka-opt.ru scanner-margo.top
saletool.ru schalke04fc.info
scenarii-1-sentyabrya.uroki.org.ua scmor.ilxc.cc
school-diplomat.ru scripted.com
sdrescher.net sdelatmebel.ru
searchinterneat-a.akamaihd.net sdi-pme.com
see-your-website-here.com se.bnt-team.com
seoprofiler.com sex-znakomstva.online
sex-tracker.de sexspornotub.com
sex-watch.com shell-pmr.ru
sexstream.pl shisha-swag.de
sharpchallenge.com sixcooler.de
silvermature.net skylta.com
siteripz.net slowmacfaster.trade
sloopyjoes.com smartshoppymac.com
slujbauborki.ru soft-program.com
small-game.com spabali.org
smartpet.ru spbchampionat.ru
social-s-iii.xyz sport7777.net
soundfrost.org sptslmtrafms.com
sstroy44.ru spy-sts.com
stats-collector.org stats-collector.org
steame.ru stillmiracle.com
strongsignal-a.akamaihd.net stop-gepatit.te.ua
subj.ukr-lit.com streetfire.net
taihouse.ru stroymonolit.su
tam-gde-more.ru swagbucks.com
taqplayer.info szamponrevita.pl
tattoo33.ru tandvardshuset.net
tech4master.com taqywu51.soup.io
technika-remont.ru
telsis.com telsis.com
thebluffs.com thebluenoodle.com
thefds.net thecounter.com
tizanidineandhydrocodone.blogspot.com theheroes.ru
tonivedu.it theprofitsmaker.net
tootoo.to tizanidine4mgprice.blogspot.com
torrent-to-magnet.com tizanidine4mgstreetprice.blogspot.com
torrentdownloadhub.com tizanidineinfo.blogspot.com
tour-line.net tuberkuleznik.ru
tracfone.com turbodsp.com
trafficmania.com turvgori.ru
tupper-posuda.ru umekana.ru
turn-up-life.life undergroundcityphoto.com
twu.com.ua usswrite.com
uginekologa.com v-doc.co
uptime-delta.net vektorpress.ru
vabasa.inwtrade.com vesnatehno.com
via-energy-cumpara.com vzlomtw.com
vids18.site weblibrary.win
visa-china.ru wemedinc.com
vitoriacabos.com westen-z.life
viven.host.sk woodyguthrie.se
vod.com.ua www.wohnkabinen-shop.de
vrnelectro.ru x-lime.net
wallpaperaccess.com xn----9sbubg3ambdfl1j.xn--p1ai
webalan.ru xn--24-glceagatoq7c2a6ioc.xn--p1ai
website-speed-check.site xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
whiteelephantwellington.com xz618.com
www.solartek.ru yebocasino.co.za
wzgyyq.com yourporn.com
xn--80atua3d.xn--p1ai zebramart.ru
xnxxandxvideos.com zeg-distribution.com
xolodremont.ru
xtubeporno.net
yourmovies.pl
zaimhelp.ru
zetmaster.ru
zigarettenonlinekaufen2.bloog.pl
zlatnajesen.com
zskdla.site zskdla.site
zvezdagedon.ru

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.44 0; 10.1.0.229 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3288 ### Version: V4.2022.08.3289
### Updated: Sat Aug 13 22:01:16 UTC 2022 ### Updated: Sun Aug 14 10:03:54 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3288 ### Version: V4.2022.08.3289
### Updated: Sat Aug 13 22:01:16 UTC 2022 ### Updated: Sun Aug 14 10:03:54 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##