vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-08 05:29:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.11.3488 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-11-23 22:07:07 +00:00
parent 78d1ec2a87
commit 497fb0a72c
46 changed files with 91567 additions and 91567 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3487 #### Version: V4.2022.11.3488
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3487 #### Version: V4.2022.11.3488
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.11.3487 #### Version: V4.2022.11.3488
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11312
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.11.3487 #### Version: V4.2022.11.3488
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11316
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11316
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11316
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11316
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

11316
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

11316
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

11316
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3487 3488

11316
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11316
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.66.34.98 0; 52.165.18.189 0;

11316
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

11316
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

11316
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

11316
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.66.34.98 0; 52.165.18.189 0;

11316
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.66.34.98 0; 52.165.18.189 0;

11316
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 1; 10.1.1.55 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Bitacle BatchFTP
GrapeshotCrawler DomainAppender
LinqiaScrapeBot Drip
Mb2345Browser InfoTekies
SEOprofiler Nameprotect
SeoSiteCheckup Screaming
Sitevigil Spanner
Teleport Whatweb
Xaldon WebSpider Zeus
com.plumanalytics ubermetrics-technologies.com

308
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
80legs 80legs
AIBOT ALittle Client
ASPSeek
Abonti
Aboundex
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
Aipbot Aipbot
AllSubmitter Alexibot
Alligator Ankit
Aspiegel Anthill
Apexoo
Asterias
AwarioRssBot AwarioRssBot
BackDoorBot BBBike
BackWeb
BacklinkCrawler BacklinkCrawler
Bandit Barkrowler
Battleztar Bazinga BetaBot
Bigfoot
Bitacle
Blow Blow
BlowFish Buddy
Bolt BuiltBotTough
BuzzSumo Bullseye
CCBot
CODE87 CODE87
CSHttp CSHttp
Calculon Cegbfeieh
Chlooe CheTeam
Cliqzbot ChinaClaw
Cloud mapping Citoid
Claritybot
Cocolyzebot
Cogentbot Cogentbot
Crawling at Home Project Copier
CopyRightCheck
Copyscape
Craftbot
CrunchBot CrunchBot
Curious Custo
DSearch
DTS Agent DTS Agent
Deusu DataCha0s
Devil Demon
Digincore Digincore
DigitalPebble DigitalPebble
Discobot Discoverybot
Dispatch
DittoSpyder DittoSpyder
DnBCrawler-Analytics DomainAppender
DomCopBot
DomainCrawler
DomainStatsBot
Dotbot Dotbot
Dragonfly Download Wonder
Drip Drip
ECCP/1.0 EMail Wolf
EMail Siphon
EasyDL
Ecxi
EirGrabber
Evil
Exabot
ExtLinksBot
Extractor Extractor
Extreme Picture Finder
EyeNetIE EyeNetIE
FemtosearchBot FemtosearchBot
Flunky Fimap
FlashGet
Freeuploader
FyberSpider FyberSpider
GT::WWW
Genieo Genieo
GetRight GetRight
Gigabot Go!Zilla
GoZilla Gotit
Grabber Grabber
Grafula Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO HEADMasterSEO
HMView HMView
HTTP::Lite HTTP::Lite
Haansoft
Harvest
Havij Havij
Hloader Humanlinks
HonoluluBot IRLbot
IDBTE4M Iblog
Image Fetch Id-search
IndeedBot
Indy Library
InfoNaviRobot InfoNaviRobot
InfoTekies
Intelliseek Intelliseek
InternetSeer InterGET
Internet Ninja
Iskanie Iskanie
JOC Web Spider IstellaBot
JamesBOT
Jbrofuzz
JennyBot JennyBot
JetCar Jetty
JikeSpider
Joomla Joomla
Jorgee Jorgee
Kenjin Spider
LNSpiderguy
Lanshanbot Lanshanbot
Larbin LeechGet
LeechFTP LibWeb
Lftp
Libwhisker
Lightspeedsystems Lightspeedsystems
Linkbot Linkbot
LinkextractorPro LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey Spider
Litemage_walker Litemage_walker
MIDown tool Lmspider
MFC_Tear_Sample
MIIxpc MIIxpc
MSIECrawler MJ12bot
Magnet MTRobot
Majestic-SEO Mag-Net
MarkMonitor
MarkWatch
Mata Hari
MauiBot MauiBot
MicroMessenger Mb2345Browser
Microsoft Data Access Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Mister PiX
Moblie Safari Moblie Safari
Morfeus Fucking Scanner Mojolicious
MolokaiBot
Musobot Musobot
NICErsPRO NICErsPRO
NPbot
Name Intelligence
Needle Needle
Nessus
NetAnts
NetLyzer
NetZIP NetZIP
Netcraft Niki-bot
Nettrack NimbleCrawler
Nmap Not
Octopus Openvas
Offline Explorer OrangeBot
Offline Navigator
OnCrawl
OpenVAS
Openfind
OrangeSpider OrangeSpider
OutfoxBot
PECL::HTTP PECL::HTTP
Page Analyzer Page Analyzer
PageAnalyzer
PageGrabber
PageScorer PageScorer
Panscient Pandalytics
Papa Foto
Pavuk
PeoplePal PeoplePal
Pimonster Picsearch
Piepmatz
Pixray Pixray
Probethenet PleaseCrawl
Pockey
Psbot
Pu_iN
PxBroker PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankActive RankActive
RankFlex
RankingBot
RankingBot2 RankingBot2
Rankivabot Rankivabot
Re-re RankurBot
RealDownload Recorder
RedesScrapy
RepoMonkey
Ripper
SBIder SBIder
SEOstats ScanAlert
SalesIntelligent Scrapy
ScoutJet ScrepyBot
Screaming Semrush
ScreenerBot SentiBot
Searchestate Siphon
SemanticJuice SiteLockSpider
SeoSiteCheckup
SeobilityBot
SiteExplorer
Siteimprove
Snake Snake
Snapbot Snapbot
Snoopy
Sociscraper Sociscraper
Sosospider Sogou web spider
Spammen
SpankBot
Spanner
Spbot Spbot
Spinn3r Spinn3r
SputnikBot SputnikBot
Sqlworm Sqworm
Stripper
Sucker Sucker
Swiftbot SurveyBot
Szukacz
Teleport Teleport
Telesoft
TightTwatBot
Titan Titan
Toweyabot
Trendiction
True_Robot
Turingos
Turnitin Turnitin
TurnitinBot TwengaBot
Twice Twice
V-BOT URLy Warning
Upflow
VB Project VB Project
VoidEYE Vacuum
Virusdie
Voil Voil
Voltron
WASALive-Bot WASALive-Bot
WISENutbot WISENutbot
WPScan WPScan
WWW-Collector-E WWW-Collector-E
WWW-Mechanize WWWOFFLE
WWW::Mechanize
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD
Web Auto Web Auto
Web Pix Web Collage
Web Enhancer
Web Fetch
Web Fuck
Web Sauger Web Sauger
WebAuto WebBandit
WebCopier
WebEnhancer WebEnhancer
WebFetch
WebFuck WebFuck
WebImageCollector
WebLeacher WebLeacher
WebStripper WebStripper
WebZIP WebSucker
WebmasterWorldForumBot WebWhacker
WebsiteQuester Website Quester
Whack Webster
Whatweb
Who.is Bot Who.is Bot
Woobot Widow
Wotbox
Wprecon
Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
Xenu
Zauba Zauba
Zermelo
Zitebot Zitebot
ZmEu
ZoomBot
ZumBot ZumBot
arquivo.pt adscanner
arquivo-web-crawler
coccocbot coccocbot
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot demandbase-bot
domainsproject.org
eCatch
evc-batch
gopher gopher
heritrix ips-agent
internetVista monitor linkdexbot
iubenda-radar
lwp-request lwp-request
lwp-trivial
magpie-crawler magpie-crawler
meanpathbot plumanalytics
muhstik-scan polaris version
netEstate NE Crawler s1z.ru
oBot satoristudio.net
pcBrowser seobility
scalaj-http
seocompany.store seocompany.store
seoscanners seoscanners
sp_auditbot seostar
sitechecker.pro
siteripz
spyfu spyfu
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
webgains-bot webgains-bot
webpros.com webmeup-crawler
webprosbot x22Mozilla
xpymep1.exe
zauba.io
zgrab zgrab

284
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404enemy 404enemy
ALittle Client ALittle Client
ASPSeek Aboundex
Aboundexbot Aboundexbot
Acunetix Acunetix
Aipbot AfD-Verbotsverfahren
Alexibot AllSubmitter
Alligator Alligator
Anarchie
Anarchy
Anarchy99 Anarchy99
Apexoo Ankit
Asterias Asterias
AwarioSmartBot
BBBike BBBike
BDCbot
BLEXBot BLEXBot
BackWeb
Backlink-Ceck Backlink-Ceck
BatchFTP BacklinkCrawler
Battleztar Bazinga Badass
Bandit
Barkrowler
BetaBot BetaBot
Black Hole Bigfoot
Blackboard
Blow
BlowFish
Bolt
BotALot BotALot
Brandprotect Brandwatch
Buddy BuiltBotTough
BuzzSumo BuzzSumo
CATExplorador
CODE87
CSHttp CSHttp
CensysInspect Calculon
CheTeam
ChinaClaw ChinaClaw
Chlooe Chlooe
Cogentbot Cocolyzebot
Collector Copier
Copyscape CopyRightCheck
Cosmos
Crawling at Home Project Crawling at Home Project
Crescent Curious
Custo Custo
DIIbot CyotekWebCopy
DataCha0s DBLBot
Digincore DSearch
DigitalPebble DatabaseDriverMysqli
Discobot Demon
Discoverybot Devil
DnBCrawler-Analytics Disco
DomCopBot Dispatch
DomainCrawler
Dotbot Dotbot
Download Wonder Ebingbong
ECCP/1.0 Ecxi
EMail Siphon
EasyDL
EirGrabber EirGrabber
EroCrawler
Evil
Exabot Exabot
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder
EyeNetIE EyeNetIE
Ezooms
FHscan FHscan
FemtosearchBot
Fimap
Firefox/7.0 Firefox/7.0
Foobot Foobot
Freeuploader
FrontPage
Fuzz Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
Genieo Genieo
GetRight
GetWeb GetWeb
Getintent Getintent
Go!Zilla Go!Zilla
Go-Ahead-Got-It
Grabber
Grafula
GrapeFX
GrapeshotCrawler GrapeshotCrawler
GridBot GridBot
HEADMasterSEO
HTMLparser HTMLparser
Harvest HaosouSpider
Havij Havij
Heritrix
HonoluluBot
Humanlinks Humanlinks
IDBTE4M IDBTE4M
IRLbot IDBot
IndeedBot Id-search
Indy Library IlseBot
InfoNaviRobot
InfoTekies InfoTekies
InterGET Intelliseek
Internet Ninja
InternetSeer InternetSeer
Iria Iskanie
JOC Web Spider
Jbrofuzz Jbrofuzz
Joomla Joomla
Jorgee Jorgee
Kenjin Spider JustView
Jyxobot
Keyword Density Keyword Density
LNSpiderguy Kinza
LWP::Simple Kozmosbot
LeechFTP Lanshanbot
LexiBot Larbin
Lftp LeechGet
LibWeb LibWeb
Libwhisker Libwhisker
LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse Likse
LinkWalker LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker Litemage_walker
MFC_Tear_Sample MIDown tool
MQQBrowser
MSIECrawler
Magnet Magnet
Mail.RU_Bot
Majestic-SEO Majestic-SEO
Masscan MarkMonitor
MeanPath Bot
Meanpathbot Meanpathbot
MegaIndex.ru MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Mister PiX Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot Msrabot
Navroad Name Intelligence
NearSite NearSite
Net Vampire Nessus
NetMechanic NetLyzer
Netcraft Netcraft
Nibbler
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap Nmap
Not
Nuclei Nuclei
Nutch
Octopus Octopus
OpenVAS OpenVAS
OrangeBot
OutclicksBot OutclicksBot
PHPCrawl PageGrabber
PageAnalyzer PageScorer
PeoplePal Pandalytics
Papa Foto
Pavuk
Petalbot Petalbot
Pi-Monster
Picscout Picscout
Picsearch Picsearch
PictureFinder PictureFinder
Piepmatz Piepmatz
Pimonster Pimonster
Pixray
Pockey
ProPowerBot ProPowerBot
Psbot ProWebWalker
Pump Pu_iN
PyCurl
QueryN Metasearch
RSSingBot RSSingBot
RankingBot RankingBot
Rankivabot Rankivabot
ReGet ReGet
RealDownload Reaper
RepoMonkey RebelMouse
Recorder
Ripper
Rogerbot
SBIder SBIder
SEOkicks SISTRIX
SMTBot Scanbot
ScoutJet ScoutJet
Scrapy Scrapy
Screaming ScrepyBot
Searchestate
Seekport
Semrush Semrush
SentiBot SentiBot
SeobilityBot SeobilityBot
Seomoz SiteExplorer
Siphon
Site Sucker
SiteLockSpider SiteLockSpider
SiteSnagger SiteSnagger
SiteSucker SiteSucker
Siteimprove Sitebeam
Sitevigil Sitevigil
SmartDownload SmartDownload
Snapbot Snapbot
Sociscraper Snoopy
Sottopop
SpankBot SpankBot
Spbot Spanner
Steeler Spinn3r
Sqlmap
Sqlworm
Stripper Stripper
Sucker Sucuri
Suzuran SuperBot
Szukacz Swiftbot
T0PHackTeam TeleportPro
Teleport Telesoft
Telesphoreo Telesphorep
The Intraformant
TheNomad TheNomad
Thumbor Trendiction
Toata Turingos
Tracemyfile TurnitinBot
UnisterBot TwengaBot
Upflow Typhoeus
VB Project URLy.Warning
Vagabondo VidibleScraper
VelenPublicWebCrawler
Virusdie Virusdie
WASALive-Bot
WEBDAV WEBDAV
WISENutbot
WPScan WPScan
WWW-Collector-E
WWW::Mechanize WWW::Mechanize
WWWOFFLE Web Auto
Wallpapers Web Enhancer
WallpapersHD Web Fetch
WeSEE
Web Fuck Web Fuck
Web Pix Web Pix
WebBandit Web Sucker
WebCollage WebImageCollector
WebEnhancer
WebGo IS
WebSauger
WebSucker
WebWhacker WebWhacker
Webalta Webalta
WebmasterWorldForumBot Webshag
Whack WebsiteQuester
Whacker Webster
Widow WinHTTrack
Wonderbot
Woobot Woobot
Wprecon Wprecon
Zeus Xaldon WebSpider
ZmEu Xenu
ZoomBot Zermelo
adscanner
arquivo-web-crawler arquivo-web-crawler
arquivo.pt arquivo.pt
cah.io.community backlink-check
clark-crawler clark-crawler
cognitiveseo cognitiveseo
crawl.sogou.com
dataforseo.com
demandbase-bot demandbase-bot
eCatch
facebookscraper facebookscraper
isitwp.com heritrix
linkdexbot lwp-request
lwp-trivial mediawords
magpie-crawler page scorer
plumanalytics polaris version
satoristudio.net s1z.ru
seobility seobility
seostar seocompany.store
siteripz
sp_auditbot sp_auditbot
tAkeOut
trendiction.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla x09Mozilla
x22Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
apisecretsaucebi-a.akamaihd.net bryansk.zrus.org
ayakino.net fr-bearings.ru
callmd5map.com online247.ml
forum69.info openfrost.net
hunterboots.online picsforkeywordsuggestion.com
jerseychinabizwholesale.us security60-e.com
microsoftportal.net sexad.net
prostitutki-rostova.org torrent-to-magnet.com
rniaeba.ga tradedeals.biz
searchinquire.com zetgie.com.pl

930
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
14b.info 08800.top
1hwy.com 1008.su
2345.com 1kinobig.ru
3rbseyes.com 4istoshop.com
4senses.co 4kepics.com
51unlim.ru 55wmz.ru
7a2rnuey1tw9ar.ru 7makemoneyonline.com
7yue.org 7zap.com
8gold.com
8kisses.eu 8kisses.eu
98oi.ru
aadroid.net
aaronabel.com aaronabel.com
abiente.ru abbanreddy.com
acc.eu.org actulite.com
acortarurl.es ad-words.ru
adelly.bg adsloads.com
ads-seo.men adtech.fr
adtech.us adult-shop.com.ua
advertex.info adult3dgames.com
affordablewebsitesandmobileapps.com adultfullhd.com
afora.ru adultwebhosting.info
agysya.ru agadelha.com.br
alert.scansafe.net aibolita.com
allesohnegirls.net aksonural.ru
allornamenti.com akuhni.by
aloofly.com alfa-img.com
aludecor.info alldubai.biz
ample-awards-today.us allpdfmags.net
ampower.me alphacarolinas.com
analytics-ads.xyz alphahoverboards.com
anaseracresar.tk alyeskaresort.com
animalia-life.club andpolice.com
aosexkontakte.net android-systems.ru
apiluckyleapnet-a.akamaihd.net angkortours.vn
apioasisspacenet-a.akamaihd.net anime.dougasouko.com
apiqualitinknet-a.akamaihd.net apartmentbay.ru
apisecretsaucebi-a.akamaihd.net apibrowsesmartne-a.akamaihd.net
apiwoodensealcom-a.akamaihd.net apifasterlightin-a.akamaihd.net
apple.com-webbrowsing-security.science apiitsthirteende-a.akamaihd.net
approved.su apishops.ru
approvedlocal.co.za
apptester.tk apptester.tk
aquarium-pro.ru arendas.net
arcadepages.com asacopaco.tk
artdeko.info asseenontv.ru
asiavirtualsolutions.com auto.rusvile.lt
asmxsatadriverin.aircus.com autobrennero.it
asscenihotosidea.blogspot.com avitocars.ru
atley.eu.pn avtovolop.ru
audiofree.ru ayanaspa.com
aviav.ru
awency.com
ayerbo.xhost.ro
azarttoto.com
azlex.uz azlex.uz
bablonow.ru backgroundpictures.net
baditri.com bambi.ck.ua
bard-real.com.ua bankmib.ru
beachfix.co bannerads.de
beachpics.com bannerswap.com
beauty-things.com beclean-nn.ru
becuo.com best-way.men
begalka.xyz bestmarriages.com
bestbrainprod.win bestmouthwash.club
bestcoin.cc betshuckclean.com
bestdraws.com bikini-image.com
bestfortraders.com binomo.kz
besthomemadepornsites.com bitcoinpile.com
bestofupload.info biteg.xyz
bestpornuha.com bizru.info
bestprofits-there.com blagovest-med.ru
betterscooter.com
bfz.biz
binaryoptionscops.info
bitnote.co
blackplanet.com
bloggedporn.com bloggedporn.com
bobba.dzaba.com bmw.afora.ru
bonky.biz boazpower.com
bongiornos.info
bradleylive.xyz
brainsandeggs.blogspot.com brainsandeggs.blogspot.com
brainzpod.win braintobe.win
bum.com.ru brokergid.ru
burkesales.com buehne-fuer-menschenrechte.de
buttons-for-your-website.com buigas.00it.com
buy-meds24.com burn-fat.ga
buzzonclick.com buyantiviralwp.com
cactussoft.biz buyk.host.sk
candiceloves.us buynorxx.com
candycrushshop.com byme.se
cannibalcheerleader.com candlewooddentalcentre.com.au
canzoni.ru cayado.snn.gr
carina-sy.de cheapjerseysbizwholesale.us
carsplate.com chidporn.com
carstrends2015.com choosecuisine.com
cartechnic.ru cialgenisrx.com
cartierlove.xyz cicaki.net
casinos4dummies.co.uk ciproandtizanidine.blogspot.com
cbozhe.com cleanallvirus.com
chelyabinsk.xrus.org cleansearch.net
chocolateslim-en-espana.com cocolyze.com
christianlouboutinsaleonline.us companies-catalog.com
cigarpass.com compliance-don.xyz
clickcash.com compliance-olga.top
clickso.com confib.ifmo.ru
club-musics.ru contentsexpress.com
compliance-elena.xyz coolbar.pro
compliance-jessica.top coprofam.org
constantaservice.net cordstrap.cc
coolwallpapers4k.info crd.clan.su
cowblog.fr crest-poloski.ru
crackguru.tk
cscwtalkto.site cscwtalkto.site
custom-product-labels.com custom-electric-guitar.com
cymbaltaandtizanidine.blogspot.com customerpromos-a.akamaihd.net
d-black.bz dailyrank.net
damasarenai.info dalavia.ru
dame-ns.kz datsun-do.com
danashop.ru deanmoore.ie
dealwifi.com digest-project.ru
demenageur.com div.as
dentfidemountpreach.tk docstoc.com
design-lands.ru dojki365.online
destinationrealestate.com domain.webkeyit.com
detalizaciya-tut.biz domainanalyzing.xyz
diamond-necklace.info dominterior.org
digilander.libero.it download-wallpaper.net
dikqlyremy.info
dimaka.info
diminishedvalueoforegon.com
dlya-android.org
dmmspy.com
dnepr-avtospar.com.ua
domainsatcost.com
domznaniy.ru
donna7753191.ru
doreenblog.online
dosugrostov.site
dotnetdotcom.org
downloadmefiranaratb1972.xpg.com.br
drev.biz
drugstoreforyou.com drugstoreforyou.com
duawitchrarato.tk eachdayisagift.review
ebooknovel.club earthmagic.info
efnor-ac.com easync.io
electricwheelchairsarea.com easyshoppermac.com
elektrischezigaretten1.blogse.nl easytuningshop.ru
elektronischezigarettekaufen1.myblog.de ebonyporn.site
elektrozigarettekaufen2.blogse.nl ecommerce-seo.org
elitedollars.com econom.co
encodable.com efkt.jp
eralph.tk ekaterinburg.xrus.org
erotikchat-24.com elitepcgames.com
evening-dating-club.info escortplius.com
expolicenciaslatam.co esnm.ru
ezb.elvenmachine.com etenininrade.ga
ezigarettenshop2.myblog.de eu-cookie-law.info
ezigaretteshop2.vefblog.net exdocsfiles.com
facecup.top eyelike.com.ua
falopicm.pw eyes-on-you.ga
familienzahnaerzte.com ezaz.info
fba-mexico.com fashion-mk.net
fbdownloader.com fashionindeed.ml
fatfasts-4tmz.com
faz99.com
fdzone.org
feeriaclub.ru
fermersovet.ru fermersovet.ru
ferretsoft.com fickluder69.com
fifa-coins.online financepoints.eu
fillmewithhappiness.com find1friend.com
fiverr.com firstsiteguide.com
forensicpsychiatry.ru flipper.top
forex.osobye.ru floridahuntingfishingadventures.com
forodvd.com fm-upgrade.ru
forpostlock.ru fortunejack.com
fototravel.eu
foxtechfpv.com foxtechfpv.com
free-fbook-traffic.com franch.info
free-share-buttons.top freakycheats.com
free-video-tool.com free-stock-illustration.com
freemaintenancesysforpcandmac.top freza-sverlo.ru
freevpn.space fullfileaccess.com
freewebs.com funnel.co.za
front.ru fxtips.ru
fun2cell.net galaxyflowers.ru
funponsel.com game-top.su
futbolkisales.ru gamedayhouse.com
gael-s.ru go2mike.ru
galeria-zdjec.com gok-kasten.net
gallery.rennlist.com goldpanningtools.com
gallerylisting.com greenzaim.ru
gamerextra.com growboxbl.ru
gamewrath.com guardlink.com
gayxperience.com gwebtools.com.br
gemara.com hackers-crackers.tk
generic-pills-online.com hatedriveapart.com
genericlowlatencyasiodriverhq.aircus.com haveinc.xyz
ghazel.ru helicalpile.us
gigapeta.com heliko.no
gktt.ru hexpilot.com
glasof.es hiwibyh.bugs3.com
glass-msk.ru homemature.net
gogps.me hotchatdate.com
googleseo.com.tr hotelcrocenzi.sm
gsasearchengineranker.xyz
guruofcasino.com
gymi.name
gz2.bbsoldes.fr
hausfrauensex18.com
hawaiisurf.com
hccoder.info
hd-film.pl
hdfreeporno.net
highspeed5.net
hledejvshopech.cz
hmmm.cz
hostsshop.ru
hotcore.info
hotloans.ru
hotshoppymac.com hotshoppymac.com
howmuchdoestizanidinecost.blogspot.com https-legalrc.biz
howtowhitenteethfast.xyz hulfingtonpost.com
ideashome.id hully.altervista.org
ie.57883.net iccornacircri.cf
iklysha.ml ido3.com
ilovevitaly.ru igadgetsworld.com
immobiliaremassaro.com incomekey.net
insurple.com inet-traffic.com
interesnie-faktu.ru infogame.name
iqs.biz.ua insta-add.pro
ixora.pro intermesh.net
jagg.info iomoio.net
javstock.com iplusbit.blogspot.co.za
jovencitas.gratis iqbazar.ru
joy-penguin.com ispac.org
jyrxd.com istizanidineacontrolledsubstance.blogspot.com
karting196.ru istock-mebel.ru
keki.info it-max.com.ua
kellyonline.xyz jav-fetish.site
kinoduh.ru jav-idol.com
kiprinform.com jjbabskoe.ru
klumba55.ru jrcigars.com
knowyournextmove.com kandidos.com
kostenlos-sexvideos.com kazrent.com
krasivoe-hd.net kino-rf.ru
kw21.org klitimg.pw
laexotic.com knowsitall.info
lafriore.ru kol-energo.ru
landmania.ru kongoultry.net
ledpolice.ru koversite.info
linkpulse.com kozhniebolezni.com
lizace.com ku6.com
lost-alpha.ru laapp.com
louboutinreplica.xyz lacave.ntic.fr
lubetube.com landreferat.ru
m.b00kmarks.com lasvegaslockandsafe.com
m5home.ru leftofcentrist.com
macrotek.ru lemon-ade.site
makedo.ru letsart.ru
mansiondelrio.co life.biz.ua
marketingtechniques.info littlecity.ch
matchpal-a.akamaihd.net live-sexcam.tk
mb140.ru liveinternet.ro
lmrauction.com
lob.com.ru
locksmith.jp
lovasszovetseg.hu
luckyshop.net.ua
lutherstable.org
madot.onlinewebshop.net
magicplayer-s.acestream.net
mail.allnews24.in
makis.nu
mamasuper.prom.ua
manyresultshub-a.akamaihd.net
matsdale.com
mcadamssupplyco.com
mcnamaratech.com mcnamaratech.com
mearns-tractors.co.uk mearns-tractors.co.uk
mediafresh.online mediaoffers.click
medictube.ru medictube.ru
medizinreisen.de
meetingrainstorm.bid
megagrabber.ru
megavolt.net.ua megavolt.net.ua
mezaruk.info memberty.com
microstatic.pl mexicosleevegastrectomy.com
minecraft-neo.ru millionare.com
mobicover.com.ua mir-business-24.ru
monarchfind-a.akamaihd.net mirmedinfo.ru
moncleroutletonline.xyz mirtorrent.net
monitorwebsitespeed.com misswell.net
monthlywinners.com mixed-wrestling.ru
morepoweronmac.trade mobplayer.ru
mrinsidesales.com mobstarr.com
mrvideospornogratis.xxx monclervests.xyz
musicstock.me morpicert.pw
myanyone.net moscow-clining.ru
mydearest.co moscow-region.ru
myfreetutorials.com moviezbonkerssk.cf
myindospace.com mp3films.ru
mykings.pw mural.co
myra.top muznachas-service.ru
naj-filmy24.pl mxgetcode.com
nalogovyykodeks.ru mybackgroundlandscape.blogspot.com
net-radar.com myfreecams.com
netallergy.ru myliveblog.ru
nightvision746.weebly.com narkologiya-voronezh.ru
njkmznnb.ru nastydollars.com
nzfilecloud.weebly.com national-today-winning-winner.club
o-o-6-o-o.ru netcheckcdn.xyz
odesproperty.com netpics.org
next-dentists.tk
ngps1.ru
nikkiewart.ru
nmrk.ru
nordstar.pro
november-lax.com
nuit-artisanale.com
nullrefer.com
o-dachnik.ru
o-o-8-o-o.ru
oballergiya.ru
obiavo.com
obiavo.uz
obuv-kupit.ru
officedocuments.net
offtopic.biz offtopic.biz
omoikiri-japan.ru okonich.com.ua
onlyporno.ru olvanto.ru
orgasmatrix.com onlinebay.ru
osb.se11.ru onload.pw
ostroike.org openfrost.net
paccohichetoti.ml openmediasoft.com
paceform.com optibuymac.com
pcgroup.com.uy osagonline.ru
pearlisland.ru ourville.info
percin.biz.ly pagesense.com
pestomou.info palocco.it
picsforkeywordsuggestion.com panchro.co.uk
pandroid.co
parajumpersstore.online
patol01.pw
pc-virus-d0l92j2.pw
perfectplanned.com
photokitchendesign.com
piter.xrus.org
pizza-tycoon.com
pl-top.pl pl-top.pl
pl-vouchers.com
plastweb.ru plastweb.ru
poem-paying.gq play-movie.pl
poffet.net
pokemongooo.ml
polska-poezja.com polska-poezja.com
porn555.com pontiacsolstice.info
pornoelita.info popunder.net
pornoklad.ru porngalleries.top
pornokorol.com pornoinn.com
pornoreino.com pornophoto.xyz
pozdravleniya-c.ru porto.abuilder.net
pozdrawleniya.com postclass.com
predominant-invent.tk privat-girl.net
printdirectforless.com privatefx-in.ru
proftests.net profit-opportunity.com
projefrio.com.br progress-upakovka.ru
pronorm.fr prom23.ru
prostitutki-astana.org prombudpostach.com.ua
prostitutki-kharkova.org promoforum.ru
pulse33.ru prpops.com
pussysaga.com pufip.com
qcstrtvt.bloger.index.hr py100.ru
qpypcx.com quelle.ru
rabotaetvse.ru quick-seeker.com
rada.ru quickloanbank.com
ratemodels.net rapevideosmovies.com
redirectme.net reckonstat.info
reklamuss.ru redirect.trafficreceiver.club
remontbiz.ru registrysweeper.com
rethinkwasteni.info reining.lovasszovetseg.hu
ric.info reklama-i-rabota.ru
robotixix.com remont-ustanovka-tehniki.ru
rock-cafe.info rentaremotecomputer.com
rockprogblog.com resellerclub.com
rfd-split.hr
ribieiendom.no
roll123.com roll123.com
rossmark.ru rosbalt.com.ua
roznica.com.ua royalads.net
rubbed.us ru-mediaget.ru
russia-tao.ru ruclicks.com
runofilms.ru
rusprostitute.com
rvzr-a.akamaihd.net
s-iwantyou.com
sabizonline.com
saecsa.co saecsa.co
saletool.ru saltspray.ru
sarahmilne.top
sbornik-zakonov.ru
sbricur.com
sc-specialhost.com sc-specialhost.com
scanner-josh.top scanner-irvin.top
scanner-nelson.top scrnet.biz.ua
search.alot.com sdsjweb.com
searchimage.co search.1and1.com
searchlock.com searchlock.com
seasaltwithfood.com seasaltwithfood.com
semprofile.com seasonvar.ru
seo-platform.com seccioncontrabajo.com
seoheap.com see-your-website-here.com
sex-tracker.de seinterface.com
semalt.com
semrush.com
sethrollins.net
sevendays.com.ua
sex-znakomstva.online sex-znakomstva.online
sexpornotales.com sexkrasivo.net
sexvporno.ru sextracker.be
sexyali.com sexytrend.ru
shemale-sex.net shisha-swag.de
shemalegalls.blogporn.in sideeffectsoftizanidine.blogspot.com
shitting.pro
shoppingmiracles.co.uk
shopvilleroyboch.com.ua
sientalyric.co sientalyric.co
silverage.ru siteonomy.com
simple-share-buttons.com skyway24.ru
simplepooltips.com
site-speed-check.site
slim.sellany.ru slim.sellany.ru
slowmac.tech snsdeainavi.info
small-games.biz snworks.com
smartadserver.com soaksoak.ru
smartpet.ru socialbookmarksubmission.org
snts.shell-pmr.ru sockshares.tv
sobecjvuwa.com.ru
soblaznu.net
social-buttons.com
socialbutton.xyz
softtor.com softtor.com
solmarket.by spacash.com
soserfis.com spaceshipad.com
sotkal.lark.ru spidtest.org
souvenir.cc spravka130.ru
spabali.org
speeddream.xyz
speedup-my.site
spitfiremusic.com
spl63.fr
sportbetfair.com
spywarebegone.com spywarebegone.com
spywarespy.com staff.prairiesouth.ca
squidoo.com statoutlook.info
stairliftstrue.com stauga.altervista.org
statustroll.com steelmaster.lv
storehouse.ua stockspmb.info
stroydetali.ru stop-gepatit.te.ua
sucsesofinspiration.com strana-krasoty.ru
summerlinhomes411.info strana-solnca.ru
superinterstitial.com stroimajor.ru
superkanpo.com stroy-portal22.ru
superlist.biz suggest-keywords.com
supermesta.ru superiends.org
svetlotorg.ru surgut.zrus.org
taihouse.ru svarkagid.com
taqplayer.info taaaak.com
tech4master.com td-33.ru
tecnoteakviareggio.it techart24.com
telemetryverification.net tecspb.ru
tengohydar.tk teenbbw.yopoint.in
textads.men teguh.info
thaisamkok.com telegraf.by
thejournal.ru telsis.com
thelottosecrets.com testbotprocessor44.com
thepornsex.org testingads.pro
timecrimea.ru thegalerie.eu
timhost.ru thegamerznetwork.com
tizanidine4mgstreetprice.blogspot.com theprofitsmaker.net
tizanidineforopiatewithdrawal.blogspot.com tizanidinehcl2mgsideeffects.blogspot.com
tizanidinehcl4mgtabinfo.blogspot.com tizanidinevsvalium.blogspot.com
tizanidineorflexeril.blogspot.com tonerbox.kz
tizanidinepain.blogspot.com topquality.cf
tizanidineshowupondrugtest.blogspot.com topsiteminecraft.com
tizanidinewithdrawalsymptoms.blogspot.com topvidos.ru
toloka.hurtom.com
toon-families.com
topads.men
topflownews.com
torrents.life
toys.erolove.in
tozup.com
track.deriv.com track.deriv.com
track112.site traffic-club.info
trafficgenius.xyz trafficmania.com
trafficjunky.net trichizobswiv.agddns.net
trk-4.net truck-addzilla.life
tubo360.com trustedhealthtips.com
tupper-posuda.ru tsan.net
turbo-suslik.org ttrraacckkrr.com
twiclub.in tubeline.biz
tyumen.xrus.org turvgori.ru
ua-company.ru twittruth.com
ua.tc ultramart.biz
uamtrk.com unitygame3d.com
ukrup.com urdoot.win
uni.me valoresito.com
unitexindia.com valuado.com
uprour.com vancleefreplica.pw
upupa.net venerologiya.com
validdomain.xyz villakohlanta.nu
vapsy.com visitcambridge.org
vashsvet.com viven.host.sk
vbabule.net vodkoved.ru
vegascosmetics.ru
velen.io
vellings.info
videonsk.com
vip-parfumeria.ru
vitanail.ru
vkontaktemusic.ru
vladimir.xrus.org
vod.com.ua
volume-pills.biz volume-pills.biz
vpnmouse.com vpnmouse.com
vrnelectro.ru vrotike.ru
vtc.pw vsdshnik.com
we-are-gamers.com vseigry.fun
webix.me vzlom-na-zakaz.com
webs.com vzlomsn.org
wesharepics.info wallpaperstock.net
westen-z.life waysbetter.cn
westum.se webradiology.ru
wechatdownload10.com
wejdz-tu.pl
wesharepics.site
whereiskentoday.com
while.cheapwebsitehoster.com while.cheapwebsitehoster.com
wineitudes.wordpress.com whiteelephantwellington.com
wordkeyhelper.com wholesalecheapjerseysfree.com
worldlovers.ru wholesalejerseys-cheapest.com
wrona.it wholesalejerseysgaa.com
ww1943.ru wholesalenfljerseys.us.com
x-porno.video womensterritory.ru
x-stars.ru word-vorlagen.xyz
xcc24.pl writersgroup580.web.fc2.com
xclicks.net x-diesel.org
xitjw.info x5market.ru
xn----7sbho2agebbhlivy.xn--p1ai xaylapdiendanang.com
xn--80aeahghtf8ac5i.xn--p1ai xmronta.com
xn--c1acygb.xn--p1ai xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xn----7sbifcamovvfggw9d.xn--p1ai
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xn----ctbbcjd3dbsehgi.xn--p1ai
xn----itbkqkfiq.xn--p1ai
xn--h1ahbi.com.ua xn--h1ahbi.com.ua
yaminecraft.ru xuki.us
youporn-ru.com yougetsignal.com
yourads.website youjizz.com
yourothersite.com youporn-forum.ga
yun56.co youraticles.pl
z-master.ru yugk.net
yunque.pluto.ro
zeroredirect.com
zhorapankratov7.blogspot.com zhorapankratov7.blogspot.com
znaniyapolza.ru zigarettenonlinekaufen.tumblr.com
zootoplist.com zirondelli.it
zvetki.ru zona-aqua.ru
zvezdagedon.ru zrus.org
zscalertwo.net
zvooq.eu
zygophyceous.womanstars.site
zynax.ua

468
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0daymusic.org 00it.com
24x7-server-support.site 123locker.com
12u.info
1314dh.com
1millionusd.xyz
2kata.ru
2rich4bitches.com 2rich4bitches.com
3xforum.ro 4k-player.pl
83net.jp 4senses.co
999webdesign.com 777-club.ru
above.com addtoadd.men
adimmix.com adidas.frwebs.fr
adsfresh.men adobereader-free.ru
adtech.fr adultfriendfinder.com
adtology.com ageofclones.com
advokateg.ru alevinefesleri.com
alert-fjg.xyz allcredits.su
alienwheels.de amateurgalls.com
all-streaming-media.com amospalla.es
allbizne.co.ua anaseracresar.tk
allproblog.com anticrawler.org
ample-awards-today.us arkartex.ru
andpolice.com artel116.ru
animenime.ru asrv-a.akamaihd.net
apccargo.com
apiappenableinfo-a.akamaihd.net
apilinkswiftco-a.akamaihd.net
app-ready.xyz
appiq.mobi
apple.com-webbrowsing-security.science
appleid-verification.com
appmsr.org
asmxsatadriverin.aircus.com
asscenihotosidea.blogspot.co.za asscenihotosidea.blogspot.co.za
atelielembrancaqueencanta.com.br atlant-auto.info
axbocz.net australia-opening-times.com
autoblogger24.info
autorn.ru
autotrends.today
avtovolop.ru
babs.com.ua
backiee.com backiee.com
best-businessman.ru bannerads.de
bestkfiledxd.cf best-way.men
bikini-image.com bestadbid.com
bio-japan.net bestmobilityscooterstoday.com
blog.f00kclan.de bestofferswalkmydogouteveryday.gq
bestssaker.com
bioca.org
blog.axant.it
blpmovies.com
board.f00d.de board.f00d.de
bongiornos.info
bonkers.name bonkers.name
boo-arts.com bonzbuddy.com
brandimensions.com bpro1.top
brandedleadgeneration.com
brendbutik.ru
bristolhotel.com.ua bristolhotel.com.ua
cashonads.com brus.city
chatroulette.online budilneg.xyz
cheapcigarettesc.info camel-beach.com
cheapjerseysbizwholesale.us capsderfudd.tk
cheatcode-lita12.rhcloud.com carina-sy.de
cialiswithoutadoctor.net carrauterie.be
cleanpcnow.com carson.getenjoyment.net
companies-catalog.com cartierlovebracelet.xyz
compliance-ivan.xyz cartierreplica.pw
coop-gamers.ru centre-indigo.org.ua
cordstrap.cc cheap-trusted-backlinks.com
cxpromote.com chinacheapelitejerseys.com
d-black.bz chocolateslim-original.com
clicksor.com
compliance-barak.xyz
construmac.com.mx
cubs-jerseys.us
cyse.tk
dafatiri.com dafatiri.com
dame-ns.kz dentfidemountpreach.tk
daneshetabiat.com dfwu1019.info
demenageur.com dieta-personalna.pl
deshevo-nedorogo.ru dikqlyremy.info
discountbarbour.online discountbarbour.online
doctormakarova.ru doctissimo.fr
domainsatcost.com dogoimage.com
downloaddy.net domznaniy.ru
el-nation.com doreenblog.online
electricwheelchairsarea.com downloadeer.net
elitedollars.com easycommerce.cf
elvenmachine.com ege-essay.ru
epngo.bz elektrozigarettekaufen2.blogse.nl
erot.co elidelcream.weebly.com
eu-cookie-law.info eu-cookie-law.info
exlarseva.webblog.es exchangeit.gq
extlinks.com exchanges-bet.com
ezaz.info exonline.info
ezigarettekaufen2.mpbloggar.se eyes-on-you.ga
fitness-video.net ezb.elvenmachine.com
flashahead.info ezigarettekaufen2.blox.pl
flavors.me f07.de
forum.poker4life.ru fandlr.com
fotzen-ficken.com favorcosmetics.com
freetangodownload.com fingerprintjs.com
freewlan.info fitnesspiks.com
freshdz.com forsex.info
frivgame250.com foxweber.com
game-top.su frankofficial.ru
gaytube.com fx-brokers-review.com
gaz-voshod.ru gentamicineyedrops.blogspot.com
gearcraft.us getresponse.com
glass-msk.ru ggiaro.com
glavprofit.ru gk-atlant.info
golden-praga.ru glcomputers.ru
gonextmedia.com go2mike.ru
gok-kasten.net
golfresa.lucania.se
googlemare.com
gopixdatabase.com
gotomontenegro.net gotomontenegro.net
handsandlegs.ru gz2.bbsoldes.fr
hetmanship.xyz hetmanship.xyz
hiwibyh.bugs3.com highspeed5.net
homedecorpicture.us himazin.info
hoporno.com hol.es
host-tracker.com hothor.se
housemilan.ru hotsocialz.com
iamsport.org hyipmanager.in
idealtits.net i-midias.net.br
inclk.com imperia31.ru
insta-add.pro inboundlinks.win
instakink.com inspiring-desperate.tk
integritylandscapeservices.com
iomoio.net iomoio.net
iusstf.org janavibekken.no
janettabridal.com janettabridal.com
japfm.com junketjuice.blogspot.com
javxxx18.com keki.info
jerseyswholesalechinalimited.com kino-ecran.ru
juliadiets.com krasnodar.xrus.org
kaac.ru lalalove.ru
karusel-market.ru lescinq.com
kazka.ru lineavabit.it
keywordteam.net lion.misba.us
kino2018.cc livefixer.com
kinoplen.ru liver-chintai.org
klin3952.ru lombia.co
knogg.net lottospring.com
kung-fu-ru.com louisvuittonoutletstore.net
lenpipet.ru m0r0zk0-krava.ru
linerdrilling.com macnewtech.com
livejasmin.com mahnwachen-helfen.info
livingroomdecor.info mainhp.net
lodki-pvh.dp.ua meteostate.com
long-beach-air-conditioning.com michaelkorsoutletstore.net
m5home.ru migente.com
machicon-ueno.info mobifunapp.weebly.com
mailemedicinals.com moi-glazki.ru
manifestyourmillion.com monarhs.info
mature.free-websites.com moneyteam24.com
maxxtor.eu morf.snn.gr
mega-bony-2017.pl mp3ritm.top
mere.host.sk msfsaar.de
mikrobiologies.ru mustat.com
mobilierland.com myfreemp3.eu
most-kerch.org mywallpaper.top
mrwhite.biz namecrumilchlet.tk
mundoaberrante.com newsperuse.com
musicspire.online nibbler.silktide.com
mymobilemoneypages.com novatech.vn
myshopmatemac.com o-o-6-o-o.com
naperehresti.info oakridgemo.com
netvouz.com osb.se11.ru
njkmznnb.ru paparazzistudios.com.au
nufaq.com photo-clip.ru
odywpjtw.bloger.index.hr piccdata.com
oneminutesite.it plastweb.ru
onko-24.com podshipniki-ntn.ru
opinionreelle.com popup-hgd.xyz
orgasmatrix.com portnoff.od.ua
partner-pop.men priceg.com
perm.xrus.org privatamateure.com
perosan.com pshare.biz
pipki.r.acdnpro.com ptr.ruvds.com
plastjulgranar.se r-e-f-e-r-e-r.com
pogodnyyeavarii.gq razleton.com
popmarker.com rcpmda.ikan1080.xyz
pornofiljmi.com registrationdomainsite.com
poshiv-chehol.ru remmling.de
positive2b.ru remont-comp-pomosh.ru
predmety.in.ua rent2spb.ru
pregnant.guru restaurantlescampi.com
printie.com restorator-msk.ru
projectforte.ru richinvestmonitor.com
real-time-analytics.com running-line.ru
reckonstat.info rus-teh.narod.ru
refudiatethissarah.info russkie-gorki.ru
replicaclub.ru samo-soznanie.ru
rp9.ru samoiedo.it
ruspdd.com sdrescher.net
sarahmilne.top securesmrt-dt.com
scanner-julianna.top seeingmeerkat.com
scanner-nelson.top servicecenter.co.ua
semxiu.com
seo-prof1.xyz
seorankinglinks.com
sex-pr.net sex-pr.net
sex-tracker.de sims-sims.ru
sex-znakomstva.online slim.sellany.ru
sextracker.be snsdeainavi.info
sexystrippe.info social-button.xyz
shitting.pro socialbuttons.xyz
shymkent.xkaz.org soda.media
sladkoevideo.com softtor.com
sledstvie-veli.net solitaire-game.ru
sluganarodu.ru stathat.com
smartbalanceworld.com steebook.com
snjatie-geroinovoy-lomki.ru streetfooduncovered.com
spanking.to studiokamyk.com.pl
sps-shop.com success-seo.com
spywarespy.com supers.com.ua
stackthatbucks.com svbur.ru
stroiminsk.com tandvardshuset.net
subj.ukr-lit.com telesvoboda.ru
supervesti.ru tgtclick.com
survival.betteroffers.review thegalerie.eu
susanholtphotography.com titelhelden.eu
svetlotorg.ru tizanidinehcl4mgtabinfo.blogspot.com
swimpool.ca tnctrx.com
swinon.site tomck.com
taranerymagesswa.blogspot.com tpu.ru
tattomedia.com traffic-club.info
tech4master.com tula.mdverey.ru
teletype.in txxx.com
thebitcoincode.com uhod-za-sobakoj.ru
tizanidinehcl2mg.blogspot.com umaseh.com
tizanidinepain.blogspot.com umekana.ru
tn811.us
toonfamilies.net
top250movies.ru
topcar-krasnodar.ru
tozup.com
trackmedia101.com
tvteleport.ru
u17795.netangels.ru
umg-stroy.ru
undergroundcityphoto.com undergroundcityphoto.com
upstore.me utrolive.ru
varbergsvind.se veles.shop
via-energy-acquistare.com
viagroid.ru
viktoria-center.ru viktoria-center.ru
vkontarkte.com voloo.ru
vsesubwaysurfers.com voluumtracker1.com
watchmygf.net vucms.com
weddingdresses.xyz wallpapersist.com
whatistizanidinehclusedfor.blogspot.com webradiology.ru
whatsappbot.flyland.ru wosik-dach.service-for-web.de
wholesalecheapjerseysfree.com www.souvenirua.com
wholinkstome.com www.timer4web.com
wildworld.site x-diesel.biz
williamrobsonproperty.com x-true.info
wordpresscore.com x69ty.ru
wormix-cheats.ru xfluro.com
xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai xmladserver.com
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
xn--80aaagvmjabrs1aoc9luc.xn--p1ai xxxsiterips.xyz
xpresscare.ru yellowstonesafaritours.com
xz618.com yes-com.com
yoluxuryevents.com you-shall-not-pass.is74.ru
yubikk.info zaimite.ru
zastenchivosti.net zigarettenonlinekaufen.tumblr.com
zazagames.org zrelaya.pw
zeroredirect1.com
zetgie.com.pl
zigarettenonlinekaufen1.bloog.pl
zlatnajesen.com
zoompegs.com

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.10 0; 10.1.1.55 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3487 ### Version: V4.2022.11.3488
### Updated: Wed Nov 23 10:03:36 UTC 2022 ### Updated: Wed Nov 23 22:01:14 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3487 ### Version: V4.2022.11.3488
### Updated: Wed Nov 23 10:03:36 UTC 2022 ### Updated: Wed Nov 23 22:01:14 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##