vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 10:40:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.11.3462 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-11-10 10:09:18 +00:00
parent 2425f31d74
commit 893150d83e
46 changed files with 99749 additions and 99749 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3461 #### Version: V4.2022.11.3462
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3461 #### Version: V4.2022.11.3462
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.11.3461 #### Version: V4.2022.11.3462
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12334
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.11.3461 #### Version: V4.2022.11.3462
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12338
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12338
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12338
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12338
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

12338
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

12338
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

12338
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3461 3462

12338
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12338
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.114.139.174 0; 20.97.116.40 0;

12338
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

12338
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

12338
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

12338
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.114.139.174 0; 20.97.116.40 0;

12338
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.114.139.174 0; 20.97.116.40 0;

12338
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 1; 10.1.0.91 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Cogentbot BacklinkCrawler
Disco Barkrowler
LinkpadBot DIIbot
PleaseCrawl MQQBrowser
Sucker Mister PiX
TurnitinBot Re-re
WebStripper Web Enhancer
WebWhacker WebLeacher
Wprecon ZmEu
plumanalytics dataforseo.com

296
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com ASPSeek
ALittle Client Abonti
Aboundex
Aboundexbot Aboundexbot
AiHitBot AfD-Verbotsverfahren
AhrefsBot
Aipbot Aipbot
AllSubmitter Anarchy
Anarchy99 Ankit
Apexoo Anthill
Atomseobot
AwarioRssBot AwarioRssBot
BBBike AwarioSmartBot
BLEXBot BLEXBot
BackStreet
BackWeb BackWeb
Backlink-Ceck Backlink-Ceck
BacklinkCrawler
Badass
Barkrowler
BatchFTP BatchFTP
BetaBot
Bigfoot Bigfoot
Bitacle
Blow Blow
Boardreader BlowFish
Brandprotect
Brandwatch
Buddy Buddy
BuiltBotTough Bullseye
BuiltWith
BunnySlippers
CCBot CCBot
CSHttp
CazoodleBot CazoodleBot
Cegbfeieh Cegbfeieh
CensysInspect CherryPicker
CheTeam
ChinaClaw ChinaClaw
Claritybot Claritybot
Cloud mapping Cocolyzebot
Cogentbot
Copier Copier
Cosmos Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
DBLBot Curious
Custo
DSearch DSearch
DataCha0s DataCha0s
DatabaseDriverMysqli Devil
Demon Disco
Digincore Discoverybot
Dirbuster Dispatch
Discobot DnBCrawler-Analytics
DnyzBot DnyzBot
DomCopBot DomCopBot
DomainCrawler DomainAppender
DomainSigmaCrawler Download Wonder
DomainStatsBot Drip
EasyDL EMail Siphon
Ebingbong Ebingbong
Ecxi Exabot
EroCrawler ExtLinksBot
Extractor
ExtractorPro ExtractorPro
EyeNetIE FHscan
Ezooms Fimap
FDM Fyrebot
Foobot
Freeuploader
FrontPage
GT::WWW
GalaxyBot GalaxyBot
Genieo
GetRight GetRight
GetWeb GetWeb
Getintent
Gigabot Gigabot
Gotit Go!Zilla
Grabber Go-Ahead-Got-It
Grafula Grafula
GrapeshotCrawler
HMView
HTMLparser
HTTrack
Haansoft Haansoft
HaosouSpider HaosouSpider
Harvest Harvest
Heritrix Havij
HonoluluBot Hloader
Humanlinks Humanlinks
HybridBot Id-search
IDBTE4M IlseBot
Image Fetch Image Fetch
Image Sucker IndeedBot
Indy Library InterGET
InfoNaviRobot Internet Ninja
Intelliseek
InternetSeer
Iskanie
IstellaBot
JamesBOT JamesBOT
JennyBot
JetCar JetCar
Jetty JustView
Jyxobot Kozmosbot
Kinza Leap
LNSpiderguy LeechGet
LWP::Simple Likse
LeechFTP
LexiBot
Lftp
LibWeb
LieBaoFast
LinkScan LinkScan
LinkWalker
Linkbot Linkbot
LinqiaMetadataDownloaderBot LinkextractorPro
LinksManager
LinqiaRSSBot
Lipperhey Spider Lipperhey Spider
Litemage_walker
MIDown tool
MSFrontPage MSFrontPage
MTRobot
Mag-Net Mag-Net
Mail.RU_Bot Mail.RU_Bot
Majestic SEO
Majestic-SEO
Mass Downloader
Masscan
MauiBot MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Minefield
Moblie Safari Moblie Safari
MolokaiBot Mojolicious
Mozlila
Mr.4x3 Mr.4x3
Msrabot Msrabot
Musobot
NICErsPRO NICErsPRO
NPbot NPbot
Nameprotect
Navroad Navroad
NearSite NearSite
Nessus
Net Vampire Net Vampire
NetAnts NetLyzer
NetSpider NetSpider
Nettrack Nettrack
Niki-bot Netvibes
Nikto Offline Navigator
Nimbostratus
Nmap
Not
Nutch
OnCrawl OnCrawl
OpenVAS Openfind
OrangeBot OrangeBot
OrangeSpider OutclicksBot
PHPCrawl OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer PageAnalyzer
PageScorer PageGrabber
PageThing.com
Pandalytics Pandalytics
Panscient
Papa Foto
PeoplePal PeoplePal
Picscout Picscout
PictureFinder
Pimonster
Pixray Pixray
ProWebWalker PleaseCrawl
Pockey
Psbot Psbot
Pu_iN Pump
Quick-Crawler Quick-Crawler
RSSingBot RankActive
RankActiveLinkBot RankActiveLinkBot
Rankivabot
Reaper Reaper
RedesScrapy RepoMonkey
Ripper
RocketCrawler
Rogerbot Rogerbot
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
Scanbot
ScoutJet ScoutJet
Screaming ScrepyBot
SearchmetricsBot SemrushBot
Semrush Seomoz
SentiBot Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider SiteLockSpider
Sitebeam Sitevigil
Snoopy SlySearch
Sociscraper Snapbot
Sottopop Spammen
SpankBot Spinn3r
Spanner
SputnikBot SputnikBot
Sqlworm
Sqworm
Sucker Sucker
SuperHTTP
Surfbot Surfbot
SurveyBot
Swiftbot Swiftbot
T8Abot T0PHackTeam
Teleport TeleportPro
Thumbor Telesphorep
TightTwatBot TheNomad
Titan Titan
Toata
Tracemyfile
Trendiction Trendiction
Trendictionbot TurnitinBot
Turingos
TwengaBot TwengaBot
Twice Twice
Typhoeus Typhoeus
VCI URLy Warning
UnisterBot
V-BOT
Vacuum Vacuum
Vagabondo Vagabondo
Virusdie VelenPublicWebCrawler
Voltron VidibleScraper
Voil
WISENutbot WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers Wallpapers
Web Collage Wallpapers/3.0
Web Fuck WeSEE
Web Pix Web Auto
Web Sauger Web Enhancer
WebAuto WebEnhancer
WebFetch
WebLeacher
WebReaper
WebSauger WebSauger
WebWhacker WebZIP
Webalta Webalta
WebsiteQuester Whack
Whatweb Whatweb
WinHTTrack Widow
Wonderbot Wotbox
Wprecon
Xenu Xenu
Zade
Zermelo Zermelo
Zitebot
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
ZumBot ZumBot
adscanner ZyBorg
arquivo.pt autoemailspider
backlink-check backlink-check
cah.io.community
check1.exe check1.exe
clark-crawler
cognitiveseo cognitiveseo
com.plumanalytics crawler.feedback
dataforseo.com
demandbase-bot demandbase-bot
gopher facebookscraper
internetVista monitor
ips-agent
iubenda-radar
muhstik-scan muhstik-scan
page scorer netEstate NE Crawler
pcBrowser pcBrowser
polaris version
probe-image-size probe-image-size
ripz ripz
scalaj-http s1z.ru
scan.lol
seobility
seocompany.store seocompany.store
seoscanners seoscanners
serpstatbot seostar
siteripz sitechecker.pro
sogouspider sogouspider
spyfu sysscan
trendiction.com ubermetrics-technologies.com
x09Mozilla voyagerx.com
x22Mozilla x22Mozilla
zauba.io
zgrab

298
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404checker
404enemy 404enemy
AhrefsBot 80legs
AIBOT
ALittle Client
ASPSeek
Abonti
AiHitBot
Aipbot Aipbot
Alexibot Alexibot
Atomseobot Alligator
Anarchy
Anthill
Asterias
Attach Attach
AwarioRssBot AwarioRssBot
BDFetch BackStreet
BLEXBot BackWeb
Backlink-Ceck Badass
Barkrowler Barkrowler
BetaBot Battleztar Bazinga
Bigfoot
Black Hole
BlackWidow BlackWidow
Blackboard Blackboard
Bolt Bolt
Buck BotALot
Buddy Buddy
BuiltBotTough BuiltBotTough
BunnySlippers
CATExplorador
CCBot
Calculon
CazoodleBot CazoodleBot
Cegbfeieh CheeseBot
CensysInspect Claritybot
CheTeam Cloud mapping
Citoid Cogentbot
Cocolyzebot CopyRightCheck
Copier
Copyscape
Craftbot
Curious Curious
DIIbot DBLBot
DSearch DTS Agent
DataCha0s DatabaseDriverMysqli
Devil Dirbuster
DigitalPebble Disco
Discoverybot DittoSpyder
DnyzBot DnyzBot
DomCopBot DomCopBot
DomainCrawler DomainAppender
Dotbot DomainSigmaCrawler
Download Wonder DomainStatsBot
Dragonfly Domains Project
Drip
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong Ebingbong
Ecxi Ecxi
Evil Evil
Exabot Exabot
Express WebPictures Express WebPictures
Extractor ExtLinksBot
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE
Ezooms Ezooms
FDM
FHscan FHscan
Fimap FlashGet
FrontPage Fuzz
FyberSpider FyberSpider
GT::WWW
Genieo Genieo
Getintent GetRight
Gotit Go!Zilla
Grabber Go-Ahead-Got-It
GrabNet
GrapeFX GrapeFX
HEADMasterSEO GrapeshotCrawler
HMView
HTMLparser HTMLparser
Haansoft HTTP::Lite
HaosouSpider HTTrack
Havij Harvest
Heritrix Hloader
HonoluluBot HonoluluBot
Humanlinks Humanlinks
HybridBot
IDBTE4M
IDBot IDBot
IRLbot Image Fetch
IndeedBot Image Sucker
InfoTekies InfoTekies
Intelliseek Intelliseek
InternetSeer InternetSeer
Iskanie Iria
IstellaBot JOC Web Spider
JamesBOT JamesBOT
Jbrofuzz JennyBot
Jetty JetCar
Joomla
Jorgee
Jyxobot
Keyword Density Keyword Density
Kinza LNSpiderguy
Kozmosbot Larbin
LWP::Simple Leap
LeechFTP
LeechGet LeechGet
Lftp
LibWeb
Libwhisker Libwhisker
LinkWalker LieBaoFast
Likse
Linkbot
LinkextractorPro LinkextractorPro
LinkpadBot
LinksManager LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
Lipperhey Lmspider
Lipperhey Spider
Litemage_walker
Ltx71 Ltx71
MQQBrowser MJ12bot
MTRobot MSIECrawler
Majestic SEO
Majestic12 Majestic12
Masscan MarkWatch
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Metauri
Moblie Safari
Mozlila Mozlila
NearSite Mr.4x3
Net Vampire NPbot
Name Intelligence
NetAnts
NetLyzer NetLyzer
Nikto NetMechanic
Nmap NextGenSearchBot
Nutch Nibbler
Offline Explorer Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Not
Octopus
OnCrawl OnCrawl
OpenLinkProfiler OpenVAS
Openfind
OrangeBot
OutclicksBot OutclicksBot
OutfoxBot OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageAnalyzer
PageGrabber PageGrabber
Pandalytics Pandalytics
Papa Foto Panscient
PeoplePal Pavuk
Pi-Monster Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz Piepmatz
Pimonster
Pixray
PleaseCrawl PleaseCrawl
Pockey ProPowerBot
ProWebWalker
Pu_iN Pu_iN
QueryN Metasearch PxBroker
RSSingBot PyCurl
RankurBot Quick-Crawler
ReGet ReGet
RealDownload RealDownload
Reaper Reaper
RebelMouse
RedesScrapy
RepoMonkey RepoMonkey
Rogerbot SEOlyticsCrawler
SBIder
SEOkicks
SEOstats SEOstats
SMTBot SMTBot
SalesIntelligent ScanAlert
ScoutJet Searchestate
Screaming Semrush
SeoSiteCheckup SemrushBot
Shodan SeobilityBot
SiteSucker Site Sucker
SmartDownload SiteCheckerBotCrawler
Siteimprove
Snake
Snapbot Snapbot
Sosospider Snoopy
SocialRankIOBot
Sogou web spider
SpaceBison SpaceBison
Spammen Spammen
Spanner SpankBot
Spinn3r Sqworm
Stripper
Sucuri Sucuri
Swiftbot SurveyBot
T8Abot Szukacz
Teleport
Telesoft Telesoft
The Intraformant Telesphoreo
TheNomad TheNomad
Toata Thumbor
Trendiction
True_Robot True_Robot
Typhoeus URLy Warning
URLy.Warning URLy.Warning
Upflow
V-BOT V-BOT
VCI
Vacuum Vacuum
Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler
Virusdie Virusdie
VoidEYE WASALive-Bot
Voil
WBSearchBot WBSearchBot
WISENutbot WISENutbot
WeSEE WWW-Collector-E
Wallpapers/3.0
Web Collage
Web Fetch Web Fetch
Web Pix Web Pix
Web Sucker WebAuto
WebFuck WebCopier
WebGo IS WebFetch
WebImageCollector
WebLeacher
WebPix
WebReaper WebReaper
WebSauger
WebSucker WebSucker
WebmasterWorldForumBot Webalta
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Webster Webster
Whacker Wonderbot
Who.is Bot
Woobot Woobot
Wotbox Zeus
Xaldon WebSpider Zitebot
Xenu ZoomBot
Zauba adscanner
Zermelo arquivo.pt
ZmEu
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
backlink-check backlink-check
coccocbot
cognitiveseo cognitiveseo
com.plumanalytics
crawl.sogou.com crawl.sogou.com
demandbase-bot
domainsproject.org domainsproject.org
heritrix
internetVista monitor internetVista monitor
linkdexbot ips-agent
lwp-request
magpie-crawler magpie-crawler
mediawords meanpathbot
netEstate NE Crawler page scorer
polaris version polaris version
s1z.ru ripz
scalaj-http satoristudio.net
seobility seobility
seocompany.store
seostar seostar
sexsearcher sexsearcher
sp_auditbot sp_auditbot
spyfu spyfu
sysscan sysscan
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
webpros.com webgains-bot
x09Mozilla webmeup-crawler
webprosbot
x22Mozilla x22Mozilla
xpymep1.exe
zauba.io zauba.io
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
cakesplus.com.au duplicashapp.com
circlesl.com ertelecom.ru
energydiet-info.ru fxund.us
hayate.biz locustdesign.co
healgastro.com mailemedicinals.com
invest-pamm.ru mega-bony-2017.pl
lacapilla.info sk.golden-praga.ru
stroimajor.ru testingads.pro
whipme.yopoint.in vipsiterip.org
x-porno.video www.888.com

928
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
101raccoon.ru 101billion.com
12u.info 101lesbian.xyz
13tabs.com 123cha.com
178evakuator178.ru 123movies.love
214jaluwobapef.cf 1j7740kd.website
24-ak.ru 28n2gl3wfyb0.ru
273-fz.ru 3rbseyes.com
4kepics.com 4pp13.com
51unlim.ru 76brighton.co.uk
7a2rnuey1tw9ar.ru
7search.com
7yue.org 7yue.org
7zap.com 98oi.ru
a.frcls.fr aa9d046aab36af4ff182f097f840430d51.com
aarbur.com abclauncher.com
absolute-s.ru
abwa.tk abwa.tk
academia-nsk.org actionnooz.com
acheterviagrafr24.com actulite.com
adcash.com adf.ly
adconscious.com adktrailmap.com
adman.se
admeasures.com admeasures.com
adservme.com adultactioncam.com
adsref.men adultfullhd.com
adtech.us adventureparkcostarica.com
adult3dgames.com
adultwebhosting.info
agysya.ru
akama.com akama.com
akita.kz ald2014.org
alert-hgd.xyz alevinefesleri.com
alfabot.xyz alif-ba-ta.com
allesohnegirls.net allbizne.co.ua
allsilver925.co.il allnews.md
amospalla.es alpharma.net
alta-realestate.com
ample-awards-today.us ample-awards-today.us
ampower.me ampower.me
anatomiy.com anal-acrobats.hol.es
androids-store.com anapa-inns.ru
animalrank.com
animaltoplist.com animaltoplist.com
apiallgeniusinfo-a.akamaihd.net antons-transporte.de
apilinkswiftco-a.akamaihd.net apartmentbay.ru
apiportalmorecom-a.akamaihd.net apiappenableinfo-a.akamaihd.net
apper.de apimegabrowsebiz-a.akamaihd.net
aquarium-pro.ru appfixing.space
arabgirls.adultgalls.com
aramaicmedia.org
arate.ru
architecturebest.com
arendas.net
arkkivoltti.net
articlesdirectoryme.info articlesdirectoryme.info
auto-moto-elektronika.cz asdfz.pro
auto.rusvile.lt asrvvv-a.akamaihd.net
autoplate.info asscenihotosidea.blogspot.co.za
avtointeres.ru audiofree.ru
avtolombard-krasnodar.com autobudpostach.club
awency.com aviav.org
axbocz.net avirasecureserver.com
azartniy-bonus.com avkzarabotok.com
azbukadiets.ru avtocredit-legko.ru
baditri.com awaybird.ru
baersaratov.ru azartmsl.com
baixar-musicas-gratis.com azbukafree.com
balla-boo.se bagcionderlab.com
bankiem.pl banki76.ru
bdsmgalls.net basedecor.ru
bear.gotcher.us bbsoldes.fr
beatifullandscape.co beachfix.co
becuo.com beclean-nn.ru
bedandbreakfast.com beget.tech
bestcurs.org belsetirehafi.tk
besthomemadepornsites.com benchmarkcommunications.co.uk
bin-brokers.com bestbuy.ca
bioca.org bestcalovebracelet.cn
bjanshee.ru bestcoin.cc
bloggers.nl bestfortraders.com
blogs.rediff.com bestwaystogetpaid.us
bmw-ark.ru bibys.com
brandehk.dk bigcities.org
bukleteg.xyz bigpictures.club
bumascloset.com billiard-classic.com.ua
buntube.net bird1.ru
cablecar.us bitcoinremote.com
cactussoft.biz bitcoins-live.ru
cakesplus.com.au blog.remote-computer.de
callawaygolfoutlet.online bloggerads.net
cardsdumps.com blogig.org
carstrends2015.com boazpower.com
cartierreplica.top bocoarchives.org
casinorewards.info brendbutik.ru
cbox.ws bristolhostel.com
cbozhe.com btvn.ru
cdncash.net bupropion-sr-150-mg.us
centrumcoachingu.com buron.pw
buyessaynow.biz
bvlgariring.xyz
bwlx.prepedu.cn
cartierlove2u.com
cartierloveringreplica.xyz
celebsopics.com
centre-indigo.org.ua
cfcl.co.uk
cgi2.nintendo.co.jp
changde.58.com changde.58.com
cheapcigarettesc.info chcu.net
checktext.org cheapmarmot.online
children-learningreading.info chimiver.info
cialischmrx.com cineacademy.ru
cjmc.info cinemaenergy-hd.ru
clipartnew.com clothesforcash.com
clmforexeu.com coccoc.com
collegeessay19.blogspot.ru cognitiveseo.com
conciergegroup.org compliance-barak.top
constantaservice.net compliance-don.top
cookie-law-enforcement-ff.xyz compliance-mark.top
coolbar.pro compliance-olga.top
counterbot.com compliance-viktor.top
countercrazy.com compliance-walt.top
covadhosting.biz computernetworksonline.com
customcollegeessays.net consorzioilmosaico.org
converse.ddsoldes.fr
cosmetic.donna7753191.ru
countbertwistdisp26.soup.io
cs-passion.pl
cwetochki.ru cwetochki.ru
cypernhuset.se dairyindia.in
d2jsp.org dandiyabeats.in
dafatiri.com darodar.com
data-ox.com data1.scopich.com
dating-app.ru daydream-studio.ru
datsun-do.com ddsoldes.fr
detsky-nabytek.info de.zapmeta.com
diegolopezcastan.com dekoration.us
digital-sale.su dengi-pod-zalog-nedvizhimosti.ru
dildofotzen.net derevesendeco.com
divci-hry.info destinationrealestate.com
dktr.ru detective01.ru
dnepropetrovsk.mistr-x.org detoxmed24.ru
dneprsvet.com.ua deutschland123.de
dodlive.mil dev.citetick.com
dogbreedspicture.net digital-video-processing.com
dogclothing.store disruptingdinnerparties.com
domashneeruporno.com divku.ru
domination.ml dokumentalkino.net
download-of-the-warez.blogspot.com dolohen.com
download-wallpaper.net domainsatcost.com
downloadkakaotalk.com download-walpaperhd.blogspot.com
doyouknowtheword-flummox.ml downloadmefiranaratb1972.xpg.com.br
dptaughtme.com doxysexy.com
drugspowerstore.com e-poker-2005.com
dtnlyss.com earthmagic.info
easync.io ebooknovel.club
ec-file.info ec-file.info
elektrozigarettekaufen1.devhub.com ekspertmed.com
elexies.info elektronischezigarettekaufen1.myblog.de
elitedollars.com elektrozigarettekaufen2.blogse.nl
elstal.com.pl elmifarhangi.com
elvenar.com elvel.com.ua
erotag.com enge-fotzen.info
erotik0049.com enpolis.ru
escortslet.net essay-writing.work
esnm.ru essaypro.com
everypony.ru este-line.com.ua
exchangeit.gq euronis-free.com
exci.ru eurosamodelki.ru
excitacion.info evaashop.ru
extener.org evrotekhservis.ru
ezigarettenshop2.myblog.de exct.net
ezigaretteshop.webs.com exportshop.us
ezrvrentals.com extremal-blog.com
faithe.top ezigarettekaufen2.yolasite.com
fanoboi.com failingmarriege.blogspot.com
fashion.stellaconstance.co fakehandbags.xyz
fast-torrent.ru fantasticpixcool.com
fbdownloader.com fearcrow.com
feeriaclub.ru fickluder69.com
ferretsoft.com filerockstar298.weebly.com
fickkontaktehobbyhuren.com film-one.ru
filesdatabase.net filmania-x.ru
firesub.pl financepoints.eu
fix-website-errors.com firstsiteguide.com
forexunion.net fodelsedagspresenter.nu
forum.doctissimo.fr forex-indextop20.ru
free-stock-illustration.com formulaf1results.blogspot.com
freevpn.space forsex.info
freewhatsappload.com forum.tvmir.org
freewlan.info foto-basa.com
freakycheats.com
free-fbook-traffic.com
freefoto.ca
freegamesplay.online
freshwallpapers.info freshwallpapers.info
gael-s.ru funnymama.com
gallerily.com fxund.us
gambarkataku.co galeon.com
games.kolossale.ru game-top.su
geckoandfly.com gamebackyard.com
gamerscorps.com
gateway.zscalerone.net
gemara.com
gemgrab-a.akamaihd.net gemgrab-a.akamaihd.net
gentamicineyedrops.blogspot.com
getmyads24.com getmyads24.com
ghostvisitor.com girlspicsa.com
glavprofit.ru gkvector.ru
glcomputers.ru global-ics.co.za
go2album.com globetrotting-culture.ru
go2mike.ru golden-praga.ru
gobongo.info gorodservis.ru
goodnightjournal.com gotorussia.com
googlsucks.com gourcy.altervista.org
greatgrace.ru grtyi.com
hamacapty.com gsasearchengineranker.xyz
hasshe.com guod.me
hccoder.info guruofcasino.com
hdhc.ru h2monline.com
hdpixion.com habermetre.com
healgastro.com happy.new.yeartwit.com
heartofbeijing.blogspot.com hauleddes.com
hazardky.net
hdimagegallery.net
helicalpile.us helicalpile.us
heroz.fr herehloadibs.cf
hetmanship.xyz hit-kino.ru
heygidday.biz hmywwogw.bloger.index.hr
hmmm.cz howtoclean.club
hundejo.com huhn.altervista.org
igru-xbox.net humanelydrew.com
imagecoolpub.com humbmosquina.tk
informatiecentro.be hut1.ru
hystersister.com
ideibiznesa2015.ru
igithab.com
iklysha.ml
ilovevitaly.ru
imabase.com
imagerydatabase.com
imediadesk.com
impotentik.com
inclk.com
infazavr.ru
infobabki.ru
int.search.mywebsearch.com int.search.mywebsearch.com
interesnie-faktu.ru intelhdgraphicsgtdrive6w.metroblog.com
interferencer.ru
investpamm.ru
iopeninghours.co.uk
iphantom.com
iplogger.org iplogger.org
itag.pw iscblog.info
itch.io iskalko.ru
ixora.pro istripper.com
izismile.com j-times.ru
james13prix.info j33x.com
jav-fetish.site jaxcube.info
javstock.com jeremyeaton.co
javxxx18.com jerseyswholesalechinalimited.com
jerseywholesaleelitestore.com kam-dom.ru
justprofit.xyz kamagragelusa.net
justucalling32211123456789.tk kazan.zrus.org
jwss.cc kerch.site
kazrent.com
kenaba.su
kerwinandcariza.com
khafre.us
kiinomaniak.pl kiinomaniak.pl
kino-ecran.ru
kino-key.info
kino-rating.ru
kinoflux.net
kinoplen.ru kinoplen.ru
kinotorka.ru kirov.zrus.org
koleso24.com.ua kladrus.ru
kostenlos-sexvideos.com kmgamex.cf
kvartiry-remont.ucoz.ru kozhniebolezni.com
lacapilla.info lacasamorett.com
landscaping.center lampokrat.ws
lasvegaslockandsafe.com landreferat.ru
ledis.top law-check-eight.xyz
lego4x4.ru law-check-seven.xyz
letslowbefast.today lemon-ade.site
lflash.ru lider-zhaluzi.kiev.ua
limtu.ifmo.ru lifeinsurancekb.com
littlesunraiser.com likesdesign.com
live-sexchat.ru linkpulse.com
liveshoppersmac.com liumimgx.pw
llastbuy.ru localflirtbuddies.com
lombia.com lockerz.com
lonerangergames.com lomb.co
low-format.ru longadventure.com
lowephotos.info lordzfilmz.me
m0r0zk0-krava.ru louboutinreplica.xyz
machicon-akihabara.info louboutinshoes.xyz
mackeeper-center.club
macotool.com macotool.com
maju.bluesalt.co mailemedicinals.com
manifestyourmillion.com mainlinehobby.net
mararoom.ru makedo.ru
maridan.com.ua makemoneyonline.com
markjaybeefractal.com makenahartlin.com
masturbate.co.uk mall.uk
max-p.men malls.com
maxxtor.eu marblestyle.ru
mcar.in.ua matchpal-a.akamaihd.net
mcnamaratech.com medicines-choice.com
mecash.ru medicovi.com
meltwater.com medispainstitute.com.au
members.ghanaweb.com meetingrainstorm.bid
minecraft-neo.ru micasainvest.com
miniature.io michaelkorssaleoutletonline.net
mirzonru.net mobplayer.ru
mitrasound.ru mockupui.com
mnogabukaff.net modnie-futbolki.net
mobifunapp.weebly.com moesexy.com
moetomnenie.com monarhs.info
mojaocena.com
moncleronline.xyz
monetizationking.net
monetizer.com-01.site monetizer.com-01.site
more-letom.ru money-every-day.com
moscow.xrus.org moscow-region.ru
mosrif.ru mostantikor.ru
movies-in-theaters.net mototsikl.org
movpod.in mountainstream.ms
mug-na-chas-moscow.ru musicktab.com
muz-baza.net mxgetcode.com
mydirtyhobby.com my-big-family.com
myyour.eu mygameplus.ru
narkologiya-penza.ru myhitmp3.club
nastroyke.net namenectar.com
nastydollars.com naperehresti.info
nationalbreakdown.com new-post.tk
negral.pluto.ro nextrent-crimea.ru
neks.info nicovideo.jp
nextbackgroundcheck.gq nmrk.ru
niki-mlt.ru nofreezingmac.work
norththeface.store noumeda.com
novosti-hi-tech.ru nyfinance.ml
nrjmobile.fr offergroup.info
nrv.co.za offtime.ru
obiavo.kz onclkads.com
officedocuments.net ooo-olni.ru
okel.co openmediasoft.com
okmusic.jp optikremont.ru
omgtnc.com orsonet.ru
one-gear.com osnova3.ru
oneminutesite.it otbelivanie-zubov.com
online.ktc45.ru oxotl.com
open-odyssey.org ozas.net
osoznanie-narkotikam.net page2rss.com
outshop.ru paighambot.com
owohho.com pammik.ru
oxford-book.com.ua pattersonsweb.com
pacificair.com peugeot-club.org
paintingplanet.ru physfunc.ru
panouri-solare-acoperis.com pintattoos.com
paparazzistudios.com.au pinwallpaper.xyz
par-fallen.ga poppen-nw.net
partnersafe.men popup-hgd.xyz
partnerworkroom.men pornotubs.com
patterntrader-en.com porto.abuilder.net
pawli.eu princevc.com
pcads.ru
perfectplanned.com
pertlocogasilk.tk
php-market.ru
phpdevops.com
phrcialiled.com
picmoonco.pw
picphotos.net
picsfair.com
picture-group.com
pictures-and-images.net
piluli.info
pinkduck.ga
piuminiita.com
pizza-tycoon.com
pl.aasoldes.fr
plohaya-kreditnaya-istoriya.ru
pogodnyyeavarii.gq
polcin.de
pons-presse.com
popugaychiki.com
popunder.net
pornhive.org
pornoklad.ru
pornosemki.info
pornoxxx.com.mx
pornozhara.com
preg.marketingvici.com
privacylocationforloc.com
privatefx.all4invest.info
privhosting.com privhosting.com
professionaldieselcare.com professionalwritingservices15.blogspot.ru
prokotov.com profitsport.club
pts163.ru profitwithalex.info
promoheads.com
prostitutki-kharkova.org
prostitutki-yaroslavlya.org
pulse33.ru pulse33.ru
puzzleweb.ru rankexperience.com
quick-seeker.com rarbg.to
quickchange.cc rating-casino2021.ru
qwesa.ru razorweb-a.akamaihd.net
rapidsites.pro reklama1.ru
rebrand.ly repeatlogo.co.uk
rebuildermedical.com rff-cfal.info
recipedays.com ribieiendom.no
redhotfreebies.co.uk ric.info
refudiatethissarah.info risparmiocasa.bz.it
remont-komputerov-notebook.ru
restorator-msk.ru
ritlweb.com
rniaeba.ga
rubbed.us rubbed.us
scanner-elena.top ruf777.com
scanner-ivan.top runofilms.ru
scanner-olga.top ruscoininvest.company
rvi.biz
s1z.ru
salutmontreal.com
santechnik.jimdo.com
sbwealthsolutions.ca
scanner-andrew.top
scanner-barak.top
scanner-don.top
scat.porn scat.porn
searchinquire.com schlampen-treffen.com
searchtooknow-a.akamaihd.net se.bnt-team.com
semalt.com searchimpression.com
seocheckupx.com searchwebknow-a.akamaihd.net
seoexperimenty.ru seo-tools-optimizing.com
serialsway.ucoz.ru seo-traffic-ranking.info
servethis.com seorankinglinks.us
sex-tracker.com serdcenebolit.com
sexkontakte-seite.com sexblog.pw
sexy-screen-savers.com sexxdate.net
shemalegalls.blogporn.in shisha-swag.de
ship-marvel.co.ua sisiynas.ru
shodanhq.com site3.free-share-buttons.com
shop-electron.ru siteexpress.co.il
shop.xz618.com skylta.com
shtaketniki.kz smartshoppymac.com
sibtest.ru social-buttons.xyz
sildenafil-tadalafil.info social-s-ggg.xyz
simplepooltips.com social-s-iii.xyz
siteimprove.com sockshares.tv
sitevaluation.com
skachat-besplatno-obrazcy.ru
skincrate.net
slayerlife.com
slomm.ru
sluganarodu.ru
social-buttons.com
soda.media
soft-terminal.ru soft-terminal.ru
softlinesolutions.me spasswelt.xyz
solinf.co sport-video-obzor.ru
sonata-arctica.wz.cz squidoo.com
space-worry.ml sstroy44.ru
spamnuker.com steamoff.net
spb-plitka.ru stjamesschool.info
spl63.fr store-rx.com
sportbetfair.com studiofaca.com
spravka130.ru suchenindeutschland.com
spywarenuker.com supermodni.com.ua
spywarespy.com supernew.org
stretchmate.net surfbuyermac.com
stroiminsk.org surffoundation.nl
stroymonolit.su
sugarkun.com
supermesta.ru
supervesti.ru
surgut.zrus.org surgut.zrus.org
surintech.ac.th svbur.ru
swinger-mobil.net svolze.com
tacbibirfa.tk tabakur77.com
taranerymagesswa.blogspot.com tandvardshuset.net
telsis.com tasteidea.com
tengohydar.tk teenporn18.net
thecounter.com telefonsex-ohne0900.net
thaisamkok.com
the-usa-games.blogspot.com
thedownloadfromwarez.blogspot.com thedownloadfromwarez.blogspot.com
tiens2010.ru thenews-today.info
tizanidine4mgstreetvalue.blogspot.com tizanidinemusclerelaxant.blogspot.com
tizanidinewithdrawalsymptoms.blogspot.com tizanidinepain.blogspot.com
tizanidinesideeffects.blogspot.com
tizanidinevsvalium.blogspot.com
tomatis.gospartner.com tomatis.gospartner.com
tomck.com toon-families.com
torrents-tracker.com topcasinoratings.ru
torrnada.ru touchmods.fr
track-rankings.online toyota.7zap.com
traffmonster.info tradedeals.biz
trustaffs.com traffic-club.info
ttrraacckkrr.com tryrating.com
tuckpointingmasonrysystems.com tuberkuleznik.ru
turizmus.us
turvgori.ru turvgori.ru
u555u.info twittrading.com
ucoz.ru tx41tclega.ru
universals.com.ua tzritel.tk
unpredictable.ga ugogo.info
upstore.me ukrtextbook.com
uptime-gamma.net umnovocaminho.com
urlcut.ru unece.org
ussearche.cf unlimitdocs.net
vchulkax.com unrealcommander.org
vegascosmetics.ru uptime.com
viagengrarx.com uroki.net
viagra-soft.ru urzedowski.eu
videochat.cafe usbggettwku.ga
videosbox.ru veselokloun.ru
videositename.com via-energy-cumpara.com
villakohlanta.nu video-woman.com
vinsit.ru vkontarkte.com
virtualbb.com vsdshnik.com
vitanail.ru vseigru.one
vizag.kharkov.ua vsesubwaysurfers.com
voluumtracker1.com vykup-avto-krasnodar.ru
vseigry.fun wallpapers-best.com
vut.com.ru watchmygf.net
wanker.us waysbetter.cn
wareseeker.com webix.me
watchdogs-2.ru webjam.com
webcamdevochka.com weblo.com
webkeyit.com
webmasterhome.cn
webpromotion.ae
website-analytics.online
website-speed-checker.site
websiteexplorer.info
webstatsdomain.org webstatsdomain.org
winwotgold.pl weburlopener.com
worldhistory.biz wedding0venues.tk
woweb.com.ua westermarkanjou.se
wstroika.ru whatistizanidinehclusedfor.blogspot.com
ww2awards.info wholesalejerseychinaoutlet.com
wholesalejerseysgaa.com
wildnatureimages.com
worldtraveler.world
wowas31.ucoz.ru
www.kabbalah-red-bracelets.com www.kabbalah-red-bracelets.com
x-diesel.org x-true.info
xbaboon.com xedserver.com
xkaz.org
xmlinde.com xmlinde.com
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xn----7sbifcamovvfggw9d.xn--p1ai xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xn----btbdvdh4aafrfciljm6k.xn--p1ai xn--80aikhbrhr.net
xn--b1addnj3cah.xn--p1ai
xn--c1acygb.xn--p1ai
xn--lifehacer-1rb.com xn--lifehacer-1rb.com
xnxx699.com xportvusbdriver8i.snack.ws
xtubeporno.net
xwatt.ru
xxlargepop.com xxlargepop.com
xxxkaz.org xxxsiterips.xyz
zaapplesales.blogspot.com yellocloud.be
zajm-zalog-krasnodar.ru yellowfootprints.com
zarajbuilders.com yougame.biz
ypmuseum.ru
yurgorod.ru
zarabiaj-dzis.pl
zero1.it
zhuravlev.info
zoogdinsney.com zoogdinsney.com
zryydi.com zscalertwo.net
zvooq.eu zygophyceous.womanstars.site

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
100dollars-seo.com 101billion.com
3xforum.ro 12u.info
51.la 178evakuator178.ru
6hopping.com 1stat.ru
aa9bd78f328a6a41279d0fad0a88df1901.com 4inn.ru
adrunnr.com 4senses.co
afftrack001.com 4ureyesonly.com
ageofclones.com 888.com
akita.kz 8gold.com
aktobe.xkaz.org adsfresh.men
albumsuper.info adsloads.com
alert-jdh.xyz adviceforum.info
anatomiy.com advocatemsk.ru
adzerg.com
agecheckadult.com
alfa9.com
allcredits.su
alphaforum.ru
amoi.tn
ananumous.ru
anapa-inns.ru
animalrank.com
animebox.com.ua
anniemation.com
apiitsthirteende-a.akamaihd.net apiitsthirteende-a.akamaihd.net
apple.com-webbrowsing-security.science arabseyes.com
aproposde.com arendas.net
as5000.com arius.tech
asmxsatadriverin.aircus.com arpelsreplica.xyz
asrv-a.akamaihd.net
asrvrep-a.akamaihd.net asrvrep-a.akamaihd.net
asseenontv.ru autotrends.today
asseenontvonline.ru awaybird.ru
autorn.ru azartniy-bonus.com
banan.tv azbuka-mo.ru
beachdriveblog.com babespcs.com
bensbargains.net balkanfarma.org
bestmouthwash.club balook.com
bbsoldes.fr
besthomemadepornsites.com
bigcareer.info bigcareer.info
blackplanet.com bingo8888.com
blavia.00author.com boc.kz
bmw-ark.ru bosman.pluto.ro
brothers-smaller.ru brianhenry.co
buy-forum.ru businescoop.men
buypanicdisorderpill.com buyparajumpers.online
buypuppies.ca cardul.ru
bytimedance.ru
candytiner.com
cartierlovestore.xyz cartierlovestore.xyz
cementaresearch.se cartiertrinity.xyz
chidporn.com cayado.snn.gr
civilwartheater.com cienum.fr
classicakuhni.ru
claytransformations.info claytransformations.info
clickaider.com cleanallspyware.com
compliance-barak.top clevernt.com
contentsexpress.com compliance-ivan.xyz
cookingmeat.ru consorzioilmosaico.org
cool-wedding.net converse.ddsoldes.fr
cornomase.win cscwtalkto.site
customcatchcan.com
customchocolate.business-for-home.com customchocolate.business-for-home.com
d0t.ru cutt.us
danashop.ru dcj-nn.ru
datsun-do.com detskie-konstruktory.ru
daydream-studio.ru dfwu1019.info
dbmkfhqk.bloger.index.hr dikqlyremy.info
decorationspcs.com discountbarbour.online
dengi-pod-zalog-nedvizhimosti.ru doctissimo.fr
digest-project.ru domainsatcost.com
digilander.libero.it downloads-whatsapp.com
downvids.net dvr.biz.ua
dwomlink.info dynainbox.com
ekaterinburg.xrus.org e-avon.ru
elektrozigarettekaufen1.devhub.com ecommerce-seo.org
elstal.com.pl eduserver.net
englate.com elektronischezigarettekaufen2.tumblr.com
eropornosex.ru elvenar.com
exchangeit.gq enginebay.ru
ezofest.sk extrabot.com
faracontrol.ir ezb.elvenmachine.com
ff30236ddef1465f88547e760973d70a.com ezigarettekaufen2.yolasite.com
fifa-coins.online f07.de
filefilter.weebly.com femdom.twiclub.in
firma-legion.ru forexunion.net
forpostlock.ru forodvd.com
forumprofi.de freza-sverlo.ru
fr-bearings.ru frustrated-favorable.gq
free-floating-buttons.com ftns.ru
free-stock-illustration.com gaming-journal.com
freelifetimefuckbook.com gazporno.com
freshberry.com.ua gok-kasten.net
fungirlsgames.net goodwinmetals.co
funtoonez.com guge.io
gaypornmovie.net
germetiki.com.ua
getdot.ru
go2jump.org
gosarhivrt.ru
grupografico-pilar.com.ar
gta-top.ru
guiadeserraazul.com guiadeserraazul.com
guigyverpo.cf gungamesz.com
gymi.name guod.me
gz2.bbsoldes.fr hamacapty.com
hermesreplica.win hd-film.pl
highland-homes.com healmytrauma.info
hobbyhuren24.net hem.passagen.se
ikritikimou.gr highspeed5.net
infobabki.ru hobild.net
innodgfdriverhm.aircus.com hostsshop.ru
innoslicon.com hotshoppymac.com
intellego.info humbmosquina.tk
investmac.com hydropump.su
janerikholst.se iloveitaly.ru
javrip.net incanto.in.ua
jikoman.info internet-apteka.ru
johannesburgsingles.co.za investyb.com
kareliatobacco.ru istanbulit.com
kartiniresto.com ivanstroi.ru
keywordsuggest.org jbl-charge.info
kimcurlrvsms.com jeremyeaton.co
krasivoe-hd.net kakadu-interior.com.ua
kretpicf.pw kambasoft.com
kvartir-remont.biz keki.info
lanasshop.ru keywords-monitoring-success.com
landoftracking.com kidskunst.info
kinofak.net
kinopolet.net
kndxbkdx.bloger.index.hr
knogg.net
konpax.com
koptims.tiu.ru
kuzinsp.ru
la-fa.ru
larutti.ru
lasvegaslockandsafe.com lasvegaslockandsafe.com
laxob.com lidoradio.com
lflash.ru lol-smurfs.com
lightinghomes.net lostaruban.com
lion.conboy.us louboutinreplica.xyz
lionking-1994.blogspot.com love-baby.cz
livingcanarias.com lumb.co
lockerz.com lunamedia.co
lsex.xyz manifestation.betteroffers.review
mabdoola.blogspot.com maridan.com.ua
magicplayer-s.acestream.net mcar.in.ua
maglid.ru medicineseasybuy.com
marinetraffic.com medmajor.ru
martlinker.com menstennisforums.com
medictube.ru mikrobiologies.ru
mini-modus.ru mmog-play.ru
mobplayer.ru moncleroutletonline.pw
moskva.nodup.ru moncleroutletonline.win
myhydros.org more-letom.ru
myindospace.com mp3downloadhq.com
myonigroup.com multgo.ru
national-today-winning-winner.club mybackgroundlandscape.blogspot.com
netanalytics.xyz myplaycity.com
obiavo.net november-lax.com
ofanda.com okel.co
officedocuments.net ooomeru.ru
olvanto.ru oranga.host.sk
onlainbesplatno.ru parlament.biz
onlinadverts.com petsblogroll.com
online-sbank.ru picscout.com
online.ktc45.ru piratecams.com
paramountmarble.co.uk piulatte.cz
perl.dp.ua pix-hd.com
petitions.whitehouse.gov pixelrz.com
pharmacyincity.com play-movie.pl
phormchina.com pokemongooo.ml
pills24h.com pooleroadmedicalcentre.co.uk
pogodnyyeavarii.gq popunder.net
popup-hgd.xyz pornoinn.com
porn-w.org priceg.com
pornosmola.info propranolol40mg.blogspot.com
pornosok.ru prostitutki-novgoroda.org
pornowarp.info
portside.xyz
potolokelekor.ru
powenlite24.ru
pozvonim.com
pretty-mart.com
professionalwritingservices15.blogspot.ru
pron.pro
prostitutki-kharkova.org
pushdata.sendpulse.com
quick-seeker.com
qwertty.net qwertty.net
rasteniya-vs-zombi.ru rank-checker.online
recipedays.com reelheroes.net
relatodelpresente.com.ar referencemoi.com
rennlist.com replica-watch.ru
responsive-test.net reyel1985.webnode.fr
rightenergysolutions.com.au rock-cafe.info
rn-to-bsn.com ruex.org.ua
roznica.com.ua rustic-quiver.win
rp9.ru sanjosestartups.com
s1z.ru sankt-peterburg.nodup.ru
see-your-website-here.com sarm.tk
seo-traffic-ranking.info savingsslider-a.akamaihd.net
sexphoto.site sbdl.no
ship-marvel.co.ua scanner-mark.top
shoppingmiracles.co.uk seeingmeerkat.com
si-unique.com seryeznie-znakomstva.ru
site-speed-checker.site sethrollins.net
snow.nvr163.com sexgalleries.top
softonicads.com shemalegalls.blogporn.in
sr-rekneskap.no site5.com
stroiminsk.org social-s-hhh.xyz
stroy-portal22.ru solinf.co
success-seo.com soserfis.com
surfbuyermac.com souvenir.cc
szucs.ru spammen.de
taaaak.com spanking.to
technika-remont.ru spy-sts.com
telesvoboda.ru srdrvp.com
thefotosgratis.eu steame.ru
threecolumnblogger.com sukarame.net
tizanidineformigraines.blogspot.com supers.com.ua
tizanidinehcl2mgtablet.blogspot.com superstats.com
tizanidinestreetprice.blogspot.com surcentro.com
toloka.hurtom.com tackletarts.co
toolsky.com takeflyte.com
track112.site telefonsexsofort.tk
tramadolandtizanidine.blogspot.com thaisamkok.com
tvory.predmety.in.ua thebluffs.com
twiclub.in thenetinfo.com
urengoy.pro thexart.club
urlopener.com tiens2010.ru
vapeface.club tizanidinewithdrawal.blogspot.com
videokrik.net tracklead.net
viteonlusarezzo.it traffic2cash.org
vysigy.su trailer.cinemaflix.website
vzlom-na-zakaz.com twodollarshows.com
wahicbefa31.soup.io tx41tclega.ru
wallpaperstock.net u555u.info
wdfdocando.com uamtrk.com
webnode.me uhdtv.website
weburlopener.com univerfiles.com
westermarkanjou.se unpredictable.ga
wma-x.com uptime-delta.net
worldoffiles.ru urldelivery.com
worldtraveler.world ventelnos.com
wormix-cheats.ru veopornogratis.xxx
wowas31.ucoz.ru vykup-avto-krasnodar.ru
wtsindia.in webpromotion.ae
www.jbetting.com website-datenbank.de
www.pinnacle-bets.com wetgames.ru
x-musics.com whatistizanidinehclusedfor.blogspot.com
x-stars.ru whereiskentoday.com
xkaz.org wleuaprpxuvr.ga
xmladserver.com ww2awards.info
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai x-lime.net
xn----btbdvdh4aafrfciljm6k.xn--p1ai x-true.info
xn----dtbndd4ae7eub.top xedserver.com
xnxxandxvideos.com xn--80aodinpgi.xn--p1ai
xtubeporno.net xnxx-n.com
xxxdatinglocal.us xtremeeagles.net
yaoguangdj.com xuki.us
xxxguitars.com
xzlive.com
yaminecraft.ru
yebocasino.com yebocasino.com
yoshkarola.zrus.org yoursite.com
youradulthosting.com ytmnd.com
yunque.pluto.ro zakazvzloma.com
zaim-pod-zalog-krasnodar.ru zakonobosago.ru
zeleznobeton.ru zawyna.ua
zhongwenlink.com zdesformula.ru
zmoda.hostreo.com
zzlgxh.com

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.61 0; 10.1.0.91 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3461 ### Version: V4.2022.11.3462
### Updated: Wed Nov 9 22:01:17 UTC 2022 ### Updated: Thu Nov 10 10:03:23 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3461 ### Version: V4.2022.11.3462
### Updated: Wed Nov 9 22:01:17 UTC 2022 ### Updated: Thu Nov 10 10:03:23 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##