vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 12:09:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.11.3452 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-11-05 10:09:30 +00:00
parent 43bf5fbc93
commit 16e1e4eb45
46 changed files with 94522 additions and 94522 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3451 #### Version: V4.2022.11.3452
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3451 #### Version: V4.2022.11.3452
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.11.3451 #### Version: V4.2022.11.3452
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11678
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.11.3451 #### Version: V4.2022.11.3452
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11682
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11682
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11682
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11682
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

11682
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

11682
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

11682
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3451 3452

11682
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11682
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
168.62.202.239 0; 20.172.155.249 0;

11682
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

11682
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

11682
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

11682
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
168.62.202.239 0; 20.172.155.249 0;

11682
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
168.62.202.239 0; 20.172.155.249 0;

11682
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 1; 10.1.0.130 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Alligator IDBTE4M
Boardreader Mass Downloader
LinkWalker OutfoxBot
MolokaiBot RankurBot
OpenLinkProfiler ScrepyBot
Snake VCI
Spanner WebPix
VidibleScraper oBot
Xaldon_WebSpider serpstatbot
ubermetrics-technologies.com sitechecker.pro

322
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404checker 404enemy
80legs
ADmantX ADmantX
Abonti ASPSeek
Aboundex
Aboundexbot Aboundexbot
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
Alligator
AlphaBot AlphaBot
Anarchy99 Anarchy99
Anthill
Asterias Asterias
AwarioSmartBot AwarioRssBot
BDFetch BDFetch
BLEXBot BLEXBot
BackDoorBot BackDoorBot
BackStreet BackWeb
Backlink-Ceck BacklinkCrawler
Battleztar Bazinga Bandit
Barkrowler
Bigfoot Bigfoot
BlackWidow Blackboard
BlowFish Blow
Bolt BotALot
BuiltWith Brandprotect
BuzzSumo Brandwatch
Buck
Bullseye
BunnySlippers
CATExplorador CATExplorador
CODE87
Calculon
Cegbfeieh Cegbfeieh
CensysInspect CensysInspect
CherryPicker Citoid
Chlooe Claritybot
Cocolyzebot CopyRightCheck
Cogentbot
Craftbot Craftbot
Curious Crawling at Home Project
Custo CrunchBot
DIIbot CyotekWebCopy
DSearch DBLBot
DTS Agent DTS Agent
DatabaseDriverMysqli
Demon
Deusu Deusu
Disco Digincore
Discoverybot Dispatch
DnBCrawler-Analytics DomCopBot
DomainCrawler DomainSigmaCrawler
Domains Project Domains Project
ECCP/1.0 Dragonfly
EasyDL Ebingbong
EirGrabber
EroCrawler EroCrawler
Express WebPictures Exabot
Extreme Picture Finder Ezooms
FHscan
FemtosearchBot
Fimap Fimap
Firefox/7.0
Flunky
Foobot
Freeuploader Freeuploader
G-i-g-a-b-o-t FrontPage
GT::WWW FyberSpider
Genieo Fyrebot
GermCrawler GalaxyBot
GetRight GetRight
Go!Zilla Gigabot
GoZilla GoZilla
Grabber Grabber
Grafula GrapeshotCrawler
GrapeFX GridBot
HEADMasterSEO HTTP::Lite
HTTrack
HaosouSpider
Harvest Harvest
Heritrix
Hloader Hloader
HybridBot
IDBot IDBot
IlseBot IRLbot
Image Sucker Id-search
IndeedBot IndeedBot
InfoTekies Intelliseek
InterGET
Internet Ninja Internet Ninja
InternetSeer Iria
JOC Web Spider Iskanie
JetCar JamesBOT
JikeSpider JennyBot
Jetty
Joomla
Jorgee Jorgee
JustView Kenjin Spider
Jyxobot Keybot Translation-Search-Machine
Kozmosbot Kozmosbot
LWP::Simple LNSpiderguy
Lanshanbot Lanshanbot
Larbin Larbin
LeechFTP Lftp
LeechGet
LibWeb LibWeb
LieBaoFast Libwhisker
Lightspeedsystems Lightspeedsystems
Likse LinkScan
LinkpadBot LinkextractorPro
LinksManager LinqiaMetadataDownloaderBot
Ltx71 LinqiaScrapeBot
MIDown tool Litemage_walker
MIIxpc Lmspider
MSFrontPage MJ12bot
MSIECrawler MQQBrowser
Magnet MTRobot
Mail.RU_Bot MarkMonitor
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Masscan
MauiBot
MeanPath Bot MeanPath Bot
Meanpathbot
Metauri Metauri
Microsoft URL Control Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mojeek
MolokaiBot MolokaiBot
Mr.4x3 NPbot
Msrabot NearSite
Musobot Nessus
Needle NetAnts
Net Vampire
NetMechanic NetMechanic
Netcraft NetSpider
Nettrack
NextGenSearchBot
Nibbler Nibbler
Niki-bot Niki-bot
Nimbostratus
Nmap Nmap
Not Nutch
Offline Explorer OpenVAS
Openfind OrangeSpider
PECL::HTTP PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer PageAnalyzer
PageScorer PageThing.com
Pandalytics Papa Foto
Panscient Petalbot
PeoplePal Picsearch
Pockey Pixray
Probethenet ProWebWalker
Pu_iN
Pump
PxBroker
PyCurl PyCurl
Quick-Crawler
RSSingBot RSSingBot
RankActive RankActive
RankActiveLinkBot RankActiveLinkBot
Rankivabot RankingBot2
RankurBot RealDownload
ReGet Reaper
Recorder Recorder
RepoMonkey
Ripper Ripper
RocketCrawler RocketCrawler
SEOlyticsCrawler SBIder
SISTRIX SEOstats
ScanAlert
Scanbot Scanbot
Scrapy
Searchestate
SearchmetricsBot
Seekport Seekport
SeoSiteCheckup Semrush
SemrushBot
SeobilityBot SeobilityBot
Seomoz Shodan
Siphon SiteLockSpider
SiteExplorer SiteSnagger
SiteSucker Sitebeam
SlySearch Sitevigil
Snake SmartDownload
Snapbot
Snoopy Snoopy
SocialRankIOBot
Sociscraper Sociscraper
Sottopop
SpaceBison SpaceBison
Spammen Sqlworm
Sqlmap
Sqworm Sqworm
Steeler Steeler
Sucker
Sucuri Sucuri
SuperBot SuperBot
Surfbot
SurveyBot SurveyBot
Szukacz
T0PHackTeam
TeleportPro TeleportPro
Telesoft Telesphoreo
Titan Telesphorep
TheNomad
Thumbor
TightTwatBot
Toweyabot Toweyabot
Tracemyfile
Trendictionbot
True_Robot True_Robot
Turnitin Turnitin
TwengaBot TwengaBot
Twice Twice
Typhoeus
URLy.Warning
UnisterBot UnisterBot
Upflow V-BOT
VB Project VCI
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie
VoidEYE VoidEYE
Voil Voil
WASALive-Bot WEBDAV
WISENutbot
Wallpapers Wallpapers
WallpapersHD WallpapersHD
Web Enhancer Web Pix
WebBandit Web Sucker
WebCollage WebPix
WebFetch WebSauger
WebFuck WebStripper
WebImageCollector WebmasterWorldForumBot
WebReaper Website Quester
WebZIP Whack
Webalta Widow
WiseGuys Robot
Wonderbot Wonderbot
Woobot
Wotbox
Wprecon
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider
Zauba Zauba
ZoominfoBot Zitebot
archive.org_bot ZmEu
autoemailspider ZyBorg
cah.io.community arquivo-web-crawler
clark-crawler clark-crawler
cognitiveseo coccocbot
com.plumanalytics
crawler4j crawler4j
dataforseo.com dataforseo.com
demandbase-bot domainsproject.org
eCatch
evc-batch evc-batch
facebookscraper instabid
gopher ips-agent
internetVista monitor linkdexbot
iubenda-radar
magpie-crawler
meanpathbot meanpathbot
mediawords mediawords
muhstik-scan
netEstate NE Crawler netEstate NE Crawler
oBot plumanalytics
page scorer
polaris version
s1z.ru s1z.ru
scalaj-http satoristudio.net
scan.lol
seobility seobility
seocompany.store seostar
seoscanners
serpstatbot
sitechecker.pro sitechecker.pro
siteripz
spyfu spyfu
trendiction.com webgains-bot
voyagerx.com webmeup-crawler
webprosbot webpros.com
x22Mozilla x09Mozilla
xpymep1.exe xpymep1.exe

308
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 360Spider
80legs 80legs
ADmantX
AIBOT
ALittle Client ALittle Client
Acunetix ASPSeek
Anthill Abonti
AhrefsBot
Aipbot
AllSubmitter
Anarchie
Anarchy99
Apexoo Apexoo
Aspiegel
Atomseobot Atomseobot
BBBike AwarioRssBot
BDFetch AwarioSmartBot
BLEXBot BDCbot
BackWeb BackWeb
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Badass
Bandit
Barkrowler Barkrowler
Bitacle Bigfoot
Black Hole
BlackWidow
Blackboard Blackboard
BlowFish BlowFish
BotALot Boardreader
Buck Bolt
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye Bullseye
BunnySlippers BuzzSumo
CSHttp
CazoodleBot CazoodleBot
CheTeam Cegbfeieh
CensysInspect
CheeseBot CheeseBot
ChinaClaw ChinaClaw
Chlooe Chlooe
Claritybot Citoid
Cliqzbot Cliqzbot
Cloud mapping
Cocolyzebot
Copier Copier
Craftbot CopyRightCheck
Curious Cosmos
Crescent
CrunchBot
Custo Custo
DBLBot DIIbot
DSearch
DataCha0s DataCha0s
Demon
Devil Devil
Digincore Digincore
Disco DigitalPebble
Discobot Dirbuster
DnBCrawler-Analytics
DnyzBot DnyzBot
DomCopBot
DomainCrawler
Dotbot Dotbot
Dragonfly Download Wonder
Ebingbong EMail Wolf
Exabot EasyDL
Express WebPictures EirGrabber
ExtLinksBot ExtractorPro
EyeNetIE
FDM
FHscan
Fimap Fimap
FlashGet Freeuploader
Flunky Fuzz
Foobot
FrontPage
GalaxyBot GalaxyBot
GetWeb Genieo
Getintent GrapeshotCrawler
GoZilla
Gotit
Grabber
Grafula
GridBot
HMView
HTMLparser
Haansoft
HaosouSpider HaosouSpider
Havij
Heritrix Heritrix
Hloader
HonoluluBot HonoluluBot
IRLbot IDBTE4M
Iblog
Id-search Id-search
Image Fetch IlseBot
IndeedBot Image Sucker
InternetSeer Indy Library
JOC Web Spider InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
Jbrofuzz Jbrofuzz
JetCar Jorgee
Jetty Jyxobot
JustView Kenjin Spider
Kinza LNSpiderguy
LWP::Simple LibWeb
Libwhisker Lightspeedsystems
LinkWalker LinkScan
Lipperhey LinkextractorPro
Lipperhey Spider LinkpadBot
Litemage_walker LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
MFC_Tear_Sample
MIIxpc MIIxpc
MQQBrowser MSIECrawler
MTRobot Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12 Majestic12
MarkMonitor
MarkWatch MarkWatch
Mb2345Browser Mass Downloader
MeanPath Bot
Meanpathbot
MegaIndex.ru MegaIndex.ru
Metauri Metauri
Microsoft Data Access Microsoft URL Control
Minefield
Mister PiX Mister PiX
Moblie Safari NICErsPRO
MolokaiBot
Name Intelligence Name Intelligence
Nameprotect NearSite
Navroad Nessus
Needle
Net Vampire Net Vampire
NetAnts
NetSpider NetSpider
Netcraft
Nettrack
Netvibes Netvibes
NextGenSearchBot
Nibbler Nibbler
NimbleCrawler Nimbostratus
Not
Nuclei
Octopus Octopus
Offline Explorer
Offline Navigator Offline Navigator
OpenVAS OpenLinkProfiler
Openfind Openfind
OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot
PHPCrawl
PageAnalyzer PageAnalyzer
Pandalytics PageGrabber
PeoplePal PageScorer
Pi-Monster Pimonster
Piepmatz PleaseCrawl
Pixray
Pockey Pockey
ProWebWalker ProPowerBot
Pump Psbot
Pu_iN
PxBroker PxBroker
PyCurl Quick-Crawler
RankActive RSSingBot
RankActiveLinkBot
RankFlex RankFlex
Rankivabot
RankurBot RankurBot
Reaper ReGet
RealDownload
RebelMouse RebelMouse
Recorder Recorder
RedesScrapy
Ripper Ripper
RocketCrawler RocketCrawler
SBIder SEOlyticsCrawler
SEOkicks-Robot
SEOprofiler SEOprofiler
SEOstats SMTBot
ScoutJet ScrepyBot
Scrapy Searchestate
Screaming Seekport
SemanticJuice
Semrush Semrush
SeobilityBot SentiBot
Shodan Seomoz
Siphon Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger SiteSnagger
SiteSucker
Sitebeam Sitebeam
Sitevigil
SlySearch SlySearch
SmartDownload SmartDownload
Snake Snake
SocialRankIOBot
Sociscraper Sociscraper
Spinn3r Sosospider
SpaceBison
Spanner
Spbot
SputnikBot SputnikBot
Sqlmap
Sqlworm
Sqworm Sqworm
SuperBot Stripper
Sucker
SuperHTTP SuperHTTP
SurveyBot
Szukacz Szukacz
T8Abot TheNomad
Telesphoreo Toata
Telesphorep
Thumbor
Titan
Toweyabot Toweyabot
Trendictionbot Trendictionbot
Turingos
TurnitinBot TurnitinBot
Twice TwengaBot
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
Upflow Upflow
V-BOT Vagabondo
VB Project
Vacuum
VelenPublicWebCrawler
Voltron Voltron
WASALive-Bot
WEBDAV WEBDAV
WISENutbot
WWW-Mechanize WWW-Mechanize
WWWOFFLE Wallpapers
Wallpapers/3.0 Web Collage
WeSEE Web Pix
Web Auto Web Sucker
Web Fetch WebAuto
WebBandit
WebCollage WebCollage
WebFetch
WebFuck WebFuck
WebImageCollector WebGo IS
WebReaper WebReaper
WebStripper WebSucker
WebZIP Webalta
WebmasterWorldForumBot
Website Quester Website Quester
WebsiteQuester WebsiteQuester
Whack Wotbox
Whacker
Who.is Bot
WinHTTrack
Woobot
Wprecon
Xaldon_WebSpider Xaldon_WebSpider
Xenu Xenu
Zermelo Zade
Zitebot Zauba
ZoomBot
ZoominfoBot
ZyBorg ZyBorg
archive.org_bot backlink-check
arquivo-web-crawler cah.io.community
check1.exe check1.exe
crawler.feedback coccocbot
dataforseo.com
domainsproject.org domainsproject.org
heritrix
ips-agent ips-agent
isitwp.com isitwp.com
magpie-crawler lwp-request
lwp-trivial
mediawords mediawords
polaris version oBot
probe-image-size pcBrowser
satoristudio.net
scalaj-http scalaj-http
seobility scan.lol
seocompany.store
seostar
serpstatbot serpstatbot
sexsearcher sexsearcher
sitechecker.pro sogouspider
siteripz
spyfu spyfu
sysscan tAkeOut
trendiction.com trendiction.com
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com
webmeup-crawler webmeup-crawler
webpros.com
webprosbot webprosbot
x22Mozilla
xpymep1.exe xpymep1.exe
zauba.io zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
2020iscoming.info compliance-jess.top
bannerswap.com digest-project.ru
earn-from-articles.com oda.as
expdom.com onlinefilmz.net
himgaws.pw pestomou.info
myfreemp3.eu porno-transsexuals.ru
privatefx-in.ru strangeduckfilms.com
quickbuck.com toursmaps.com
realizmobi.com wheelchairliftsarea.com
viagengrarx.com xitjw.info

934
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00author.com 0lovespells0.blogspot.com
100dollars-seo.com
123cha.com 123cha.com
12bet.com 1kdailyprofit.me
1314dh.com 1stat.ru
1flag.co.za 20pascals.nl
24videos.tv 23kw.ru
300richmond.co.nz 2drittel.de
3w24.com 2itech.ru
3xforum.ro 2pxg8bcf.top
4kepics.com 4ureyesonly.com
4webmasters.org 5u.com
66cpwgln.space 5ws.dating-app.ru
7search.com 70casino.online
abclauncher.com 7minuteworkout.com
abovetherivernc.com 8jn.dating-app.ru
activepr.ru a96527gi.beget.tech
adbetclickin.pink aa625d84f1587749c1ab011d6f269f7d64.com
adobereader-free.ru aa8780bb28a1de4eb5bff33c28a218a930.com
adprotect.net aac52006ec82a24e08b665f4db2b5013f7.com
ads.tremorhub.com aad1f4acb0a373420d9b0c4202d38d94fa.com
aero2.ru aanapa.ru
alert-hgd.xyz abctoppictures.net
alienwheel.es absolutelyanalog.com
allboard.xobor.de acunetix-referrer.com
altamayoztourism.com addbin.men
ameblo.jp addtoadd.men
aosheng-tech.com adhome.biz
apartmentbay.ru adman.se
api.stathat.com adrunnr.com
apibatbrowsecom-a.akamaihd.net adtech.fr
apilinkswiftco-a.akamaihd.net adtology.com
apple.com-cleaner.systems adult-shop.com.ua
approved.su advertisingtag.net
approvedlocal.co.za alarmobninsk.ru
alevinefesleri.com
allornamenti.com
aludecor.info
angel1777.kz
aosexkontakte.net
apartment.ru
apiadanaknet-a.akamaihd.net
apidigidocketnet-a.akamaihd.net
apiitsthirteende-a.akamaihd.net
apiportalmorecom-a.akamaihd.net
apiwoodensealcom-a.akamaihd.net
app-ready.xyz
appfixing.space
aproposde.com aproposde.com
arquivo.pt arcadeplayhouse.com
astana.xxxkaz.org arenda-yeisk.ru
atlant-auto.info arvut.org
australia-opening-times.com asacopaco.tk
autoseo-traffic.com atmagroup.ru
autoplate.info
avtovolop.ru
azadnegar.com azadnegar.com
bankmib.ru azartclub.org
bannerconnect.net babs.com.ua
badavit.com.ua
bannerspace.com bannerspace.com
beauby.ru basisches-wasser.net
bestcalovebracelet.cn beachfix.co
bestssaker.com beclean-nn.ru
bestwaystogetpaid.us beetpics.pw
benchmarkcommunications.co.uk
berdasovivan.ru
besthomemadepornsites.com
bestofferswalkmydogouteveryday.gq
bet-prognoz.com
betonka.pro betonka.pro
bezlimitko.xyz bezsporno.ru
bidbuy.co.kr bg6s0.com
bif-ru.info blackwitchcraft.ru
bingo8888.com blue-square.biz
bizfly.info bluesalt.co
bizru.info bookhome.info
bkgr.se bpro1.top
blackle.com braip.com.br
blavia.00author.com brandbucket.com
blog.f00kclan.de brianhenry.co
blpmovies.com
bmwhighperformers.com
boeuklad.com
bolegapakistan.com
bolitgorlo.net
book-bets.com
bosefux.esy.es
bravegirlsclub.com
briomotor.co
brus-vsem.ru
budilneg.xyz
budpost.com.ua budpost.com.ua
buketeg.xyz bumskontakte.org
bum.com.ru
bumascloset.com
burkesales.com burkesales.com
buttons-for-website.com businesxxl.com
buytizanidineonlinenoprescription.blogspot.com buzzonclick.com
buzzurl.jp bwlx.prepedu.cn
capacitacionyaprendizaje.com cacheimages.com
cardsharp1.ru callawaygolfstore.online
camdolls.com
canrioloadm.gq
carfax.com.ua carfax.com.ua
cashkitten-a.akamaihd.net cartierreplica.pw
caveavins.fr cartiertrinity.xyz
cbozhe.com cb.iphantom.com
cctva.tv cfacarrosserie74.com
cfcl.co.uk cheapbelstaff.online
cheapestjerseysonwholesale.com cheapsergiorossi.online
check-host.net checktext.org
chocolateslim-original.com chelnytruck.ru
choice-credit.ru christianlouboutinreplica.pw
cicaki.net cialgenisrx.com
cienum.fr cineacademy.ru
clean-start.net clickaider.com
clickintext.net
clicksor.net
clicksotrk.com clicksotrk.com
clubfashionista.com clickzzs.nl
coindirect.io clipartnew.com
compliance-alexa.xyz clmforexeu.com
compliance-don.xyz club-musics.ru
compliance-jack.top compiko.info
compliance-john.top compliance-elena.top
compliance-mary.top compliance-fred.xyz
coolgamechannel.com compliance-george.xyz
countbertwistdisp26.soup.io compliance-julianna.top
crafthubs.com concealthyself.com
cranly.net cracksplanet.com
creams.makeforum.eu creativehutindia.com
crynet.cc cscwtalkto.site
data.vtc.pw cubs-jerseys.us
dating-app.ru culad.com
custodieva.ru
custom-product-labels.com
dalavia.ru
daneshetabiat.com
dangphoto.trade
dataloading.net
daymusam.com daymusam.com
ddlmega.net dellalimov.com
defenderxtactical.com demian.kz
derevesendeco.com demon-tweeks.com
design-lands.ru detsky-nabytek.info
dieswaene.com deutschehobbyhuren.net
dikqlyremy.info deutschland123.de
dev-seo.blog
devochki.top
dfwu1013.info
dignitasdata.se
disruptingdinnerparties.com disruptingdinnerparties.com
divci-hry.info doktoronline.no
dlya-android.org dscaas.website
docs4all.com dynainbox.com
doeco.ru earn-from-articles.com
dogsrun.net easycommerce.cf
domaincdn.xyz
domainsatcost.com
domashneeruporno.com
donvito.unas.cz
doska-vsem.ru
dostavimvdom.ru
doxysexy.com
doyouknowtheword-flummox.ml
drunkmoms.net
dtnlyss.com
dumpsmania24.com
easync.io easync.io
eduserver.net ecommerce-seo.org
edwinkonijn.com.au el-nation.com
election.interferencer.ru
electro-prom.com electro-prom.com
elektrischezigaretten1.blogse.nl eleimgo.pw
elektrozigarette1.dreamwidth.org elektrischezigarette2.devhub.com
elidelcream.weebly.com elkacentr.ru
energydiet-info.ru elmacho.xyz
elstal.com.pl
englishdictionaryfree.com
envaseslotusama.com envaseslotusama.com
eorogo.top etenininrade.ga
erot.co eyemagination.com
esfchat.tk
este-line.com.ua
evening-dating-club.info
exct.net
extstat.com
ezrvrentals.com ezrvrentals.com
f-online.de f-online.de
face.hostingx.eu factorynightclub.com
failingmarriege.blogspot.com falcon-images.blogspot.com
fapgon.com feorina.ru
faz99.com figuringmoneyout.com
fefo.gdn
findanysex.com
findsexguide.com
finuse.com finuse.com
fishingwholesale.us firstdrugmall.ru
fitfloponline.store flagcounter.me
fivedwld.cf forum.poker4life.ru
flauntyoursite.com freakycheats.com
forensicpsychiatry.ru free-stock-illustration.com
forexunion.net freemags.cc
formulaantiuban.com
forpostlock.ru
forum69.info
foxtechfpv.com
free-video-tool.com
freenode.info freenode.info
freeuploader.com freewlan.info
freevpn.space friendflnder.com
freshberry.com.ua frustrated-favorable.gq
freshsuperbloop.com fuckmill.com
frivgame250.com gabeshop.ru
fsalas.com galaxys6manual.info
fuel-gas.com gay.adultgalls.com
funtoonez.com germes-trans.com
game-mmorpg.net getaclueamerica.com
game-top.su gheus.altervista.org
gamesprite.me gigapeta.com
gay-file.com gne8.com
gaytube.com
geckoandfly.com
gemara.com
gfaq.ru
globalsurfari.com
go2jump.org go2jump.org
golaya.pw gorabagrata.ru
goldadpremium.com gotwebsite1.com
google-liar.ru gowreckdiving.com
googlepositions.com greatgrace.ru
goroda-vsego-mira.ru gsmtlf.ru
gotomontenegro.net gta-top.ru
gourcy.altervista.org gunsvicceadadebt.tk
gribokstop.com gwebtools.com
grtyi.com gyffu.com
gsbs.com.ua h2monline.com
hacktougroup.ru hackers-crackers.tk
hannasolution.ru handicapvantoday.com
hd-film.pl hard-porn.mobi
help.tpu.ru hasshe.com
hetmanship.xyz heatpower.ru
heygidday.biz hem.passagen.se
hifidesign.ru hermesreplica.win
hoste.octopis.com hidefiles.org
hotxnights.info hmmm.cz
homeinns.com
homemade.gq
hoporno.com
housekuba.org housekuba.org
howtowhitenteethfast.xyz hybrid.ru
i-hobot.ru ictizanidinehcl4mg.blogspot.com
ido3.com ilbe.club
igru-xbox.net imgarcade.com
ilikevitaly.com imperia31.ru
imagecoolpub.com indianmedicaltourismshop.com
imagine-ex.co intimshop-fantasy.ru
immigrational.info ipchicken.com
in-tandem.co irkutsk.zrus.org
inboundlinks.win islamtoday.co.za
indiakino.net istizanidineanarcoticdrug.blogspot.com
indiasourcemart.in itsdp3.com
int.search.mywebsearch.com iweblist.info
intelhdgraphicsgtdrive6w.metroblog.com jav-fetish.site
iopeninghours.co.uk jav-idol.com
istmira.ru javxxx18.com
itis4you.com jaxcube.info
ixora.pro jerseysbizwholesalecheap.com
james13prix.info jo24news.com
janettabridal.com jobmarket.com.ua
kalandranis.gr joessmogtestonly.com
kamalsinha.com jolic2.com
kandidos.com jyrxd.com
karaganda.xkaz.org kaac.ru
kazka.ru kazinogames.lv
keenoutlet.online kenaba.su
kerwinandcariza.com kerwinandcariza.com
khadastoafarde.tk kfon.eu
khafre.us kinocccp.net
kiinomaniak.pl kinohit1.ru
kino2018.cc kinostorm.net
kino2018.club komputers-best.ru
kinobaks.com kumuk.info
kinoflux.net kung-fu-ru.com
kiwi237au.tk landreferat.ru
klin3952.ru letto.by
kmgamex.cf
knowsitall.info
konkursowo-24.pl
lapitec.eu
larger.io
laxob.com
lennatin.info
lescinq.com
letmacworkfaster.world
lflash.ru
lider-zhaluzi.kiev.ua lider-zhaluzi.kiev.ua
life-instyle.com likesuccess.com
lifeinsurancekb.com linkrr.com
lion.conboy.us lisque.batcave.net
lion.playtap.us lyrics.home-task.com
littlesunraiser.com m292.info
liumimgx.pw machicon-akihabara.info
live-sexchat.ru macotool.com
liveshoppersmac.com magnetic-bracelets.ru
loginduepunti.it mainlinehobby.net
lol-smurfs.com
lowephotos.info
machicon-ueno.info
makedo.ru
makis.nu
maladot.com maladot.com
malwareremovalcenter.com manuscript.su
manifestyourmillion.com map028.com
marketingtechniques.info mapquestz.us
mastershef.club mararoom.ru
matrixalchemy.com marcogrup.com
mcar.in.ua masserect.com
mebelcomplekt.ru master-muznachas.ru
meget.co.za max-p.men
mejoresfotos.eu mcnamaratech.com
mikrobiologies.ru medmajor.ru
mensandals.xyz
metafilter.com
microsearch.ru
mir-betting.ru
missis.top
mitrasound.ru
mobilemedia.md
mockupui.com
moinozhki.com moinozhki.com
moncleroutletonline.win monclercoats.xyz
mossmesi.com monetizer.com-01.site
most-kerch.org monsterdivx.com
moviezbonkerssk.cf morepoweronmac.trade
moz.com morocco-nomad-excursions.com
mrpornogratis.xxx movpod.in
msfsaar.de mp3ritm.top
musezone.su mrbojikobi4.biz
music7s.me mtmtv.info
musicdaddy.net musicvidz.ru
mybackgroundlandscape.blogspot.com muz-tracker.net
mydirtyhobby.com mydeathspace.com
myiptest.com myfreecams.com
mylovelibrabry.com myhealthcare.com
na15.ru mylesosibirsk.ru
news-speaker.com narkologiya-penza.ru
nikhilbahl.com netcheckcdn.xyz
nikitsyringedrivelg.pen.io newstraveller.ru
nmrk.ru nextlnk12.com
nosecret.com.ua nfljerseyscheapchinabiz.com
nw-servis.ru nfljerseysforsalewholesaler.com
obsessionphrases.com nicefloor.co.uk
offf.info nudepatch.net
oivcvx.website nvformula.ru
onlinemegax.com o-dachnik.ru
origin-my.ru oconto.ru
otbelivanie-zubov.com offer.camp
owohho.com olvanto.ru
one.net.in
onlinetvseries.me
onlythegames.com
optibuymac.com
osagonline.ru
paceform.com paceform.com
partner-host.men papasdelivery.ru
pateaswing.com partners-ship.pro
pawli.eu paydayloanslocal.com
paydayonlinecom.com pc-services.ru
pcgroup.com.uy picsearch.com
pearlisland.ru piluli.info
pensplan4u.com pixell.club
perso.wanadoo.es pixelrz.com
pic2fly.com pizdopletka.club
piccdata.com play-mp3.com
picswe.com polska-poezja.com
pix24x7.com poquoson.org
playfortuna-play.ru porn555.com
poffet.net porndairy.in
popserve.adscpm.net pornobrazzers.biz
popup.matchmaker.com pornohub.me
porno-chaman.info pornozhara.com
pornolook.net powenlite24.ru
pornophoto.xyz preparevideosafesystem4unow.space
pornosmola.info proftests.net
positive2b.ru progress-upakovka.ru
prchecker.info prostitutki-belgoroda.org
princeadvantagesales.com puzo2arbuza.ru
proekt-gaz.ru puzzleweb.ru
profitwithalex.info pyramidlitho.webs.com
profolan.pl pyrodesigns.com.au
prohoster.info q-moto.ru
prombudpostach.com.ua randki-sex.com
pron.pro ranksonic.info
proprostatit.com rednise.com
prostitutki-kharkova.org reeyanaturopathy.com
purplestats.com remont-ustanovka-tehniki.ru
putevka24.ru rniaeba.ga
qitt.ru
rada.ru
ragecash.com
realting-moscow.ru
reckonstat.info
remontgruzovik.ru
retreatia.com
ring4rhino.com
rockprogblog.com
rollercoin.com rollercoin.com
ru-dety.ru roofers.org.uk
rukino.org rozalli.com
russia-today-video.ru roznica.com.ua
russintv.fr ruscopybook.com
rusvideos.su
rutor.vip
s8-nowy-wygraj.comli.com s8-nowy-wygraj.comli.com
salmonfishingsacramentoriver.com saltspray.ru
salut-camp.ru sanatorrii.ru
saneyes.com savingsslider-a.akamaihd.net
sanjosestartups.com sbricur.com
saveindex.xyz sbwealthsolutions.ca
sbdl.no scanhub.ru
scanner-barak.top scanner-jess.top
scanner-jack.top scanner-julianna.top
scanner-margo.top scat.porn
scenicmissouri.us schoolfiles.net
scrapinghub.com scoopquest.com
scripted.com screentoolkit.com
search-error.com se-welding.ru
searchencrypt.com searchimage.co
see-your-website-here.com securityallianceservices.com
semalt.com seo-traffic-ranking.info
seminarykansas904.ml seonetwizard.com
semp.net seorank.info
semxiu.com serdcenebolit.com
senger.atspace.co.uk servicecenter.co.ua
seoexperimenty.ru seryeznie-znakomstva.ru
seorussian.ru sethrollins.net
sex-foto.pw sex-znakomstva.online
sex.hotblog.top sexiporno.net
sexspornotub.com sexkontakteao.info
sextracker.com sexpornotales.net
sextracker.de sexvporno.ru
shisha-swag.de sharpchallenge.com
shitting.pro shohanb.com
shoesonlinebuy.xyz sideeffectsoftizanidine.blogspot.com
signoredom.com similardeals.net
silvermature.net site-speed-checker.site
site-analyzer.com siteimprove.com
siteaero.com siteonomy.com
siteripz.net siteripz.net
skutecznetabletkinaporostwlosow.pl sitevalued.com
skylta.com sixcooler.de
skyway24.ru sklad-24.ru
sledstvie-veli.net skypasss.com
sluganarodu.ru slonechka.ru
smadihome.com sloopyjoes.com
social-button.xyz socas.pluto.ro
social-search.me social-s-ggg.xyz
sofit-dmd.ru sockshare.net
soft1.ru space-worry.ml
softtor.com special-porn.com
softwaretrend.net speechfoodie.com
solitaire-game.ru spy-sts.com
solution4u.com stop-gepatit.te.ua
splendorsearch-a.akamaihd.net stpicks.com
sportbetfair.com strag-invest.ru
spravka-medosmotr.ru strongholdsb.ru
sstroy44.ru students-cheapskate.ml
stackthatbucks.com success-seo.com
stairliftstrue.com sudexpert66.ru
star61.de sukirgenk.dvrlists.com
statustroll.com takethatad.com
stmassage.ru tarad.com
stop-zavisimost.com tattomedia.com
stopnarco.ru tattooha.com
stroydetali.ru td-33.ru
stuff-about-money.com teastory.co
superinterstitial.com teenfuck.tv
supermama.top tehngr.ru
swinon.site tetracsaudi.com
teenbbw.yopoint.in
testingads.pro
texbaza.by texbaza.by
thedownloadfromwarez.blogspot.com thexart.club
timeallnews.ru titelhelden.eu
tizanidine4mg.blogspot.com tizanidineandcipro.blogspot.com
tizanidineandhydrocodone.blogspot.com tizanidinesideeffects.blogspot.com
tizanidineforopiatewithdrawal.blogspot.com tjkckpytpnje.com
tizanidineoral.blogspot.com tmtrck.com
tizanidineshowupondrugtest.blogspot.com tn811.us
tizanidinewithdrawalsymptoms.blogspot.com tnctrx.com
tizanidinezanaflex.blogspot.com tonivedu.it
toproadrunner5.info topads.men
trafficmania.com topanasex.com
tula.howotorg.ru torrent-to-magnet.com
turist-strani.ru torrnada.ru
tvory.predmety.in.ua touchmods.fr
twitlinks.com tradedeals.biz
tzritel.tk trafficgenius.xyz
uggbootsoutletsale.us trahic.ru
ugguk.online ua.tc
uhod-za-sobakoj.ru ugogo.info
uhodzalijami.ru ukrtextbook.com
unisexjewelry.org uptime-gamma.net
unrealcommander.biz url-img.link
uptime-delta.net usswrite.com
vedomstvo.net varbergsvind.se
viandpet.com vesnatehno.com
video-chat.in vesnatehno.ru
viagra-soft.ru
videochaty.ru
vids18.site vids18.site
villakohlanta.nu vietimgy.pw
vizitki.net vigrx-original.ru
vod.com.ua virus-schutzmasken.de
voprosotvet24.ru visitcambridge.org
vrnelectro.ru viveresaniesnelli.it
vtc.pw vladimir.zrus.org
vvon.co.uk voluumtracker1.com
wallpapers-best.com vsexkontakte.net
wallpapersdesk.info vucms.com
wdrake.com w-journal.ru
webextract.profound.net wanker.us
webjam.com wareseeker.com
website-speed-check.site watchmyfb.pl
waysbetter.cn
web-analytics.date
webinstantservice.com
website-stealer.nufaq.com
webtherapy.ru webtherapy.ru
weburok.com weightatraining.com
wedding-salon.net
weekes.biz.tc
wellcome2slovenia.ru wellcome2slovenia.ru
westen-v.life whatistizanidine2mg.blogspot.com
whatistizanidinehclusedfor.blogspot.com wma-x.com
wheelchairliftsarea.com wordkeyhelper.com
wholesalecheapjerseysfree.com worldhistory.biz
wrz0iuebwhp5fg.freeddns.com worldlovers.ru
wstroika.ru worldmusicfests.com
wyniki-lista.pl wrona.it
x-mix.info ws.ampower.me
xclicks.net wsgames.ru
xn----itbkqkfiq.xn--p1ai www.timer4web.com
xxx-treker.ru www.wohnkabinen-shop.de
yebocasino.co.za wygraj-skiny.win
yoluxuryevents.com x-musics.com
you-shall-not-pass.is74.ru x5market.ru
youdao.com xaijo.com
youghbould.wordpress.com xblog.in
yoursearch.me xdoza.com
yugk.net xingzi-vision.com
xitjw.info
xmladserver.com
xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--b1addnj3cah.xn--p1ai
xn--b1ag5cfn.xn--p1ai
xnxx-n.com
yogamatsexpert.com
youandcredit.ru
youbrainboost.asia
youradexchange.com
youtubedownload.org
yugo-star.ru yugo-star.ru
zajm-pod-zalog-nedvizhimosti.ru zeroredirect8.com
zastroyka.org zeroredirect9.com
zawyna.ua zigarettenonl.canalblog.com
zdesoboi.com znakom.sibtest.ru
zeleznobeton.ru zone-kev717.info
zerocash.msk.ru zrelaya.pw
zygophyceous.womanstars.site zzbroya.com.ua

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
0c47f8422d3f.com 123locker.com
101billion.com 1webmaster.ml
2rich4bitches.com 40cg.com
34.gs 4webmasters.org
4rent.ru adssafeprotected.com
a.frcls.fr advertisingtag.net
abcdefh.xyz advokat-grodno.by
actionnooz.com agecheckadult.com
adclickthru.net albumsuper.info
adexprts.com alfa-medosmotr.ru
advocatemsk.ru alice.it
affordablewebsitesandmobileapps.com alpharma.net
aliexpresscashback.club amazon-adsystem.com
altamayoztourism.com amt-k.ru
analnoeporno.tv anticrawler.org
appmsr.org apilinkswiftco-a.akamaihd.net
aquarium-pro.ru architecturebest.com
arendakvartir.kz arendakvartir.kz
arendovalka.xyz arvut.org
asmxsatadriverin.aircus.com atlasvkusov.ru
autoseo-traffic.com autovideobroadcast.com
avitocars.ru avtovolop.ru
avtolombard-krasnodar.com bag77.ru
babosas.com bang-hotties.com
bankcrediti.ru bank.uz
bestempresas.es bankofthewext.com
bestpornuha.com bedandbreakfast.com
biglistofwebsites.com betterhdporn.com
blog.yam.com beztuberkuleza.ru
bloke.com bimmerpost.com
bmsco.co binaryoptionscops.info
brainzpod.win bonkers.name
bwlx.prepedu.cn bookmaker-bet.com
cam-kontakte.org buypuppies.ca
bvlgaribracelet.xyz
camdolls.com
candlewooddentalcentre.com.au candlewooddentalcentre.com.au
cartiertrinity.xyz chatroulette.world
casinorewards.info checkm8.com
celejihad.info chiblackhawks-jerseys.com
cercacamion.it chocolateslim-u-srbiji.com
cheapmoncler.xyz ciproandtizanidine.blogspot.com
chocolateslim-en-espana.com clash-clans.ru
clickbanksites.info clmforexeu.com
coccoc.com cntravelre.com
colehaanoutlet.store coin-hive.com
connectingsingles.com coindirect.io
costablue.xyz com-secure.download
crafthubs.com compliance-jane.top
customerguru.in compliance-nelson.top
cypernhuset.se connectionstrenth.com
damedingel.ya.ru continent-e.tv
dating-app.ru d0t.ru
design-lands.ru datsun-do.com
deutschland123.de dmmspy.com
digital-sale.su documentbase.net
dimkino.ru drunkenstepfather.com
dolohen.com drunkmoms.net
dverimegapolis.ru eas-seo.com
dvrlists.com elektrischezigarette2.onsugar.com
e-collantes.com elektrischezigaretten1.blogse.nl
ec-file.info elektronischezi.livejournal.com
electronicadirect.com englishgamer.com
emailaccountlogin.co epngo.bz
en.altezza.travel eshop.md
enhand.se eyelike.com.ua
enthuse.computernetworksonline.com ezb.elvenmachine.com
errorfixing.space f5mtrack.com
euroskat.ru fashion-stickers.ru
everypony.ru filmetricsasia.com
ezigarettekaufen1.hpage.com flowersbazar.com
ezigaretteshop2.vefblog.net forum.poker4life.ru
facialporntube.com franecki.net
favoritemoney.ru free-fbook-traffic.com
figuringmoneyout.com free-social-buttons.xyz
filkhbr.com freelinkbuilding.website.tk
fingerprintjs.com freshsuperbloop.com
foxinsocks.ru froggytube.com
fr.netlog.com fungamelands.com
freegamesplay.online gamblingnerd.com
freewebs.com gamebackyard.com
front.ru gotcher.us
fuckmill.com gotomontenegro.net
fuel-gas.com grand-chlen.ru
fungirlsgames.net greatdealshop.com
funnymama.com gsmtlf.ru
g.starmoe.xyz hatedriveapart.com
g7m.pl hchha.com
gabeshop.ru hikesearch.net
game-top.su histats.com
gateway.zscalerone.net hiwibyh.bugs3.com
getlaid-xxxhookupdirect.com homedo.fabpage.com
girlgamerdaily.com homemade.gq
gojiberriess.apishops.ru hosting-tracker.com
hledejvshopech.cz icaseclub.ru
hotblognetwork.com ideoworld.org
hoverboardforsaledirect.com
igithab.com
ilovevitaly.xyz
imagecoolpub.com
imagerydatabase.com imagerydatabase.com
inboxdollars.com indianmedicaltourismshop.com
increasewwwtraffic.info interfucks.net
iron-age.info interior-stickers.ru
isistaylorporn.info invitefashion.com
isoveti.ru istizanidineanopiate.blogspot.com
istripper.com iyasimasennka.com
ivearchenceinflu.cf jrcigars.com
iwantedmoney.com jyvopys.com
jerseychinabizwholesale.com kareliatobacco.ru
jo24news.com kiinomaniak.pl
keywordspay.com kino-rating.ru
kollesa.ru kino2018.cc
kongoultry.net knowsitall.info
kovesszucs.atw.hu krasula.pp.ua
krassh.ru lakomka.com.ua
kustanay.kz lalalove.ru
lacloop.info lanasshop.ru
ladsup.com lapolis.it
larger.io
law-check-two.xyz law-check-two.xyz
lego4x4.ru laxdrills.com
likesuccess.com lechenie-gemorroya.com
lincolntheatre.com lion.playtap.us
localflirtbuddies.com livefixer.com
lollypopgaming.com lob.com.ru
lotto6888.com loftdigital.eu
lowephotos.info lomb.co
mackeeper-center.club magicplayer-s.acestream.net
makenahartlin.com markjaybeefractal.com
matematikus.info max-p.men
misandesign.se maxthon.com
missis.top menetie.ru
modnie-futbolki.net meteocast.net
mole.pluto.ro mirtorrent.net
moneyteam24.com mirzonru.net
moskva.nodup.ru misswell.net
mp3downloadhq.com mnogolok.info
mrmoneymustache.com mojpreskumanie.com
mylovelibrabry.com most.gov.iq
na-telefon.biz my-floor.in.ua
neodownload.webcam mykings.pw
nerudlogistik.ru mypets.by
newsperuse.com myseoconsultant.com
nfljerseyscheapchinabiz.com netpics.org
offf.info new-apps.ru
ngps1.ru
okmusic.jp okmusic.jp
oranga.host.sk okroshki.ru
orion-v.com online-podarki.com
ourville.info oren-cats.ru
papasdelivery.ru otbelivanie-zubov.com
paphoselectricianandplumber.com paidonlinesites.com
par-fallen.ga pammik.ru
patterntrader-en.com partner-print.men
photostudiolightings.com
phuketscreen.com
picscout.com
pinapchik.com pinapchik.com
pistonclasico.com pladform.ru
pl-vouchers.com play.leadzupc.com
porto.abuilder.net polybuild.ru
prom23.ru popugaychiki.com
purplesphere.in pornhub-forum.ga
puserving.com porno-video-chati.ru
quick-seeker.com princeadvantagesales.com
rankscanner.com printingpeach.com
recipedays.com prosmibank.ru
refudiatethissarah.info prostitutki-belgoroda.org
remedyotc.com prostitutki-kiev.org
remont-komputerov-notebook.ru pyrodesigns.com.au
remontvsamare.su quangcaons.com
resellerclub.com raisedseo.com
richinvestmonitor.com rank-checker.online
rniaeba.ga realnye-otzyvy.info
rusenvironmental.net retailwith.com
samo-soznanie.ru rossmark.ru
sanatorrii.ru s1z.ru
saveindex.xyz satoristudio.net
sayyoethe.blogspot.co.za saugatuck.com
scanner-andrew.top
scanner-margo.top scanner-margo.top
scottbywater.com searchinquire.com
seansonline24.pl seasaltwithfood.com
seo-prof1.xyz seo-traffic-ranking.info
seorankinglinks.us seogadget.ru
sevendays.com.ua seotoolsagency.com
shoesonlinebuy.xyz sexreliz.com
shopperifymac.com sexsearch.com
silvermature.net shtaketniki.ru
simpoed.ufop.br si-unique.com
sispe.com.br sibtest.ru
sitechecker.pro skyway24.ru
slowmac.tech softtor.com
small-game.com sosdepotdebilan.com
snomer1.ru
social-buttons.xyz
sodexo.com
sport-video-obzor.ru
spravka130.ru spravka130.ru
star61.de staticfs.host
streetfooduncovered.com stillmiracle.com
stroymonolit.su studentguide.ru
suhanpacktech.com studiofaca.com
svetlotorg.ru styro.ru
svetodiodoff.ru success-seo.com
swinon.site superfish.com
tamada69.com swagbucks.com
technopellet.gr tattooha.com
teenporn18.net taximytishi.ru
template-kid.com teenbbw.yopoint.in
thecoolimages.net telefonsexkostenlos.tk
themestotal.com tiens2010.ru
theporndude.com time-japan.ru
topads.men tizanidine4mguses.blogspot.com
topsy.com tizanidineandhydrocodone.blogspot.com
touchmods.fr tizanidinesleepaid.blogspot.com
tradedeals.biz torontoplumbinggroup.com
truck-addzilla.life toys.erolove.in
tsan.net
tsyndicate.com
tula.mdverey.ru
tvory.predmety.in.ua
tvteleport.ru
udayavani.com
ultimateclassicrock.com
umg-stroy.ru umg-stroy.ru
unblocksit.es undergroundcityphoto.com
upstore.me uptimebot.net
vapsy.com uzporno.mobi
vektorpress.ru validdomain.xyz
veselokloun.ru vezuviy.su
viel.su viagraneggrx.com
visa-china.ru viddyoze.com
vodkoved.ru voloomoney.com
vzube.com vse-pesni.com
webscouter.net w-journal.ru
website-speed-checker.site webcamtalk.net
wholesalejerseychinashop.com weboptimizes.com
website-speed-up.site
website-stealer.nufaq.com
wemarketing.se
westermarkanjou.se
wildworld.site wildworld.site
woodyguthrie.se win-spy.com
www.pinnacle-bets.com wingsoffury2.com
xaijo.com wleuaprpxuvr.ga
xjlottery.com woman-tampon.ru
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai wrona.it
xnxxandxvideos.com ws.ampower.me
xolodremont.ru xaylapdiendanang.com
xxxasianporn.net xclicks.net
youraticles.pl xfire.com
yourdesires.ru xlovecam.com
yourothersite.com xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai
yoursearch.me youporn-ru.com
yourserverisdown.com yur-p.ru
yugk.net zazagames.org
zambini.ru zdesoboi.com
zdesformula.ru zigarettenonlinekaufen.tumblr.com
zebramart.ru znaniyapolza.ru
zeroredirect9.com zskdla.site
zirondelli.it
zoomovies.org
zrizvtrnpale.tk

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.3 0; 10.1.0.130 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3451 ### Version: V4.2022.11.3452
### Updated: Fri Nov 4 22:01:21 UTC 2022 ### Updated: Sat Nov 5 10:03:41 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3451 ### Version: V4.2022.11.3452
### Updated: Fri Nov 4 22:01:21 UTC 2022 ### Updated: Sat Nov 5 10:03:41 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##