vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-07 13:10:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.03.2958 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-03-04 10:09:24 +00:00
parent 39f310c465
commit 806aac22d1
46 changed files with 87328 additions and 87328 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2957 #### Version: V4.2022.03.2958
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2957 #### Version: V4.2022.03.2958
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.03.2957 #### Version: V4.2022.03.2958
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10780
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.03.2957 #### Version: V4.2022.03.2958
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10784
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10784
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10784
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10784
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.24 0;
127.0.0.1 0; 127.0.0.1 0;

10784
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.24 0;
127.0.0.1 0; 127.0.0.1 0;

10784
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.24 0;
127.0.0.1 0; 127.0.0.1 0;

10784
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2957 2958

10784
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10784
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.114.15.107 0; 52.176.104.167 0;

10784
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.24 0;
127.0.0.1 0; 127.0.0.1 0;

10784
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.24 0;
127.0.0.1 0; 127.0.0.1 0;

10784
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.24 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.24 0;
127.0.0.1 0; 127.0.0.1 0;

10784
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.114.15.107 0; 52.176.104.167 0;

10784
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.114.15.107 0; 52.176.104.167 0;

10784
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.24 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
DittoSpyder Cogentbot
GrabNet LinqiaScrapeBot
Image Fetch NearSite
Ltx71 SEOkicks
Musobot Screaming
OrangeBot VB Project
SalesIntelligent Xaldon WebSpider
Spanner dataforseo.com
URLy Warning lwp-request
WebImageCollector seocompany.store

300
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404checker
80legs
ADmantX ADmantX
ALittle Client
Abonti
Aboundex
Aboundexbot
Acunetix Acunetix
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
Aipbot Aipbot
Alexibot
Alligator Alligator
AlphaBot Anarchie
Anarchy99 Anarchy99
Anthill
Apexoo Apexoo
Asterias Aspiegel
AwarioRssBot Atomseobot
Attach
AwarioSmartBot AwarioSmartBot
BLEXBot BBBike
BackDoorBot BackStreet
Backlink-Ceck BackWeb
Barkrowler Badass
BatchFTP BatchFTP
Battleztar Bazinga BetaBot
Bigfoot Bitacle
BlackWidow Blackboard
Blow
BlowFish BlowFish
BotALot Boardreader
Brandwatch Bolt
Buck Buddy
BuiltWith BuiltWith
Bullseye Bullseye
BunnySlippers BunnySlippers
BuzzSumo CCBot
CSHttp CSHttp
Calculon
CazoodleBot
CensysInspect CensysInspect
CheTeam CheTeam
CherryPicker CheeseBot
Cliqzbot ChinaClaw
Copier Citoid
Cosmos Cloud mapping
Cocolyzebot
Cogentbot
Craftbot Craftbot
CrazyWebCrawler Crescent
CrunchBot
DBLBot DBLBot
Demon DIIbot
Discobot DatabaseDriverMysqli
Dispatch Dispatch
DittoSpyder DittoSpyder
DnBCrawler-Analytics DnBCrawler-Analytics
Download Wonder DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Domains Project
Dotbot
EMail Siphon
EMail Wolf
EirGrabber
EroCrawler
Evil Evil
Exabot
ExtLinksBot ExtLinksBot
Extractor Ezooms
Extreme Picture Finder
EyeNetIE
FDM FDM
FHscan Firefox/7.0
FemtosearchBot Foobot
Flunky Freeuploader
FyberSpider FrontPage
Fyrebot
G-i-g-a-b-o-t G-i-g-a-b-o-t
GT::WWW Go!Zilla
GalaxyBot
GermCrawler
GetRight
GetWeb
Getintent
GoZilla GoZilla
Gotit HEADMasterSEO
Grabber HTTrack
GridBot Haansoft
HTTP::Lite
HaosouSpider
Harvest
Havij
Heritrix
Humanlinks Humanlinks
HybridBot
IDBTE4M IDBTE4M
Image Fetch IDBot
Image Sucker
IndeedBot
InfoNaviRobot InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja Internet Ninja
InternetSeer Iria
JamesBOT JOC Web Spider
JennyBot Jbrofuzz
JetCar
Jetty Jetty
JikeSpider
Jorgee
JustView JustView
Kenjin Spider Jyxobot
Keyword Density
Kinza Kinza
LWP::Simple
Leap Leap
Libwhisker LeechFTP
LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker LinkWalker
Linkbot Linkbot
LinkextractorPro Lmspider
Lipperhey Spider MFC_Tear_Sample
Litemage_walker MIIxpc
MSFrontPage MSFrontPage
MTRobot MTRobot
Mail.RU_Bot Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Mata Hari Mata Hari
Microsoft URL Control
Minefield Minefield
Mister PiX
Moblie Safari Moblie Safari
Mojolicious Mojolicious
MolokaiBot Morfeus Fucking Scanner
Mr.4x3 NICErsPRO
Name Intelligence NPbot
Navroad
Nessus
Net Vampire Net Vampire
NetAnts NetAnts
NetLyzer Nettrack
Netvibes Netvibes
NextGenSearchBot Nikto
Niki-bot
NimbleCrawler
Ninja
Nmap Nmap
Nuclei Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler OpenLinkProfiler
OpenVAS OrangeBot
OutclicksBot OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageGrabber
PageScorer PageScorer
PageThing.com
Pandalytics Pandalytics
Papa Foto Papa Foto
Pavuk
Petalbot Petalbot
Picscout PictureFinder
Piepmatz Piepmatz
Pimonster
Pixray Pixray
PleaseCrawl
Pockey Pockey
ProPowerBot Pump
ProWebWalker
Psbot
Pu_iN
PxBroker
QueryN Metasearch
RSSingBot RSSingBot
RankActive RankActive
RankActiveLinkBot RealDownload
RankingBot2
RankurBot
Reaper
RebelMouse
Recorder
RocketCrawler
SEOkicks
SEOkicks-Robot SEOkicks-Robot
Scanbot SEOstats
ScreenerBot ScanAlert
ScoutJet
Searchestate
SearchmetricsBot SearchmetricsBot
SemanticJuice SemanticJuice
Semrush
SemrushBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan Shodan
Siphon Siphon
SiteSnagger
Site Sucker Site Sucker
Sitevigil SiteExplorer
SlySearch SiteSucker
SpaceBison Sitebeam
Sqlmap Snoopy
SuperHTTP SocialRankIOBot
Sosospider
Spammen
SpankBot
SputnikBot
Sqworm
Sucker
Sucuri
Surfbot Surfbot
SurveyBot
Suzuran
Swiftbot Swiftbot
Szukacz
T0PHackTeam T0PHackTeam
T8Abot
TeleportPro TeleportPro
Telesoft Telesphorep
Telesphoreo TheNomad
TightTwatBot TightTwatBot
Toata Toata
Toweyabot
Tracemyfile Tracemyfile
Trendiction
Trendictionbot Trendictionbot
Turnitin TwengaBot
VB Project Twice
VCI UnisterBot
Voil Upflow
WBSearchBot VelenPublicWebCrawler
WPScan Voltron
WWW-Collector-E WASALive-Bot
WWWOFFLE
WallpapersHD
WeSEE
Web Enhancer
Web Fetch
Web Fuck
Web Sauger
Web Auto Web Auto
Web Collage
Web Enhancer Web Enhancer
Web Pix
WebAuto
WebCollage
WebFetch WebFetch
WebGo IS
WebLeacher WebLeacher
WebStripper
WebSucker WebSucker
WebZIP WebZIP
WebsiteQuester Webalta
Webster
Whack
Whacker
Widow Widow
WinHTTrack WiseGuys Robot
Wonderbot Wonderbot
Wprecon
Xaldon_WebSpider Xaldon_WebSpider
YoudaoBot
Zade Zade
Zeus
Zitebot
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
ZumBot ZumBot
arquivo-web-crawler adscanner
archive.org_bot
arquivo.pt
autoemailspider autoemailspider
backlink-check backlink-check
check1.exe clark-crawler
coccocbot
cognitiveseo cognitiveseo
com.plumanalytics crawler.feedback
eCatch dataforseo.com
gopher demandbase-bot
ips-agent
isitwp.com
iubenda-radar
lwp-request
lwp-trivial lwp-trivial
muhstik-scan muhstik-scan
oBot
page scorer page scorer
plumanalytics plumanalytics
polaris version ripz
probe-image-size
s1z.ru
scalaj-http
seobility
seoscanners seoscanners
seostar serpstatbot
sitechecker.pro
sogouspider sogouspider
spyfu spyfu
sysscan
tAkeOut tAkeOut
trendiction.de trendiction.de
ubermetrics-technologies.com webgains-bot
webmeup-crawler x09Mozilla
webprosbot
zauba.io

318
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider AIBOT
404enemy
80legs
ADmantX
ASPSeek ASPSeek
Acunetix Abonti
Aboundex
AfD-Verbotsverfahren AfD-Verbotsverfahren
Alexibot AhrefsBot
AllSubmitter AllSubmitter
Alligator Anarchy99
AlphaBot Ankit
Apexoo
Aspiegel
Asterias Asterias
BDCbot AwarioSmartBot
BacklinkCrawler BLEXBot
BackDoorBot
BackWeb
Badass Badass
Bandit Bigfoot
Battleztar Bazinga Bitacle
BetaBot BlackWidow
Blow Blow
Brandprotect Boardreader
Brandwatch
Buck Buck
BuiltBotTough
Bullseye Bullseye
BuzzSumo BuzzSumo
CATExplorador
CODE87 CODE87
CSHttp CazoodleBot
Cegbfeieh
CensysInspect
CheTeam CheTeam
CherryPicker ChinaClaw
Chlooe Citoid
Cliqzbot Claritybot
Collector Cloud mapping
Cogentbot
CopyRightCheck CopyRightCheck
Cosmos
Craftbot Craftbot
CrazyWebCrawler Crawling at Home Project
Curious Crescent
CrunchBot
Custo
CyotekWebCopy CyotekWebCopy
DIIbot DBLBot
DSearch DSearch
DTS Agent DTS Agent
Demon DatabaseDriverMysqli
Deusu
Devil
Digincore Digincore
Dispatch DigitalPebble
Dotbot Disco
Drip Discobot
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
Download Wonder
Dragonfly
ECCP/1.0 ECCP/1.0
EMail Siphon EMail Siphon
EasyDL EMail Wolf
EroCrawler EroCrawler
Express WebPictures ExtLinksBot
Extreme Picture Finder Extractor
Ezooms EyeNetIE
Fimap Fimap
Firefox/7.0 Firefox/7.0
FlashGet Fyrebot
Foobot GalaxyBot
FyberSpider
G-i-g-a-b-o-t
Genieo Genieo
GermCrawler
GetRight
GetWeb GetWeb
Gigabot Getintent
Gotit
GrabNet GrabNet
Grabber
Grafula
GrapeshotCrawler GrapeshotCrawler
GridBot HTTrack
HEADMasterSEO
HTTP::Lite
Harvest Harvest
Havij
Hloader
Humanlinks
IDBot
Iblog
Id-search Id-search
IlseBot
IndeedBot
Intelliseek
InternetSeer InternetSeer
Jbrofuzz Iskanie
JustView IstellaBot
Jyxobot JamesBOT
Keybot Translation-Search-Machine Jetty
LNSpiderguy JikeSpider
Leap Keyword Density
LeechGet Kinza
Libwhisker Lanshanbot
LinqiaScrapeBot LeechFTP
Lipperhey LieBaoFast
Lipperhey Spider LinkScan
LinkWalker
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
Litemage_walker
Ltx71 Ltx71
MIDown tool MIDown tool
MJ12bot
MSFrontPage
MSIECrawler
MTRobot MTRobot
Mag-Net Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
MarkMonitor
MarkWatch MarkWatch
Mass Downloader
Masscan
Mata Hari
MauiBot
MeanPath Bot MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
MicroMessenger MicroMessenger
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Mister PiX Minefield
MolokaiBot Mozlila
Morfeus Fucking Scanner Name Intelligence
Mr.4x3
NICErsPRO
NPbot
Nameprotect
NearSite
Needle Needle
Nessus Nessus
Net Vampire
NetAnts NetAnts
NetLyzer NetLyzer
NetSpider NetMechanic
NetZIP
Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler Ninja
Nikto
Nmap
Nuclei Nuclei
Nutch Octopus
Openfind Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas Openvas
OrangeBot
OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot PHPCrawl
POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageAnalyzer PageAnalyzer
PageThing.com PageThing.com
Pandalytics Panscient
Papa Foto Papa Foto
Pavuk
PeoplePal
Petalbot Petalbot
Picscout Picscout
Pimonster Probethenet
ProPowerBot Psbot
ProWebWalker
PxBroker
QueryN Metasearch QueryN Metasearch
Quick-Crawler RankActiveLinkBot
RSSingBot
RankFlex
RankingBot
Rankivabot Rankivabot
Recorder RealDownload
RedesScrapy SEOkicks-Robot
RepoMonkey SEOlyticsCrawler
Ripper
SEOkicks
SEOstats
SISTRIX
SMTBot SMTBot
ScoutJet SalesIntelligent
SearchmetricsBot ScanAlert
Semrush Scanbot
SentiBot Screaming
Seomoz ScrepyBot
Site Sucker Seekport
SemanticJuice
SeoSiteCheckup
SiteExplorer SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger Siteimprove
Sitevigil SlySearch
SmartDownload
Snake
Snapbot Snapbot
Sociscraper SocialRankIOBot
Sogou web spider Sogou web spider
Sosospider Spinn3r
SpaceBison Sqlmap
Spammen Sqworm
SputnikBot Stripper
Steeler Sucuri
SuperBot SuperBot
SurveyBot SuperHTTP
Swiftbot Surfbot
T8Abot T0PHackTeam
The Intraformant TeleportPro
TheNomad Telesoft
Thumbor TightTwatBot
Titan Toata
Toweyabot True_Robot
Turingos Turingos
TurnitinBot
TwengaBot TwengaBot
URLy Warning Typhoeus
VB Project URLy.Warning
VCI
Vacuum Vacuum
Vagabondo Voltron
VelenPublicWebCrawler WPScan
Voil WWW-Mechanize
WBSearchBot
WEBDAV
WISENutbot
Wallpapers
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE
Web Auto
Web Collage Web Collage
WebAuto Web Enhancer
Web Fetch
Web Sauger
Web Sucker
WebBandit WebBandit
WebReaper WebEnhancer
WebFetch
WebImageCollector
WebPix
WebStripper WebStripper
WebZIP
WebmasterWorldForumBot
Website Quester
Webster
Whack Whack
Whacker
Whatweb Whatweb
WiseGuys Robot
Wonderbot Wonderbot
Xaldon WebSpider Woobot
Xaldon_WebSpider
Xenu
Zauba
Zermelo
Zeus
Zitebot
ZmEu ZmEu
ZoomBot ZoomBot
adscanner ZoominfoBot
ZumBot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt
autoemailspider
check1.exe check1.exe
coccocbot clark-crawler
com.plumanalytics com.plumanalytics
dataforseo.com crawl.sogou.com
crawler4j
demandbase-bot demandbase-bot
evc-batch
facebookscraper facebookscraper
gopher
heritrix
instabid instabid
internetVista monitor internetVista monitor
iubenda-radar isitwp.com
lwp-request
lwp-trivial lwp-trivial
magpie-crawler
muhstik-scan
oBot oBot
pcBrowser
plumanalytics plumanalytics
s1z.ru s1z.ru
satoristudio.net
scalaj-http scalaj-http
scan.lol sexsearcher
siteripz siteripz
sogouspider sogouspider
spyfu spyfu
trendiction.com sysscan
voyagerx.com voyagerx.com
webgains-bot webgains-bot
webmeup-crawler webpros.com
x09Mozilla xpymep1.exe
zauba.io zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
4k-player.pl 8lufu.com
aproposde.com atofilms.com
capture-room.com bannerads.de
khadastoafarde.tk bigames.online
medosmotr-ufa.ru discountbarbour.online
renecaovillasale.online e-commerce-seo.com
scanner-margo.top epicbrogaming.com
thesmartsearch.net otbelivanie-zubov.com
vseigry.fun topcar-krasnodar.ru
yourtemplatefinder.com x-diesel.org

930
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1pamm.ru 000free.us
1qingdao.com 0912701309f8ce.com
2015god.org 1bet.com
404.mn 3dracergames.com
3xforum.ro
4webmasters.com 4webmasters.com
5-steps-to-start-business.com 76brighton.co.uk
7zap.com 7a2rnuey1tw9ar.ru
8jn.dating-app.ru a1security.com.ua
aa9bd78f328a6a41279d0fad0a88df1901.com
aa9d046aab36af4ff182f097f840430d51.com aa9d046aab36af4ff182f097f840430d51.com
aaronabel.com aaa38852e886ac4af1a3cff9b47cab6272.com
abcdefh.xyz above.com
abcdeg.xyz acc.eu.org
absugars.com actionnooz.com
adclickservice.com activecampaign.dreamhosters.com
aihelen.net adult-shop.com.ua
akama.com adultwebhosting.info
alarmobninsk.ru adviceforum.info
allknow.info advokateg.xyz
alltheviews.com affiliate-fr.com
ageofclones.com
aktivator-windows10.blogspot.com
alfabot.xyz
alkoravto.ru
all4invest.ru
allwidewallpapers.com allwidewallpapers.com
am15.net amateurgalls.com
amung.us amazingpic.net
an-donut.com an-donut.com
animebox.com.ua anaseracresar.tk
apibatbrowsecom-a.akamaihd.net android-vsem.org
appiq.mobi angry-fermi-7633.arukascloud.io
approved.su animal36.com
aproposde.com apartamentwroclaw.eu
apiitsthirteende-a.akamaihd.net
apimossnetinfo-a.akamaihd.net
apimountainbikei-a.akamaihd.net
apple.com-cleaner.systems
aramaicmedia.org
arquivo.pt
ascat.porn
asdfg.pro asdfg.pro
asiavirtualsolutions.com asscenihotosidea.blogspot.com
asophoto.com atelielembrancaqueencanta.com.br
atmovs.com atlant-auto.info
audiobangout.com atmagroup.ru
ausergrubhof.info aversis.net
autodo.info avtoarenda.by
autotrends.today azadnegar.com
aviav.org balans.shahterworld.org
avon-severozapad.ru bamo.xsl.pt
avtolombard-krasnodar.com bbsoldes.fr
avtovolop.ru beclean-nn.ru
awency.com
azazaporn.com
b2b-lounge.com
babosas.com
bang-hotties.com
bannerpower.com
bear.gotcher.us
bedcapdealers.com
benchmarkcommunications.co.uk
best-way.men best-way.men
bikini-image.com betterhdporn.com
biocn.dx.am bgviagrachrx.com
birzha-truda.eu bio-market.kz
bizzliving.com bio.trade-jp.net
blockety.co bitporno.sx
blog-hits.com bizcheapjerseyswholesalechina.com
boazpower.com biznesluxe.ru
brainboosting.club bmwhighperformers.com
brandbucket.com bolitgorlo.net
brimstonehillfortress.org boole.onlinewebshop.net
bugshoot.cn brainsandeggs.blogspot.com
builtwith.com brillianty.info
buqyxa.rincian.info browserprotecter.com
bus-offer.com btnativenav.com
butstrap.space buscarfoto.com
buy-loft.ru buy-forum.ru
buyscabiescream.com buyclomidonlaine.com
buytizanidineonline.blogspot.com buyessaynow.biz
buzzurl.jp
c-english.ru c-english.ru
cah.io.community c-gainsbourg.com
calcularpagerank.com callcafe.info
camdolls.com camel-beach.com
canvas.gloverid.site candytiner.com
canyougethighofftizanidine.blogspot.com carina-sy.de
cardsharp1.ru carrauterie.be
cartierwatch.xyz carson.getenjoyment.net
ccbill.com cartierloveringreplica.xyz
cdnnetwok.xyz cartierreplica.xyz
cenokos.ru ccjp.eu
ceotrk.com centraletermice.us
chinese-amezon.com charmstroy.info
chocolateslim-en-espana.com checkm8.com
citizenclsdriveri7.pen.io children-learningreading.info
clickpapa.com ciekawinki.pl
clickprotects.com citysecurity.nu
clksite.com clash-clans.ru
clmforexeu.com cleanpcnow.com
compliance-andrew.top clickcash.com
compliance-ivan.top clodo.ru
compliance-walt.top cmhomestayagency.com
compucelunlock.net com-cleaner.systems
cookie-law-enforcement-hh.xyz compliance-josh.top
copro.pw compliance-julia.top
crafthubs.com cornerstone-countertops.com
cryptoswap.biz cottageofgrace.com
cubook.supernew.org crackguru.tk
cxpromote.com crest-poloski.ru
danschawbel.com customboxes4less.com
dawlenie.com customcollegeessays.net
ddsoldes.fr cutt.us
deadlinkchecker.com cyclobenzaprinevstizanidine.blogspot.com
dealwifi.com cyprusbuyproperties.com
deniven.1bb.ru daretodonate.co
designdevise.com dayibiao.com
detoxmed24.ru den-noch24.ru
dimaka.info destinationrealestate.com
disruptingdinnerparties.com detsky-nabytek.info
djonwatch.ru dichvuvesinhhanoi.com
dktr.ru digilander.libero.it
dogclothing.store divatraffic.com
dojki-hd.com dnsrsearch.com
domainsphoto.com doctormakarova.ru
donna7753191.ru domaincrawler.com
dostavka-v-ukrainu.ru domini.cat
domznaniy.ru
dostavimvdom.ru
downloadkakaotalk.com downloadkakaotalk.com
doxysexy.com droidlook.net
dscaas.website drpornogratisx.xxx
duplicashapp.com earncash.com.ua
ec-file.info ec-file.info
ednorxmed.com edge.sharethis.com
ekaterinburg.xrus.org ee77ee.com
ekto.ee ekobata.ru
el-nation.com el-nation.com
electronicadirect.com elektronischezigarette2.mex.tl
elektir.ru empirepoker.com
elektronischezigarettekaufen1.myblog.de en.altezza.travel
eropho.net
erotik-kostenlos.net erotik-kostenlos.net
extads.net eshop.md
eyelike.com.ua espaceinventoristes.com
ezigarettenkaufen2.dreamwidth.org essayassist.com
f1nder.org etenininrade.ga
etur.ru
executehosting.com
ezigarettekaufen2.yolasite.com
ezigaretteshop.webs.com
fakehandbags.xyz
fanpagerobot.com fanpagerobot.com
fashionavenuegame.com farm26.ru
favorcosmetics.com fast-torrent.ru
faz99.com fba-mexico.com
fettefrauen.net fbdownloader.com
fickblock18.com fetlifeblog.com
fighrofacciufreesig.ga folowsite.com
filerockstar298.weebly.com forpostlock.ru
filesvine.com fortunejack.com
filmbokep69.com forum.tvmir.org
filmi-onlain.info free-traffic.xyz
finuse.com freecamdollars.com
flashbannernow.com freeuploader.ml
flashlarevista.com freevpn.space
flowwwers.com frequiry.com
forodvd.com froggytube.com
forum-engineering.ru frustrated-favorable.gq
forum.doctissimo.fr fuckbuddybestgilf.info
forums.toucharcade.com funnypica.com
free-floating-buttons.com fxund.us
free-laptop-reward.com gamezblox.com
free-share-buttons.top gaming-journal.com
freegamesplay.online gateway.zscalertwo.net
freetangodownload.com gay-file.com
funcrushgames.com ge0ip.org
gabeshop.ru germes-trans.com
gael-s.ru
galaxyflowers.ru
gameonasia.com
gayxperience.com
generalporn.org
getmiro.com getmiro.com
ghazel.ru gheus.altervista.org
girlgamerdaily.com given2.com
girls-ufa.ru glavprofit.ru
glcomputers.ru goldenggames.com
glicol.kz goodwinmetals.co
goldandcard.ru graphics8.info
goodwriterssales.com greamimgo.pw
gpirate.com gsasearchengineranker.space
growmyfunds.ca guildebzh.info
grtyi.com gungamesz.com
gyffu.com hacktougroup.ru
hauleddes.com handicapbathtubarea.com
hdimagegallery.net hatedriveapart.com
hdwallpapers-free.com heliko.no
hermesbracelets.xyz himgaws.pw
hidemyass.com homegardenlova.com
hitcpm.com hoporno.com
holidaypics.org houtings.xyz
home.myplaycity.com hoverboard360.es
homik.pw howmuchdoestizanidinecost.blogspot.com
hornymatches.com howtowhitenteethfast.xyz
hotel-mkad.ru iklysha.ml
hotloans.ru ilbe.club
houdom.net ilmexico.com
housediz.com ilte.info
housekuba.org
htmlcorner.com
https-legalrc.biz
husky-shop.cz
hyipmanager.in
iamsport.org
idealtits.net
ilikevitaly.com
imediadesk.com imediadesk.com
imguramx.pw imgarit.pw
immigrational.info imperia31.ru
incep.imagine-ex.co impresagaia.it
increasewwwtraffic.info interfucks.net
indo-export.ru investingclub.ru
infoupdate.org investyb.com
inome.com.ua iqbazar.ru
instakink.com irkutsk.zrus.org
interferencer.ru isitwp.com
internet-apteka.ru itsdp3.com
iplogger.org jagg.info
istmira.ru johnnyhaley.top
ix20.ru joyceblog.top
izoll.ru junketjuice.blogspot.com
jillepille.com jyvopys.com
justprofit.xyz kareliatobacco.ru
jwss.cc katjimej.blog.fc2.com
kambasoft.com keki.info
kanimage.com kinky-fetishes.com
keywordhouse.com kino-key.info
keywordsuggests.com kinohall.ru
kino-ecran.ru kladrus.ru
kinogonew.ru kolotiloff.ru
kinoplen.ru kovesszucs.atw.hu
kinostorm.net ks1234.com
klikbonus.com kustanay.kz
konica.kz kvartir-remont.biz
koopilka.com labelwater.se
kovrenok.ru landmania.ru
kraljeva-sutjeska.com laudit.ru
kreativperlen.ch legionalpha.com
kung-fu-ru.com likesdesign.com
kwzf.net
lacapilla.info
lacasamorett.com
lacave.ntic.fr
landinez.co
leboard.ru
lemon-ade.site
lenvred.org
levaquin750mg.blogspot.com
lexixxx.com
liky.co.ua liky.co.ua
lion.snapmap.us linkwithin.com
lirunet.ru lion.playtap.us
liupis.com listiseltemournlan.gq
localmatchbook.com locatellicorretor.com.br
lol-smurfs.com lrac.info
lonely-mature.com ltvperf.com
losangeles-ads.com
lostaruban.com
louboutinbooties.xyz
louboutinreplica.xyz
luckyday.world
luxmagazine.cf luxmagazine.cf
m1media.net lyngdalhudterapi.no
mafcards.ru lyrster.com
maranbrinfo.com.br mahnwachen-helfen.info
mail.allnews24.in
mainhp.net
manifestation.betteroffers.review
marcoislandvacations.net marcoislandvacations.net
marmotstore.online masserect.com
marsgatan.com master-muznachas.ru
maslenka.kz max-eclat.men
matchpal-a.akamaihd.net max-p.men
medicines-choice.com mebel-ekb.com
medtherapy.ru meccadumps.net
megaindex.ru mediaoffers.click
mini.7zap.com medicine-4u.org
mir-limuzinov.ru meds-online24.com
mirtorrent.net metallosajding.ru
mobifunapp.weebly.com mhi-systems.ru
minet.club
miniature.io
mir-business-24.ru
missis.top
mlf.hordo.win
mobilemedia.md
moesen-ficken.com moesen-ficken.com
mole.pluto.ro
monclerboots.xyz
moneyzzz.ru
monitorwebsitespeed.com monitorwebsitespeed.com
monsterdivx.com more-letom.ru
montredemarque.nl mostantikor.ru
mosrif.ru mozello.ru
mountainstream.ms mrcsa.com.au
mouselink.co musicspire.online
mrmoneymustache.com mxgetcode.com
mulberryoutletonlineeu.com my-aladin.com
multgo.ru mycaf.it
musezone.ru mydownloadengine.com
mustat.com myindospace.com
myplaycity.com mykings.pw
myseoconsultant.com mylida.org
narkologiya-peterburg.ru mymobilemoneypages.com
narkologiya-voronezh.ru mywallpaper.top
naughtyconnect.com namecrumilchlet.tk
nikitsyringedrivelg.pen.io new-apps.ru
nvformula.ru news-readers.ru
nfljerseyscheapbiz.us
niki-mlt.ru
nonews.co
nosecret.com.ua
nzfilecloud.weebly.com nzfilecloud.weebly.com
obsessionphrases.com o-dachnik.ru
odywpjtw.bloger.index.hr okel.co
offers.bycontext.com online-hit.info
office2web.com onstrapon.purplesphere.in
okout.ru oops-cinema.ru
oksrv.com openmultipleurl.com
one-gear.com page2rss.com
online-hd.pl pandroid.co
online-x.ru pb-dv.ru
onlyporno.ru pdamods.ru
onthemarch.co pdns.cz
optitrade24.com pensplan.com
orgasmus-virtual.com pepperstyle.ru
ownshop.win perm.xrus.org
oyster-green.com peugeot-club.org
paceform.com pics-group.com
panamaforbeginners.com picture-group.com
park.above.com pila.pl
partner-cdn.men piter.xrus.org
pc-services.ru piuminiita.com
pcgroup.com.uy plastjulgranar.se
perederni.net podshipniki-nsk.ru
picscout.com pontiacsolstice.info
pinstake.com popmarker.com
piratecams.com popugaychiki.com
pixshark.com porndl.org
pliks.pl pornhive.org
poem-paying.gq
pogruztehnik.ru
pomoc-drogowa.cba.pl
popserve.adscpm.net
popup-jdh.xyz
porno-play.net porno-play.net
pornohd1080.online pornoforadult.com
poshiv-chehol.ru pornokajf.com
preventheadacheguide.info pornokorol.com
privatbank46.ru pornoreino.com
pornosexrolik.com
powc.r.ca.d.sendibm2.com
pozdrawleniya.ru
prchecker.info
privatefx.all4invest.info privatefx.all4invest.info
produkto.net professionalwritingservices15.blogspot.ru
profitsport.club prombudpostach.com.ua
promoforum.ru prostitutki-astana.org
ptr.ruvds.com purplesphere.in
pukaporn.com purplestats.com
puserving.com
qld10000.net
quebec-bin.com
quelle.ru
questionmarque.ch
quickbuck.com quickbuck.com
ragecash.com raavidesigns.com
realnye-otzyvy.info radiodigital.co
redirlock.com rank-checker.online
registrationdomainsite.com ranking2017.ga
registry-clean-up.net rapevideosmovies.com
rapidsites.pro
ratemodels.net
razamicroelectronics.com
redirect.trafficreceiver.club
reeyanaturopathy.com
referencemoi.com
registry-cleaner.net registry-cleaner.net
reining.lovasszovetseg.hu renecaovillasale.online
remont-fridge-tv.ru resultshub-a.akamaihd.net
remontvsamare.su rff-cfal.info
research.ifmo.ru rosbalt.com.ua
responsinator.com runstocks.com
rewardpoll.com
rfserial.net
rimedia.org
rossanasaavedra.net
royalads.net
ru-mediaget.ru
rvi.biz rvi.biz
rvtv.ru sady-urala.ru
sabizonline.com sandhillsonline.com
saltspray.ru sardinie.us
sarahmilne.top savememoney.co.za
savingsslider-a.akamaihd.net sax-sex.com
sbtdesign.co.uk scanner-brian.top
scanner-alexa.top scanner-josh.top
scanner-don.top scripted.com
scanner-jack.top search-error.com
scrapinghub.com searchimage.co
screentoolkit.com searchkut.com
searchlock.com security60-e.com
selectads.men seksvideoonlain.com
seoboxes.com sel-hoz.com
seoholding.com semrush.com
seotoolsagency.com seorankinglinks.xyz
sexkontakteao.info serw.clicksor.com
sexkvartal.com sex-sex-sex5.com
shlyahten.ru shitmovs.com
sibtest.ru shmetall.com.ua
silvermature.net shopcheermakeup.info
shtaketniki.ru
simply.net simply.net
sirpornogratis.xxx site-auditor.online
siteaero.com sitevaluation.com
sitebeam.net skladvaz.ru
sitopreferito.it slavia.info
sivs.ru smadihome.com
skincrate.net smallseotools.com
skutecznetabletkinaporostwlosow.pl snip.to
skylta.com snworks.com
skytraf.xyz sobecjvuwa.com.ru
social-fun.ru socialtrade.biz
social-s-ggg.xyz softwaretrend.net
socialmonkee.com spacash.com
softlinesolutions.me specialfinanceoffers.com
spabali.org sport-video-obzor.ru
spl63.fr sport7777.net
sportbetfair.com stal-rulon.ru
sps-shop.com stardevine.com
spy-sts.com statoutlook.info
spymac.net
statustroll.com statustroll.com
stjamesschool.info steame.ru
strv.se stroilka.info
suhanpacktech.com stroiminsk.org
supermodni.com.ua stroy-portal22.ru
superstats.com sudexpert66.ru
surflinksmedical.com supers.com.ua
swinginwithme.ru svetodiodoff.ru
swiped.su swsociety.se
tamada69.com symphonyintegratedhealthcare.com
tattomedia.com taranerymagesswa.blogspot.com
tattooha.com taxi-v-eisk.ru
td-33.ru teenfuck.tv
thegolfclub.info telsis.com
thenews-today.info the-torrent-tracker.blogspot.com
thewomenlife.com thebestweightlosspills.ovh
thexart.club thedownloadfreeonlinegames.blogspot.com
tizanidine4mgprice.blogspot.com thepokertimer.com
tizanidine6mg.blogspot.com timeallnews.ru
tizanidineandcipro.blogspot.com timer4web.com
tizanidinefibromyalgia.blogspot.com titelhelden.eu
tizanidinehydrochloride4mgstreetvalue.blogspot.com tizanidineandgabapentin.blogspot.com
tizanidineorflexeril.blogspot.com tizanidinecapsules.blogspot.com
tn811.us tizanidineingredients.blogspot.com
tizanidinepain.blogspot.com
tizanidinesleepaid.blogspot.com
tizanidinestreetvalue.blogspot.com
todohr.com todohr.com
token-lab.org tongkatmadura.info
tomck.com top10-way.com
topappspro.com top10registrycleaners.com
topcasinoratings.ru torrents.cd
topshef.ru trackzapper.com
tradedeals.biz traffic2money.com
trafficfactory.biz trafficfactory.biz
trafficmania.com trkur.com
trk-4.net tryrating.com
tsyndicate.com tv-spoty.info
tubeline.biz ucsol.ru
tubo360.com ukr-lit.com
twu.com.ua ukrup.com
udayavani.com um-razum.ru
unpredictable.ga unlimitdocs.net
uogonline.com
uptime.com uptime.com
verymes.xyz urlcut.ru
uroki.net
usacasino.com
usadacha.net
usdx.us
uzporno.mobi
vacuumscleaner.com
valkiria-tk.ru
valuado.com
veopornogratis.xxx
vesnatehno.com
via-gra.webstarts.com
viberdownload10.com
videonsk.com
videositename.com videositename.com
viktoria-center.ru videotuber.ru
videtubs.pl
viel.su
vikistars.com
virtuagirl.com
virus-respirators.com virus-respirators.com
vkak.ru visitcambridge.org
voloo.ru vizag.kharkov.ua
voltrknc1.com vk-mus.ru
vksex.ru
volume-pills.biz
vonradio.com
vremya.eu
vsdshnik.com vsdshnik.com
vseigru.one vtcdns.com
vzubah.com vykupavto-krasnodar.ru
walkme.com wait3sec.org
walpaperlist.com wanker.us
waterefficiency.co wareseeker.com
webadvance.club waterpurifier.club
webshoppermac.com wdrake.com
website-analyzer.info webpromotion.ae
website-speed-up.site westen-v.life
websiteaccountant.de whengirlsgowild.com
websitevaluebot.com wieseversa.no
weclipart.com wingsoffury2.com
whatistizanidine2mg.blogspot.com womama.ru
whatsappbot.flyland.ru wormix-cheats.ru
whipme.yopoint.in ww1943.ru
wikes.20fr.com
witclub.info
woman-orgasm.ru
woodyguthrie.se
world-mmo.com
wosik-dach.service-for-web.de
wsgames.ru
wstroika.ru
www.labves.ru
www.pinnacle-bets.com
www.timer4web.com www.timer4web.com
wygraj-teraz.com x-diesel.info
wyniki-lista.pl x-musics.com
x-diesel.com xn--b1agm2d.net
xcc24.pl xn--d1aifoe0a9a.top
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai yaderenergy.ru
xn----8sbdbjgb1ap7a9c4czbh.xn--p1acf yeartwit.com
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai youdesigner.kz
xnxx-n.com yourdesires.ru
xnxxandxvideos.com yourporn.com
xvideosbay.com ypmuseum.ru
xzlive.com yubikk.info
yogamatsexpert.com zagadki.in.ua
yoshkarola.zrus.org zarabiaj-dzis.pl
you-shall-not-pass.is74.ru zarenica.net
youporn-forum.ga zeikopay.com
yoursearch.me zetgie.com.pl
yourserverisdown.com
ytmnd.com
zaimhelp.ru
zambini.ru
zdesformula.ru
zeroredirect1.com
zigarettenonlinekaufen2.drupalgardens.com zigarettenonlinekaufen2.drupalgardens.com
zionstar.net zmoda.hostreo.com
znaturaloriginal.com znakomstva-piter78.ru
zone-kev717.info zona-aqua.ru
zoompegs.com
zverokruh-shop.cz
zvezdagedon.ru

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00author.com 1001watch.com.ua
2girls1cup-free.com 1flag.co.za
4senses.co 24-ak.ru
5000-cotydzien.com 28n2gl3wfyb0.ru
51unlim.ru 2daytrendingnews.com
7minuteworkout.com aasoldes.fr
8jn.dating-app.ru adrunnr.com
999webdesign.com adult-shop.com.ua
a14download.com ald2014.org
acmebtn.ml alltheviews.com
adnotbad.com amazon-adsystem.com
adpremium.org amehdaily.com
aimayangzhi.com amoi.tn
alarmobninsk.ru amyfoxfitness.com
albumsuper.info android-vsem.org
all4invest.ru animenime.ru
allblogroll.com apidigidocketnet-a.akamaihd.net
amateurlivechat.org apilinkswiftco-a.akamaihd.net
andpolice.com apptester.tk
animaltoplist.com arabseyes.com
anti-virus-removal.info arvut.org
apartmentratings.com asseenontv.ru
apiallgeniusinfo-a.akamaihd.net atofilms.com
apidiamondatanet-a.akamaihd.net avtochehli.by
apiluckyleapnet-a.akamaihd.net azadnegar.com
as5000.com azinoofficial777.ru
asdfg.pro barbourjackets.online
atelielembrancaqueencanta.com.br battleforupdating.site
auspolice.com begalka.xyz
aversis.net belstaffstore.online
b2b-lounge.com bestbrainprod.win
baladur.ru betshuckclean.com
balkanfarma.ru beyan.host.sk
bashtime.ru
bestprofits-there.com
besttorrentknifta.weebly.com
beta.hotkeys.com
betteroffers.review
bigcareer.info
billiard-classic.com.ua
bizcheapjerseyswholesalechina.com bizcheapjerseyswholesalechina.com
bizzliving.com bkgr.se
blobar.org bloggerads.net
bnt-team.com blogos.kz
bolegapakistan.com blogsfunky672.weebly.com
boazpower.com
bookhome.info
bosman.pluto.ro
bracketsmackdown.com
brandimensions.com brandimensions.com
brothers-smaller.ru brandov.ru
buttons-for-website.com brokergid.ru
buy-cheap-pills-order-online.com budilneg.xyz
candy-glam-hp.com burn-fat.ga
cartierjusteunclou.xyz buyparajumpers.online
cartierlovebracelet.xyz cakemediahq.com.au
cartierlovebraceletreplica.xyz callcafe.info
castingbank.ru callejondelpozo.es
cenoval.ru carabela.com.do
certifywebsite.win cartierbraceletsreplica.pw
cgi2.nintendo.co.jp cartierring.xyz
chocolateslim-en-france.com cercacamion.it
clickprotects.com checkhit.com
clmforexeu.com citizenclsdriveri7.pen.io
community.allhiphop.com cleanersoft.com
coolwallpapers4k.info click2pawn.com
d0t.ru co.lumb.co
daisye.top compliance-don.xyz
dekoration.us coslab.club
depositfiles-porn.ga customerguru.in
detective01.ru czat.wp.pl
div.as dairyindia.in
divku.ru date-withme.com
degerlund.net
dfwu1019.info
dieswaene.com
disruptingdinnerparties.com
documentbase.net documentbase.net
dogbreedspicture.net druzhbany.ru
dolohen.com eaplay.ru
domain2008.com elektir.ru
dostavimvdom.ru elektrischezigaretten2.beeplog.com
dosugrostov.site elektrozigarette2.webs.com
dpihatinh.gov.vn eloconcream.blogspot.com
enbersoft.com erectile.bid
exct.net f00kclan.de
ezigarettenshop2.myblog.de f0815.de
f1nder.org femmesdenudees.com
fealq.com findthe.pet
fickkontaktehobbyhuren.com fireads.men
financehint.eu flprog.com
forensicpsychiatry.ru
forexgb.ru
forum20.smailik.org forum20.smailik.org
franch.info forzeronly.com
frcls.fr foto-weinberger.at
free-fb-traffic.com fr.netlog.com
free-stock-illustration.com freefoto.ca
freejabs.com freetangodownload.com
go2jump.org fx-brokers-review.com
habermetre.com gallery.rennlist.com
hatedriveapart.com gateway.zscalerone.net
highland-homes.com gazoblok.net.ua
hkladys.com ge0ip.net
i-service.kz ge0ip.org
ideibiznesa2015.ru geileweiber.tk
indianmedicaltourismshop.com gembird.com
inome.com.ua gettpromos.com
global-ics.co.za
gotcher.us
gotomontenegro.net
gratis-sexkontakte.com
hannasolution.ru
hatdc.org
historichometeam.com
hop.clickbank.net
hothot.ru
hotloans.ru
housekuba.org
howtowhitenteethfast.xyz
hubbble.com
i-midias.net.br
ibb.com.ua
ideawheel.com
iflycapetown.co.za
ilovevitaly.com
insurple.com insurple.com
internetartfair.com internet-apteka.ru
investsuccess.org istripper.com
irkutsk.zrus.org itrevolution.cf
islandminingsupply.wordpress.com izhevsk.zrus.org
jasonpartington.com izismile.com
javatex.co.id kamen-e.ru
jyrxd.com karpun-iris.ru
kazan.zrus.org kinogonew.ru
kazka.ru koptims.tiu.ru
keywordspay.com kraljeva-sutjeska.com
kihi.gdn landreferat.ru
knowyournextmove.com lashstudia.ru
kosynka-games.ru lawyers.cafe
kovesszucs.atw.hu leadwayau.com
landscapebackgrounds.blogspot.com ledis.top
lemon-ade.site machicon-akihabara.info
lineavabit.it macotool.com
live-sexchat.ru malwareremovalcenter.com
lrac.info marsgatan.com
lsp-awak-perikanan.com mcnamaratech.com
magiadinamibia.blogspot.com meduza-consult.ru
magnetic-bracelets.ru meltwater.com
massage-info.nl microsearch.ru
medictube.ru mister-shop.com
merryhouse.co.uk moneyzzz.ru
midst.eu moskva.nodup.ru
minneapoliscopiers.com mrbitsandbytes.com
mirobuvi.com.ua muz-tracker.net
monetizer.com-01.site my-bc.ru
moneytop.ru my-cash-bot.co
morocco-nomad-excursions.com mydeathspace.com
mosrif.ru myfreetutorials.com
moviemail-online.co.uk myftpupload.com
musicvidz.ru
myghillie.info myghillie.info
narco24.me myliveblog.ru
naturalpharm.com.ua myxdate.info
netpics.org naj-filmy24.pl
nhl09.ru newhairstylesformen2014.com
nisuturnetdgu.tk newstraveller.ru
novodigs.com nikitabuch.com
omgtnc.com nonameread45.live
onclkads.com nudepatch.net
online247.ml oda.as
ozas.net offside2.5v.pl
palocco.it ohmyrings.com
parajumpersstore.online olympescort.com
pathwhelp.org omsk.xrus.org
pensplan.com online.ktc45.ru
perm.xrus.org ooomeru.ru
pijoto.net orgasmus-virtual.com
pladform.ru ostrovtaxi.ru
platezhka.net ourtherapy.ru
popcash.net pagesense.com
popmarker.com paramountmarble.co.uk
pornhive.org pdfprof.com
posible.net pinwallpaper.xyz
pr-ten.de piratecams.com
primedice.com plugingeorgia.com
priscilarodrigues.com.br porno-transsexuals.ru
promover.org prizefestival.mobi
pro-tec.kz
pronekut.com pronekut.com
prostitutki-almata.org putitin.me
prostitutki-kiev.org
prostitutki-yaroslavlya.org
pussysaga.com
pwwysydh.com
quebec-bin.com quebec-bin.com
quick-seeker.com rankscanner.com
rebelmouse.com reklama1.ru
refads.pro
remont-mobile-phones.ru
rezeptiblud.ru
ru-dety.ru ru-dety.ru
rutor.group rus-pornuha.com
rvi.biz s1z.ru
sakhboard.ru samo-soznanie.ru
salut-camp.ru
sarahmilne.top sarahmilne.top
satellite.maps.ilovevitaly.com sbf441.com
scanner-julia.top searchlock.com
seo-prof1.xyz searchwebknow-a.akamaihd.net
serviporno.com securityallianceservices.com
shama-rc.net seojokes.net
shitting.pro sexvporno.ru
shopfishing.com.ua sigmund-freud.co.uk
site3.free-share-buttons.com simplepooltips.com
smailik.org sisi-go.ru
smichovbike.cz site-speed-checker.site
social-buttons.com sitiz.club
social-s-ggg.xyz slavia.info
space2019.top social-fun.ru
space4updating.win sockshares.tv
stair.registrydomainservices.com soochi.co
staticfs.host sovetogorod.ru
stats-public.grammarly.io sovinsteel.ru
superoboi.com.ua sstroy44.ru
surfbuyermac.com streamin.to
suture.co sugarkun.com
swinger-mobil.net sureone.pro
tanieaukcje.com.pl the-torrent-tracker.blogspot.com
thaismartloan.com theguardlan.com
the-usa-games.blogspot.com theporndude.com
thebluffs.com tizanidineoral.blogspot.com
tizanidinecapsules.blogspot.com tjkckpytpnje.com
top250movies.ru tour-line.net
topsiteminecraft.com tracfone.com
toys.erolove.in tradedeals.biz
trackmedia101.com tubeoffline.com
trafficjunky.net tuberkulezanet.ru
ttsq.fr ucoz.ru
turbodsp.com ukrobstep.com
uchil.net
uggsale.online
uk-zheu20.ru
um-razum.ru
unimodemhalfduplefw.pen.io
unrealcommander.com unrealcommander.com
us-america.ru vacuumcleanerguru.com
usdx.us vadimkravtcov.ru
uvozdeckych.info velen.io
vabasa.inwtrade.com virtuagirl.com
valoresito.com virus-respirators.com
via-energy-order.com wcb.su
videotuber.ru webextract.profound.net
vltai.com wheelchairliftsarea.com
vrotike.ru wildworld.site
vvon.co.uk winx-play.ru
warezaccess.com writingservices17.blogspot.ru
weblo.com wwwadultcheck.com
website-speed-up.site x-lime.com
website-speed-up.top xgftnlrt.bloger.index.hr
weclipart.com xmladserver.com
whatsappdownload10.com xn----9sbubg3ambdfl1j.xn--p1ai
wstroika.ru xn--80atua3d.xn--p1ai
xcombear.ru xwatt.ru
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai youjizz.com
xn--b1agm2d.net za-fun-offer.com
xn--h1ahbi.com.ua za-music.mymobiplanet.com
xn--l1aengat.xn--p1ai
xz618.com
youjizz.vc
zakazvzloma.com
zaloadi.ru zaloadi.ru
zaloro.com zarajbuilders.com
zdesformula.ru zdesoboi.com
zigarettenonlinekaufen2.drupalgardens.com zeroredirect11.com
znakomstvaonlain.ru zeroredirect12.com
zophim.me zrus.org

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.24 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2957 ### Version: V4.2022.03.2958
### Updated: Thu Mar 3 22:01:15 UTC 2022 ### Updated: Fri Mar 4 10:03:31 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2957 ### Version: V4.2022.03.2958
### Updated: Thu Mar 3 22:01:15 UTC 2022 ### Updated: Fri Mar 4 10:03:31 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##