V4.2024.08.4681 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-AwarioBot
+Abonti
+Anarchie
+Anthill
 AwarioSmartBot
-BackWeb
-Backlink-Ceck
+BDCbot
+BacklinkCrawler
 Badass
-Bitacle
-Boardreader
-Bullseye
-BunnySlippers
-CazoodleBot
-ChatGPT-User
+BatchFTP
+Blackboard
+CODE87
 CheeseBot
+CherryPicker
 ChinaClaw
+Citoid
 Cloud mapping
-Copier
-Curious
-Custo
-Demon
+Cocolyzebot
+Crawling at Home Project
+DataCha0s
+Devil
+Digincore
 Dispatch
-Ebingbong
-EyeNetIE
-Fimap
-Freeuploader
-FyberSpider
-GalaxyBot
-Grabber
-Grafula
-HEADMasterSEO
-HMView
-Id-search
-InfoNaviRobot
-Internet Ninja
-JennyBot
-Jetty
-JikeSpider
-Jorgee
-Kinza
-LinkWalker
-Litemage_walker
-MQQBrowser
-MarkWatch
-MauiBot
-MeanPath Bot
+DomCopBot
+Domains Project
+ECCP/1.0
+FHscan
+Firefox/7.0
+GetRight
+Getintent
+Heritrix
+Kenjin Spider
+LeechGet
+Lightspeedsystems
+LinkextractorPro
+LinqiaMetadataDownloaderBot
+Ltx71
+Majestic SEO
+Masscan
 Meanpathbot
+Metauri
+Moblie Safari
 Mojeek
-Morfeus Fucking Scanner
-Mr.4x3
+Name Intelligence
 Nameprotect
 Navroad
-Octopus
-Offline Explorer
-Openfind
+Nessus
+Nettrack
+Netvibes
+Nibbler
+Nutch
+OutclicksBot
 POE-Component-Client-HTTP
-PageThing.com
-Pavuk
+Page Analyzer
+PageAnalyzer
+Pi-Monster
+Picscout
 Probethenet
-RealDownload
-SBIder
-SearchmetricsBot
-Seekport
-SeekportBot
+Pump
+RSSingBot
+RankActiveLinkBot
+Rankivabot
+Reaper
+RepoMonkey
+Rogerbot
+SEOstats
+SMTBot
+Scanbot
+SeoSiteCheckup
 SiteExplorer
-SiteSucker
-SmartDownload
-Snake
-Snapbot
-Sociscraper
+Siteimprove
+Snoopy
+SuperBot
 T8Abot
-TeleportPro
-TurnitinBot
-VB Project
-Virusdie
-WEBDAV
-WWW::Mechanize
-WallpapersHD
+Thumbor
+Toweyabot
+Tracemyfile
+Trendictionbot
+Turnitin
+UnisterBot
+Wallpapers/3.0
+Web Fetch
 Web Sucker
-WebBandit
-WebCollage
-WebImageCollector
-Webalta
+WebAuto
+Website Quester
 Webster
-Whack
-Whatweb
-Wonderbot
-Wotbox
 Wprecon
-Xaldon_WebSpider
-arquivo-web-crawler
-crawler.feedback
-evc-batch
-facebookscraper
-gopher
+Zauba
+ZmEu
+ZoomBot
+ZoominfoBot
+check1.exe
+domainsproject.org
 linkfluence
+mediawords
+s1z.ru
+seoscanners
+seostar
 serpstatbot
-sexsearcher
-sitechecker.pro
-spyfu
-voyagerx.com
-webpros.com
+trendiction.de
+webprosbot
 zgrab