V4.2023.05.3771 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-Acunetix
-Anarchy99
-Anthill
-BLEXBot
+01h4x.com
+360Spider
+404enemy
+80legs
+AiHitBot
+Asterias
+Attach
 Backlink-Ceck
 Barkrowler
-Battleztar Bazinga
-Calculon
-CheeseBot
-Chlooe
-Cliqzbot
-Cloud mapping
-DataCha0s
+BetaBot
+Brandprotect
+Brandwatch
+CATExplorador
+CSHttp
+Claritybot
+CopyRightCheck
+DBLBot
+DIIbot
+Dispatch
+DittoSpyder
 DomainCrawler
-FemtosearchBot
-GalaxyBot
+DomainSigmaCrawler
+EMail Siphon
+EasyDL
+Evil
+ExtractorPro
+FDM
+Firefox/7.0
+Flunky
+Freeuploader
+FrontPage
 GetWeb
-Go!Zilla
-Go-Ahead-Got-It
-Gotit
-GrabNet
-GrapeshotCrawler
-HEADMasterSEO
-Heritrix
-HonoluluBot
-IstellaBot
-JOC Web Spider
+Getintent
+Gigabot
+Harvest
+Image Sucker
+InfoTekies
+Intelliseek
+Internet Ninja
 JetCar
-LWP::Simple
-Leap
-Libwhisker
-Linkbot
+Lftp
+LibWeb
 LinkextractorPro
-Lipperhey Spider
-MJ12bot
-MarkMonitor
-Masscan
-MicroMessenger
-Microsoft Data Access
-Moblie Safari
-Mozlila
-NICErsPRO
-Needle
-NetMechanic
-Nettrack
-Nibbler
-NimbleCrawler
-Offline Explorer
+LinksManager
+Lipperhey
+Ltx71
+MFC_Tear_Sample
+Mag-Net
+Mr.4x3
+Nmap
+Nutch
+Octopus
+OnCrawl
+PECL::HTTP
+POE-Component-Client-HTTP
+Papa Foto
+Picsearch
 Pump
-Quick-Crawler
-SISTRIX
-ScanAlert
-Seomoz
-SiteSucker
-Sitevigil
-Snoopy
-Sociscraper
-Spammen
-Sqlmap
-Sucker
+QueryN Metasearch
+RealDownload
+SEOkicks-Robot
+ScoutJet
+ScrepyBot
+SeekportBot
+Sitebeam
+Snake
+SpaceBison
+Steeler
 SuperBot
-Teleport
-Titan
-Typhoeus
-UnisterBot
-VB Project
-Vagabondo
-VeriCiteCrawler
+Surfbot
+Telesoft
+Toata
+Trendiction
+URLy Warning
 Virusdie
-VoidEYE
-WWWOFFLE
+WeSEE
+Web Collage
+Web Enhancer
+Web Fetch
+Web Pix
 Web Sucker
-WebSucker
+WebBandit
+WebCollage
+WebLeacher
 WebWhacker
-WebsiteExtractor
-Whatweb
-WinHTTrack
-Wprecon
-Xaldon WebSpider
-Xaldon_WebSpider
+WebZIP
+Xenu
 Zeus
-ZmEu
-autoemailspider
-coccocbot
-cognitiveseo
-com.plumanalytics
-domainsproject.org
-eCatch
-facebookscraper
-gopher
-ips-agent
-linkdexbot
-lwp-trivial
-sexsearcher
-sp_auditbot
-trendiction.de
-webmeup-crawler
+ZumBot
+clark-crawler
+crawler4j
+dataforseobot
+isitwp.com
+meanpathbot
+pcBrowser
+seobility
+spyfu
+trendiction.com
 webpros.com
-webprosbot
-x09Mozilla
+zauba.io