V4.2021.11.2741 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
-01h4x.com
 360Spider
 80legs
+ADmantX
 AIBOT
-Abonti
-Aboundex
-Aboundexbot
 Acunetix
 AiHitBot
-Anarchy99
-Apexoo
+AlphaBot
+Anarchy
+Ankit
 Asterias
-AwarioRssBot
 BDFetch
-BackStreet
-Bandit
-BatchFTP
-Battleztar Bazinga
-BetaBot
-Bitacle
-Black Hole
+BLEXBot
+BackDoorBot
+Backlink-Ceck
+Barkrowler
+Bigfoot
 BlackWidow
 BlowFish
-BotALot
+Bolt
+Brandwatch
 Buck
-BunnySlippers
-CCBot
-CODE87
+Bullseye
 Calculon
+Cegbfeieh
+CensysInspect
 CheTeam
-CheeseBot
-Cliqzbot
-Cocolyzebot
-Cogentbot
-Craftbot
+Collector
+Copier
+Cosmos
 Crawling at Home Project
+CrazyWebCrawler
+Crescent
 CrunchBot
 Curious
-CyotekWebCopy
-DBLBot
 DIIbot
-DTS Agent
-DataCha0s
-DatabaseDriverMysqli
-Discoverybot
-DittoSpyder
+Deusu
+Devil
+DomCopBot
+DomainAppender
 DomainCrawler
-DomainStatsBot
-Domains Project
 Download Wonder
-Dragonfly
 Drip
+ECCP/1.0
+EMail Wolf
+Ebingbong
+EirGrabber
+Evil
 Exabot
 Express WebPictures
 ExtLinksBot
-Extractor
-Extreme Picture Finder
-Ezooms
-FDM
-FemtosearchBot
+EyeNetIE
+Firefox/7.0
+FlashGet
+Foobot
+Freeuploader
 FrontPage
+Fuzz
 FyberSpider
-Fyrebot
+G-i-g-a-b-o-t
 GT::WWW
-GalaxyBot
 GermCrawler
 GetRight
-GetWeb
-GoZilla
-GrabNet
-Grabber
-HEADMasterSEO
+Getintent
+Gigabot
+Go!Zilla
+Go-Ahead-Got-It
+GridBot
+HTTrack
 Harvest
-Havij
 Heritrix
-HybridBot
-IDBTE4M
-IDBot
+Humanlinks
+IRLbot
 Id-search
-Image Fetch
-InfoTekies
-Intelliseek
-InterGET
-InternetSeer
-JennyBot
+Image Sucker
+Indy Library
+InfoNaviRobot
+Internet Ninja
 JetCar
-Jetty
-JikeSpider
-Jorgee
+JustView
+Jyxobot
 Kenjin Spider
-Kinza
+Keyword Density
+Kozmosbot
+LNSpiderguy
 LWP::Simple
-Lanshanbot
+Larbin
+Leap
 LeechFTP
 LexiBot
+Lftp
+LibWeb
 LieBaoFast
-Lightspeedsystems
+Likse
 LinkWalker
-Linkbot
-LinkextractorPro
-LinksManager
+LinkpadBot
+LinqiaRSSBot
+LinqiaScrapeBot
 Lipperhey Spider
+Litemage_walker
+Lmspider
+Ltx71
 MFC_Tear_Sample
-MIDown tool
+MJ12bot
 MSFrontPage
-MarkMonitor
-Masscan
+MSIECrawler
+MTRobot
+Magnet
+Majestic-SEO
+Majestic12
+MarkWatch
 Mata Hari
-MeanPath Bot
+MauiBot
+Mediatoolkitbot
 MegaIndex.ru
-MicroMessenger
-Microsoft Data Access
-Minefield
-Mozlila
-Mr.4x3
-Msrabot
-NICErsPRO
+Microsoft URL Control
+Mojeek
+Mojolicious
+Morfeus Fucking Scanner
 NPbot
-Navroad
-NearSite
+Needle
+Nessus
+Net Vampire
+NetAnts
 NetLyzer
+NetMechanic
+NetSpider
+Nettrack
 NextGenSearchBot
+Nibbler
 Niki-bot
-Nikto
-NimbleCrawler
-Ninja
+Nimbostratus
 Nmap
-Not
 Nuclei
-Openvas
+OpenLinkProfiler
+Openfind
+OrangeBot
+OutfoxBot
+PECL::HTTP
 PHPCrawl
-POE-Component-Client-HTTP
-Page Analyzer
-PageAnalyzer
-PageGrabber
 PageScorer
+PageThing.com
 Pandalytics
-PeoplePal
-PictureFinder
-Piepmatz
-Pimonster
-Pixray
+Panscient
+Papa Foto
+PleaseCrawl
 Pockey
-Probethenet
+ProPowerBot
+PxBroker
 PyCurl
+QueryN Metasearch
+Quick-Crawler
 RSSingBot
 RankActiveLinkBot
-RankingBot
-Rankivabot
-RebelMouse
-RedesScrapy
+RankFlex
+RankurBot
+Re-re
+Reaper
+Recorder
 RepoMonkey
-RocketCrawler
-Rogerbot
-SBIder
-SEOkicks
-SEOlyticsCrawler
-SEOprofiler
-SMTBot
+SalesIntelligent
+ScanAlert
 Scanbot
-ScoutJet
-Screaming
-SemanticJuice
-Semrush
+Searchestate
 SeoSiteCheckup
-Site Sucker
-SiteCheckerBotCrawler
+SeobilityBot
+Siphon
 SiteLockSpider
-Sitebeam
+SiteSucker
 Siteimprove
-Snoopy
-SocialRankIOBot
-Sottopop
-SpaceBison
+SmartDownload
+Spbot
+SputnikBot
+Sqlworm
+Sqworm
 Stripper
-Szukacz
+Sucker
+SuperBot
+SurveyBot
+T8Abot
+Teleport
+TeleportPro
 Telesoft
-Telesphorep
+The Intraformant
+TheNomad
 Thumbor
+TightTwatBot
 Trendiction
-Trendictionbot
-Turingos
+True_Robot
 Turnitin
-TwengaBot
-Upflow
+Typhoeus
+URLy Warning
 V-BOT
-VeriCiteCrawler
-VidibleScraper
+Vagabondo
 Virusdie
-VoidEYE
-Voil
 Voltron
-WISENutbot
+WASALive-Bot
+WEBDAV
 WPScan
-WWW::Mechanize
-Wallpapers
+WWW-Collector-E
+WWW-Mechanize
 Wallpapers/3.0
 WallpapersHD
-Web Auto
 Web Collage
 Web Fetch
 Web Fuck
-Web Pix
 Web Sucker
-WebGo IS
-WebLeacher
-WebWhacker
-WebZIP
-WebmasterWorldForumBot
+WebAuto
+WebCollage
+WebEnhancer
+WebFetch
+WebFuck
+WebImageCollector
+Website Quester
+WebsiteExtractor
 WebsiteQuester
-Whack
 Whacker
 Who.is Bot
-WinHTTrack
+WiseGuys Robot
 Wonderbot
-Woobot
 Wprecon
-Xenu
-ZoomBot
-ZumBot
+Zauba
 adscanner
+autoemailspider
+check1.exe
+clark-crawler
 com.plumanalytics
-crawl.sogou.com
-evc-batch
+crawler4j
+dataforseo.com
+domainsproject.org
+eCatch
 instabid
 internetVista monitor
-ips-agent
 lwp-request
 lwp-trivial
-magpie-crawler
+meanpathbot
+mediawords
 netEstate NE Crawler
 pcBrowser
-probe-image-size
-ripz
-s1z.ru
-satoristudio.net
 scalaj-http
 seobility
-seoscanners
-seostar
-sexsearcher
-siteripz
-tAkeOut
-trendiction.de
-ubermetrics-technologies.com
+serpstatbot
+sogouspider
+sysscan
 voyagerx.com
 webgains-bot
-webmeup-crawler
-x09Mozilla
+webpros.com
+webprosbot
+x22Mozilla
 zauba.io
+zgrab