404enemy
ADmantX
Abonti
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Anarchy
Anthill
Aspiegel
Atomseobot
BackStreet
Backlink-Ceck
BatchFTP
Brandwatch
Bytespider
ChinaClaw
CyotekWebCopy
Deusu
Digincore
Dispatch
Dotbot
ECCP/1.0
Ebingbong
Fimap
Flunky
G-i-g-a-b-o-t
GermCrawler
Gigabot
Gotit
GrapeFX
HEADMasterSEO
HaosouSpider
Heritrix
Image Fetch
Iskanie
IstellaBot
JennyBot
Jorgee
JustView
LeechGet
LieBaoFast
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Majestic SEO
MauiBot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Minefield
Mojeek
Morfeus Fucking Scanner
Needle
NetLyzer
Nmap
Page Analyzer
Pandalytics
Pi-Monster
PictureFinder
Pump
PxBroker
QueryN Metasearch
ReGet
RebelMouse
Recorder
ScanAlert
ScoutJet
ScreenerBot
SemrushBot
SeobilityBot
SiteExplorer
SiteSnagger
Snapbot
Sociscraper
Sogou web spider
SpaceBison
Spammen
SpankBot
Sqworm
SurveyBot
TeleportPro
Titan
Toata
Trendictionbot
WebImageCollector
Webalta
Whack
Xaldon WebSpider
arquivo-web-crawler
coccocbot
cohere-ai
crawler.feedback
facebookscraper
magpie-crawler
scalaj-http
sexsearcher
sitechecker.pro
sp_auditbot
webprosbot