Proxy Configuration

Proxy is the proxy module, mainly responsible for message forwarding, volume allocation and renewal proxy, caching, etc., mainly to alleviate the service pressure of clustermgr.

The configuration of the proxy is based on the public configuration, and the following configuration instructions mainly focus on the private configuration of the proxy.

Configuration Instructions

Key Configuration

Note

Starting from version v3.3.0, Proxy node supports caching of volume and disk information.

Configuration Item	Description	Required
Public configuration	Such as service port, running logs, audit logs, etc., refer to the Basic Service Configuration section	Yes
host	Current host information, used for reporting to clustermgr for service discovery, for example, http://service_ip:bind_port	Yes
cluster_id	Cluster ID	Yes
idc	IDC ID	Yes
retain_interval_s	Renewal interval cycle, used in conjunction with the volume expiration time set by cm	Yes
init_volume_num	The number of volumes requested from clustermgr when starting up, set according to the size of the cluster	Yes
default_alloc_vols_num	The number of volumes requested from clustermgr each time, set according to the size of the cluster	Yes
mq	Kafka producer configuration	Yes
diskv_base_path	Persistent path for caching volume and disk information	Yes

All Configuration

{
  "heartbeat_interval_s": "Interval for sending heartbeat to Clustermgr. The heartbeat time is heartbeatTicks * tickInterval",
  "heartbeat_ticks": "Used in conjunction with heartbeat_interval_s",
  "expires_ticks": "",
  "diskv_base_path": "Local persistent path for caching information",
  "volume_capacity": "Capacity of memory volume information, default is 1M",
  "volume_expiration_seconds": "Expiration time of memory volume information, default is 0, which means no expiration",
  "disk_capacity": "Capacity of memory disk information, default is 1M",
  "disk_expiration_seconds": "Expiration time of memory disk information, default is 0, which means no expiration",
  "clustermgr": {
    "hosts": "List of clustermgr hosts, [`http://ip:port`,`http://ip1:port`]",
    "rpc": "Refer to the rpc LbClient configuration introduction"
  },
  "bid_alloc_nums": "Maximum number of bids that access can request from proxy each time",
  "host": "Current host information, used for reporting to clustermgr for service discovery, for example, http://service_ip:bind_port",
  "cluster_id": "Cluster ID",
  "idc": "IDC ID",
  "retain_interval_s": "Renewal interval cycle, used in conjunction with the volume expiration time set by cm",
  "init_volume_num": "The number of volumes requested from clustermgr when starting up, set according to the size of the cluster",
  "default_alloc_vols_num": "The number of volumes requested from clustermgr each time, access allocation requests can trigger",
  "retain_volume_batch_num": "The number of retain volumes in batches, which can relieve the pressure of a single retain, the default is 400",
  "retain_batch_interval_s": "Batch retain interval",
  "metric_report_interval_s": "Time interval for proxy to report running status to Prometheus",
  "mq": {
    "blob_delete_topic": "Topic name for delete messages",
    "shard_repair_topic": "Topic name for repair messages",
    "shard_repair_priority_topic": "Messages with high-priority repair will be delivered to this topic, usually when a bid has missing chunks in multiple chunks",
    "version": "kafka version, default is 2.1.0",
    "msg_sender": {
      "kafka": "Refer to the Kafka producer usage configuration introduction"
    }
  }
}

Example Configuration

{
  "bind_addr": ":9600",
  "host": "http://127.0.0.1:9600",
  "idc": "z0",
  "cluster_id": 1,
  "default_alloc_vols_num" : 2,
  "init_volume_num": 4,
  "diskv_base_path": "./run/cache",
  "clustermgr": {
    "hosts": [
      "http://127.0.0.1:9998",
      "http://127.0.0.1:9999",
      "http://127.0.0.1:10000"
    ]
  },
  "mq": {
    "blob_delete_topic": "blob_delete",
    "shard_repair_topic": "shard_repair",
    "shard_repair_priority_topic": "shard_repair_prior",
    "version": "0.10.2.0",
    "msg_sender": {
      "broker_list": ["127.0.0.1:9092"]
    }
  },
  "log": {
    "level": "info",
    "filename": "./run/logs/proxy.log"
  }
}

Edit on GitHub

Access Configuration BlobNode Configuration