Directory File Count and Quota Management

Note

Quota management is a new feature added in v3.2.1.

Limit on the Number of Files in a Single Directory

Limits the number of files or directories within a single directory to avoid the occurrence of excessively large directories, which could exhaust the resources of MP nodes.

• The default limit for the number of children in each directory is 20 million, which can be configured with a minimum value of 1 million and no upper limit. If the number of children created under a single directory exceeds the limit, the creation fails.
• The configured limit value takes effect on the entire cluster and is persisted on the master.
• Full support requires upgrading the client, metadata node, and master to version 3.2.1.

Set Quota

curl -v "http://192.168.0.11:17010/setClusterInfo?dirQuota=20000000"

Note

192.168.0.11 is the IP address of the master, and the same applies below.

Parameter	Type	Description
dirQuota	uint32	Quota value

Get Quota Information

curl -v "http://192.168.0.11:17010/admin/getIp"

The response is as follows:

{
    "code": 0,
    "data": {
        "Cluster": "test",
        "DataNodeAutoRepairLimitRate": 0,
        "DataNodeDeleteLimitRate": 0,
        "DirChildrenNumLimit": 20000000,
        "EbsAddr": "",
        "Ip": "192.168.0.1",
        "MetaNodeDeleteBatchCount": 0,
        "MetaNodeDeleteWorkerSleepMs": 0,
        "ServicePath": ""
    },
    "msg": "success"
}

The DirChildrenNumLimit field is the directory quota value for the current cluster.

Edit on GitHub

Support Atomicity QoS Management