Let’s say we have a platform in which multiple clients perform operations with some log data which is stored in starrocks. I would like to bill them for the resource they used during performing queries. Is there any way I can get these parameters for all queries?
I would like to get:
- Total bytes read from the storage to process a query (like total bytes of data read from s3 backend or any other storage class across all nodes)
- Total memory consumed for execution of the query
- Total time consumed by the query
Out of these, query time is sorted. But for rest of the parameters, I have referred this documentation page: Query Profile Structure and Metrics | StarRocks
It has QuerySumMemoryUsage parameter which appears to be total memory consumed. Other parameters that I found on same page: BytesRead, FSIOBytesRead, DirectIOBytes. But I am confused which of these parameters refer to the parameter that I require.
Also how do I access them tabular format? On which table do I need to make query to obtain these results?