After some problem with our S3 provider, there was multiple errors with infinite loops of publish tasks (because some alter statement timeout during the S3 outage, which is fixed in 3.3.11 and 3.4.1 it seems, but we have not schedule an upgrade yet, we’re using 3.3.9) that was resolved by some copying/clone/drop of the tables/partitions.
Everything recovered fine, but I noticed in fe.warn.log there are still attemps of cleaning a residual job with a specific label like this.
failed to abort job: insert_XXXX
com.starrocks.common.LoadException: LoadJob YYYYY state COMMITTED, can not be cancelled
Using
select * from information_schema.loads
where LABEL = 'insert_XXXX'
I was able to find out that this is an insert job to the statistics database, but the TABLE_NAME is blank however.
How could I manually cancel this load job so that it does not shown in the log anymore so that it does not clutter important errors/warnings? Using
CANCEL LOAD from `_statistics_` where label = 'insert_XXXX;
does not work, it says “There is no uncompleted job which label is insert_XXXX” because the load is of “PREPARED” status, which is said in the docs that is not cancelable.
There are 3 load job that are stuck like this, here is the info of one
Name |Value |
--------------------+-------------------------------------------------------------------------------------------------------------+
ID |9609707 |
LABEL |insert_384ae4f6-07db-11f0-9654-92ee8cee7f22 |
PROFILE_ID | |
DB_NAME |_statistics_ |
TABLE_NAME | |
USER | |
WAREHOUSE | |
STATE |PREPARED |
PROGRESS |ETL:100%; LOAD:99% |
TYPE |INSERT |
PRIORITY |NORMAL |
SCAN_ROWS |0 |
SCAN_BYTES |0 |
FILTERED_ROWS |0 |
UNSELECTED_ROWS |0 |
SINK_ROWS |0 |
RUNTIME_DETAILS |{"backends": {}, "file_size": 0, "load_id": "", "task_num": 0, "txn_id": 40799670, "unfinished_backends": {}}|
CREATE_TIME |2025-03-23 11:37:37.000 |
LOAD_START_TIME |2025-03-23 11:37:37.000 |
LOAD_COMMIT_TIME | |
LOAD_FINISH_TIME | |
PROPERTIES |{"max_filter_ratio": 0, "timeout": 3600} |
ERROR_MSG | |
TRACKING_SQL | |
REJECTED_RECORD_PATH| |
JOB_ID |9609707 |