on-run-end hook failed on Spark for concurrent dbt runs

[tinolyuu]

Describe the bug

Got this error when running multiple dbt models at the same time

Conflicting commit: {"timestamp":1727626311790,"operation":"DELETE","operationParameters":{"predicate":["true"]},"readVersion":21941,"isolationLevel":"Serializable","isBlindAppend":false,"operationMetrics":{"numRemovedFiles":"1","numRemovedBytes":"93969","numCopiedRows":"0","numDeletionVectorsAdded":"0","numDeletionVectorsRemoved":"0","numAddedChangeFiles":"0","executionTimeMs":"1736","numDeletionVectorsUpdated":"0","numDeletedRows":"2151","scanTimeMs":"1735","numAddedFiles":"0","numAddedBytes":"0","rewriteTimeMs":"0"},"engineInfo":"Apache-Spark/3.5.1 Delta-Lake/3.1.0","txnId":"4df3ddeb-e2ff-4653-86ed-a58a9d632eff"}

The error came from this query

delete from elementary.dbt_models where 1=1

To Reproduce

Run multiple dbt jobs in parallel