crp-order-quantity-kpi-service - Details for Query 38614

Submitted Time: 2026/07/21 20:55:03
Duration: 1 s
Succeeded Jobs: 60372 60373 60374 60375 60376

Plan Visualization

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [id="node0" labelType="html" label=" AdaptiveSparkPlan " tooltip="AdaptiveSparkPlan isFinalPlan=true"]; 1 [id="node1" labelType="html" label="Execute InsertIntoHadoopFsRelationCommand task commit time: 289 ms number of written files: 1 job commit time: 455 ms number of output rows: 25 number of dynamic part: 1 written output: 36.4 KiB" tooltip="Execute InsertIntoHadoopFsRelationCommand hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000001445, false, [activityType#8533115], Parquet, [__partition_columns=[\"activityType\"], path=hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000001445], Append, [jobId, stageCount, totalTaskCount, minTaskCountPerStage, maxTaskCountPerStage, medianTaskCountPerStage, bytesSpilledToDiskSerializedTotal, bytesSpilledToDiskSerializedMin, bytesSpilledToDiskSerializedMax, bytesSpilledToDiskSerializedMedian, taskCpuTimeTotal, taskCpuTimeMin, taskCpuTimeMax, taskCpuTimeMedian, taskDeserializeCpuTimeTotal, taskDeserializeCpuTimeMin, taskDeserializeCpuTimeMax, taskDeserializeCpuTimeMedian, taskDeserializeTimeTotal, taskDeserializeTimeMin, taskDeserializeTimeMax, taskDeserializeTimeMedian, taskRunTimeTotal, taskRunTimeMin, taskRunTimeMax, ... 67 more fields]"]; 2 [id="node2" labelType="html" label=" WriteFiles " tooltip="WriteFiles"]; subgraph cluster3 { isCluster="true"; id="cluster3"; label="WholeStageCodegen (6)\n \nduration: 151 ms"; tooltip="WholeStageCodegen (6)"; 4 [id="node4" labelType="html" label="Sort sort time: 0 ms peak memory: 2.1 MiB spill size: 0.0 B" tooltip="Sort [activityType#8533115 ASC NULLS FIRST], false, 0"]; 5 [id="node5" labelType="html" label=" Project " tooltip="Project [coalesce(jobId#8533107, jobId#8533101) AS jobId#8533108, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, ... 67 more fields]"]; 6 [id="node6" labelType="html" label="SortMergeJoin number of output rows: 25 spill size: 0.0 B" tooltip="SortMergeJoin [jobId#8533107], [jobId#8533101], FullOuter"]; } subgraph cluster7 { isCluster="true"; id="cluster7"; label="WholeStageCodegen (4)\n \nduration: 591 ms"; tooltip="WholeStageCodegen (4)"; 8 [id="node8" labelType="html" label="Sort sort time: 0 ms peak memory: 2.1 MiB spill size: 0.0 B" tooltip="Sort [jobId#8533107 ASC NULLS FIRST], false, 0"]; } 9 [id="node9" labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 6.2 KiB number of coalesced partitions: 1" tooltip="AQEShuffleRead coalesced"]; 10 [id="node10" labelType="html" label="Exchange shuffle records written: 25 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 25 local bytes read: 6.0 KiB merged fetch fallback count: 0 local blocks read: 18 remote merged chunks fetched: 0 remote blocks read: 0 data size: 15.4 KiB local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 0.0 B number of partitions: 30 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 6.0 KiB" tooltip="Exchange hashpartitioning(jobId#8533107, 30), ENSURE_REQUIREMENTS, [plan_id=11180182]"]; subgraph cluster11 { isCluster="true"; id="cluster11"; label="WholeStageCodegen (3)\n \nduration: 30 ms"; tooltip="WholeStageCodegen (3)"; 12 [id="node12" labelType="html" label=" Project " tooltip="Project [coalesce(jobId#8533024, jobId#8533097) AS jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, ... 51 more fields]"]; 13 [id="node13" labelType="html" label="SortMergeJoin number of output rows: 25 spill size: 0.0 B" tooltip="SortMergeJoin [jobId#8533024], [jobId#8533097], FullOuter"]; } subgraph cluster14 { isCluster="true"; id="cluster14"; label="WholeStageCodegen (1)\n \nduration: 402 ms"; tooltip="WholeStageCodegen (1)"; 15 [id="node15" labelType="html" label="Sort sort time: 0 ms peak memory: 2.1 MiB spill size: 0.0 B" tooltip="Sort [jobId#8533024 ASC NULLS FIRST], false, 0"]; } 16 [id="node16" labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 6.6 KiB number of coalesced partitions: 1" tooltip="AQEShuffleRead coalesced"]; 17 [id="node17" labelType="html" label="Exchange shuffle records written: 25 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 25 local bytes read: 1705.0 B merged fetch fallback count: 0 local blocks read: 7 remote merged chunks fetched: 0 remote blocks read: 18 data size total (min, med, max (stageId: taskId)) 14.8 KiB (608.0 B, 608.0 B, 608.0 B (stage 172616.0: task 2636944)) local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 10 ms (0 ms, 0 ms, 0 ms (stage 172616.0: task 2636990)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 4.6 KiB number of partitions: 30 remote reqs duration: 2 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 6.3 KiB (206.0 B, 251.0 B, 315.0 B (stage 172616.0: task 2636979))" tooltip="Exchange hashpartitioning(jobId#8533024, 30), ENSURE_REQUIREMENTS, [plan_id=11179977]"]; 18 [id="node18" labelType="html" label="LocalTableScan number of output rows: 25" tooltip="LocalTableScan [jobId#8533024, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, ... 48 more fields]"]; subgraph cluster19 { isCluster="true"; id="cluster19"; label="WholeStageCodegen (2)\n \nduration: 112 ms"; tooltip="WholeStageCodegen (2)"; 20 [id="node20" labelType="html" label="Sort sort time: 0 ms peak memory: 2.1 MiB spill size: 0.0 B" tooltip="Sort [jobId#8533097 ASC NULLS FIRST], false, 0"]; } 21 [id="node21" labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 2.6 KiB number of coalesced partitions: 1" tooltip="AQEShuffleRead coalesced"]; 22 [id="node22" labelType="html" label="Exchange shuffle records written: 25 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 25 local bytes read: 790.0 B merged fetch fallback count: 0 local blocks read: 8 remote merged chunks fetched: 0 remote blocks read: 17 data size total (min, med, max (stageId: taskId)) 1200.0 B (48.0 B, 48.0 B, 48.0 B (stage 172614.0: task 2636934)) local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 11 ms (0 ms, 0 ms, 0 ms (stage 172614.0: task 2636929)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 1694.0 B number of partitions: 30 remote reqs duration: 4 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 2.4 KiB (97.0 B, 99.0 B, 103.0 B (stage 172614.0: task 2636940))" tooltip="Exchange hashpartitioning(jobId#8533097, 30), ENSURE_REQUIREMENTS, [plan_id=11179978]"]; 23 [id="node23" labelType="html" label="LocalTableScan number of output rows: 25" tooltip="LocalTableScan [jobId#8533097, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]"]; subgraph cluster24 { isCluster="true"; id="cluster24"; label="WholeStageCodegen (5)\n \nduration: 246 ms"; tooltip="WholeStageCodegen (5)"; 25 [id="node25" labelType="html" label="Sort sort time: 0 ms peak memory: 2.1 MiB spill size: 0.0 B" tooltip="Sort [jobId#8533101 ASC NULLS FIRST], false, 0"]; } 26 [id="node26" labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 2.7 KiB number of coalesced partitions: 1" tooltip="AQEShuffleRead coalesced"]; 27 [id="node27" labelType="html" label="Exchange shuffle records written: 25 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 25 local bytes read: 222.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 23 data size total (min, med, max (stageId: taskId)) 1600.0 B (64.0 B, 64.0 B, 64.0 B (stage 172615.0: task 2636945)) local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 11 ms (0 ms, 0 ms, 0 ms (stage 172615.0: task 2636966)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 2.4 KiB number of partitions: 30 remote reqs duration: 2 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 2.6 KiB (95.0 B, 111.0 B, 113.0 B (stage 172615.0: task 2636943))" tooltip="Exchange hashpartitioning(jobId#8533101, 30), ENSURE_REQUIREMENTS, [plan_id=11179986]"]; 28 [id="node28" labelType="html" label="LocalTableScan number of output rows: 25" tooltip="LocalTableScan [jobId#8533101, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106]"]; 1->0; 2->1; 4->2; 5->4; 6->5; 8->6; 9->8; 10->9; 12->10; 13->12; 15->13; 16->15; 17->16; 18->17; 20->13; 21->20; 22->21; 23->22; 25->6; 26->25; 27->26; 28->27; }

Details

== Physical Plan ==
AdaptiveSparkPlan (40)
+- == Final Plan ==
   ResultQueryStage (27), Statistics(sizeInBytes=8.0 EiB)
   +- Execute InsertIntoHadoopFsRelationCommand (26)
      +- WriteFiles (25)
         +- * Sort (24)
            +- * Project (23)
               +- * SortMergeJoin FullOuter (22)
                  :- * Sort (16)
                  :  +- AQEShuffleRead (15)
                  :     +- ShuffleQueryStage (14), Statistics(sizeInBytes=15.4 KiB, rowCount=25)
                  :        +- Exchange (13)
                  :           +- * Project (12)
                  :              +- * SortMergeJoin FullOuter (11)
                  :                 :- * Sort (5)
                  :                 :  +- AQEShuffleRead (4)
                  :                 :     +- ShuffleQueryStage (3), Statistics(sizeInBytes=14.8 KiB, rowCount=25)
                  :                 :        +- Exchange (2)
                  :                 :           +- LocalTableScan (1)
                  :                 +- * Sort (10)
                  :                    +- AQEShuffleRead (9)
                  :                       +- ShuffleQueryStage (8), Statistics(sizeInBytes=1200.0 B, rowCount=25)
                  :                          +- Exchange (7)
                  :                             +- LocalTableScan (6)
                  +- * Sort (21)
                     +- AQEShuffleRead (20)
                        +- ShuffleQueryStage (19), Statistics(sizeInBytes=1600.0 B, rowCount=25)
                           +- Exchange (18)
                              +- LocalTableScan (17)
+- == Initial Plan ==
   Execute InsertIntoHadoopFsRelationCommand (39)
   +- WriteFiles (38)
      +- Sort (37)
         +- Project (36)
            +- SortMergeJoin FullOuter (35)
               :- Sort (33)
               :  +- Exchange (32)
               :     +- Project (31)
               :        +- SortMergeJoin FullOuter (30)
               :           :- Sort (28)
               :           :  +- Exchange (2)
               :           :     +- LocalTableScan (1)
               :           +- Sort (29)
               :              +- Exchange (7)
               :                 +- LocalTableScan (6)
               +- Sort (34)
                  +- Exchange (18)
                     +- LocalTableScan (17)


(1) LocalTableScan
Output [73]: [jobId#8533024, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L]
Arguments: [jobId#8533024, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, ... 48 more fields]

(2) Exchange
Input [73]: [jobId#8533024, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L]
Arguments: hashpartitioning(jobId#8533024, 30), ENSURE_REQUIREMENTS, [plan_id=11179977]

(3) ShuffleQueryStage
Output [73]: [jobId#8533024, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L]
Arguments: 0

(4) AQEShuffleRead
Input [73]: [jobId#8533024, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L]
Arguments: coalesced

(5) Sort [codegen id : 1]
Input [73]: [jobId#8533024, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L]
Arguments: [jobId#8533024 ASC NULLS FIRST], false, 0

(6) LocalTableScan
Output [4]: [jobId#8533097, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: [jobId#8533097, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]

(7) Exchange
Input [4]: [jobId#8533097, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: hashpartitioning(jobId#8533097, 30), ENSURE_REQUIREMENTS, [plan_id=11179978]

(8) ShuffleQueryStage
Output [4]: [jobId#8533097, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: 1

(9) AQEShuffleRead
Input [4]: [jobId#8533097, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: coalesced

(10) Sort [codegen id : 2]
Input [4]: [jobId#8533097, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: [jobId#8533097 ASC NULLS FIRST], false, 0

(11) SortMergeJoin [codegen id : 3]
Left keys [1]: [jobId#8533024]
Right keys [1]: [jobId#8533097]
Join type: FullOuter
Join condition: None

(12) Project [codegen id : 3]
Output [76]: [coalesce(jobId#8533024, jobId#8533097) AS jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Input [77]: [jobId#8533024, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, jobId#8533097, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]

(13) Exchange
Input [76]: [jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: hashpartitioning(jobId#8533107, 30), ENSURE_REQUIREMENTS, [plan_id=11180182]

(14) ShuffleQueryStage
Output [76]: [jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: 3

(15) AQEShuffleRead
Input [76]: [jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: coalesced

(16) Sort [codegen id : 4]
Input [76]: [jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: [jobId#8533107 ASC NULLS FIRST], false, 0

(17) LocalTableScan
Output [6]: [jobId#8533101, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106]
Arguments: [jobId#8533101, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106]

(18) Exchange
Input [6]: [jobId#8533101, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106]
Arguments: hashpartitioning(jobId#8533101, 30), ENSURE_REQUIREMENTS, [plan_id=11179986]

(19) ShuffleQueryStage
Output [6]: [jobId#8533101, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106]
Arguments: 2

(20) AQEShuffleRead
Input [6]: [jobId#8533101, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106]
Arguments: coalesced

(21) Sort [codegen id : 5]
Input [6]: [jobId#8533101, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106]
Arguments: [jobId#8533101 ASC NULLS FIRST], false, 0

(22) SortMergeJoin [codegen id : 6]
Left keys [1]: [jobId#8533107]
Right keys [1]: [jobId#8533101]
Join type: FullOuter
Join condition: None

(23) Project [codegen id : 6]
Output [92]: [coalesce(jobId#8533107, jobId#8533101) AS jobId#8533108, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106, 10000001445 AS replenishmentRunId#8533109L, 7625924700692506924 AS tenantId#8533110, 7287 AS cornerstoneTenantId#8533111L, Otest_new AS marketUnit#8533112, STANDARD AS scenario#8533113, d687d6be-fc33-35fa-a2ad-21a3f54797f7 AS activityId#8533114, RunStreamWithId AS activityType#8533115, CalculateOrderProposalsWorkflow AS workflowType#8533116, 708cf6bb-7108-384c-b484-427753b23e2d AS workflowId#8533117, 1 AS activityAttempt#8533118,  AS gitCommitId#8533120]
Input [82]: [jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L, jobId#8533101, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106]

(24) Sort [codegen id : 6]
Input [92]: [jobId#8533108, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106, replenishmentRunId#8533109L, tenantId#8533110, cornerstoneTenantId#8533111L, marketUnit#8533112, scenario#8533113, activityId#8533114, activityType#8533115, workflowType#8533116, workflowId#8533117, activityAttempt#8533118, gitCommitId#8533120]
Arguments: [activityType#8533115 ASC NULLS FIRST], false, 0

(25) WriteFiles
Input [92]: [jobId#8533108, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106, replenishmentRunId#8533109L, tenantId#8533110, cornerstoneTenantId#8533111L, marketUnit#8533112, scenario#8533113, activityId#8533114, activityType#8533115, workflowType#8533116, workflowId#8533117, activityAttempt#8533118, gitCommitId#8533120]

(26) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000001445, false, [activityType#8533115], Parquet, [__partition_columns=["activityType"], path=hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000001445], Append, [jobId, stageCount, totalTaskCount, minTaskCountPerStage, maxTaskCountPerStage, medianTaskCountPerStage, bytesSpilledToDiskSerializedTotal, bytesSpilledToDiskSerializedMin, bytesSpilledToDiskSerializedMax, bytesSpilledToDiskSerializedMedian, taskCpuTimeTotal, taskCpuTimeMin, taskCpuTimeMax, taskCpuTimeMedian, taskDeserializeCpuTimeTotal, taskDeserializeCpuTimeMin, taskDeserializeCpuTimeMax, taskDeserializeCpuTimeMedian, taskDeserializeTimeTotal, taskDeserializeTimeMin, taskDeserializeTimeMax, taskDeserializeTimeMedian, taskRunTimeTotal, taskRunTimeMin, taskRunTimeMax, ... 67 more fields]

(27) ResultQueryStage
Output: []
Arguments: 4

(28) Sort
Input [73]: [jobId#8533024, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L]
Arguments: [jobId#8533024 ASC NULLS FIRST], false, 0

(29) Sort
Input [4]: [jobId#8533097, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: [jobId#8533097 ASC NULLS FIRST], false, 0

(30) SortMergeJoin
Left keys [1]: [jobId#8533024]
Right keys [1]: [jobId#8533097]
Join type: FullOuter
Join condition: None

(31) Project
Output [76]: [coalesce(jobId#8533024, jobId#8533097) AS jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Input [77]: [jobId#8533024, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, jobId#8533097, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]

(32) Exchange
Input [76]: [jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: hashpartitioning(jobId#8533107, 30), ENSURE_REQUIREMENTS, [plan_id=11179985]

(33) Sort
Input [76]: [jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L]
Arguments: [jobId#8533107 ASC NULLS FIRST], false, 0

(34) Sort
Input [6]: [jobId#8533101, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106]
Arguments: [jobId#8533101 ASC NULLS FIRST], false, 0

(35) SortMergeJoin
Left keys [1]: [jobId#8533107]
Right keys [1]: [jobId#8533101]
Join type: FullOuter
Join condition: None

(36) Project
Output [92]: [coalesce(jobId#8533107, jobId#8533101) AS jobId#8533108, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106, 10000001445 AS replenishmentRunId#8533109L, 7625924700692506924 AS tenantId#8533110, 7287 AS cornerstoneTenantId#8533111L, Otest_new AS marketUnit#8533112, STANDARD AS scenario#8533113, d687d6be-fc33-35fa-a2ad-21a3f54797f7 AS activityId#8533114, RunStreamWithId AS activityType#8533115, CalculateOrderProposalsWorkflow AS workflowType#8533116, 708cf6bb-7108-384c-b484-427753b23e2d AS workflowId#8533117, 1 AS activityAttempt#8533118,  AS gitCommitId#8533120]
Input [82]: [jobId#8533107, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L, jobId#8533101, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106]

(37) Sort
Input [92]: [jobId#8533108, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106, replenishmentRunId#8533109L, tenantId#8533110, cornerstoneTenantId#8533111L, marketUnit#8533112, scenario#8533113, activityId#8533114, activityType#8533115, workflowType#8533116, workflowId#8533117, activityAttempt#8533118, gitCommitId#8533120]
Arguments: [activityType#8533115 ASC NULLS FIRST], false, 0

(38) WriteFiles
Input [92]: [jobId#8533108, stageCount#8533025L, totalTaskCount#8533026L, minTaskCountPerStage#8533027L, maxTaskCountPerStage#8533028L, medianTaskCountPerStage#8533029L, bytesSpilledToDiskSerializedTotal#8533030L, bytesSpilledToDiskSerializedMin#8533031L, bytesSpilledToDiskSerializedMax#8533032L, bytesSpilledToDiskSerializedMedian#8533033L, taskCpuTimeTotal#8533034L, taskCpuTimeMin#8533035L, taskCpuTimeMax#8533036L, taskCpuTimeMedian#8533037L, taskDeserializeCpuTimeTotal#8533038L, taskDeserializeCpuTimeMin#8533039L, taskDeserializeCpuTimeMax#8533040L, taskDeserializeCpuTimeMedian#8533041L, taskDeserializeTimeTotal#8533042L, taskDeserializeTimeMin#8533043L, taskDeserializeTimeMax#8533044L, taskDeserializeTimeMedian#8533045L, taskRunTimeTotal#8533046L, taskRunTimeMin#8533047L, taskRunTimeMax#8533048L, taskRunTimeMedian#8533049L, jvmGcTimeTotal#8533050L, jvmGcTimeMin#8533051L, jvmGcTimeMax#8533052L, jvmGcTimeMedian#8533053L, bytesSpilledToDiskRawTotal#8533054L, bytesSpilledToDiskRawMin#8533055L, bytesSpilledToDiskRawMax#8533056L, bytesSpilledToDiskRawMedian#8533057L, resultSerializationTimeTotal#8533058L, resultSerializationTimeMin#8533059L, resultSerializationTimeMax#8533060L, resultSerializationTimeMedian#8533061L, resultSizeToDriverTotal#8533062L, resultSizeToDriverMin#8533063L, resultSizeToDriverMax#8533064L, resultSizeToDriverMedian#8533065L, taskPeakExecutionMemoryMin#8533066L, taskPeakExecutionMemoryMax#8533067L, taskPeakExecutionMemoryMedian#8533068L, persistencyBytesReadTotal#8533069L, persistencyBytesReadMin#8533070L, persistencyBytesReadMax#8533071L, persistencyBytesReadMedian#8533072L, persistencyRecordsReadTotal#8533073L, persistencyRecordsReadMin#8533074L, persistencyRecordsReadMax#8533075L, persistencyRecordsReadMedian#8533076L, persistencyBytesWrittenTotal#8533077L, persistencyBytesWrittenMin#8533078L, persistencyBytesWrittenMax#8533079L, persistencyBytesWrittenMedian#8533080L, persistencyRecordsWrittenTotal#8533081L, persistencyRecordsWrittenMin#8533082L, persistencyRecordsWrittenMax#8533083L, persistencyRecordsWrittenMedian#8533084L, shuffleConsumeRecordsReadTotal#8533085L, shuffleConsumeRemoteBlocksFetchedTotal#8533086L, shuffleConsumeLocalBlocksFetchedTotal#8533087L, shuffleConsumeTotalBlocksFetchedTotal#8533088L, shuffleConsumeRemoteBytesReadTotal#8533089L, shuffleConsumeLocalBytesReadTotal#8533090L, shuffleConsumeTotalBytesReadTotal#8533091L, shuffleConsumeRemoteBytesReadToDiskTotal#8533092L, shuffleConsumeFetchWaitTimeTotal#8533093L, shuffleProduceBytesWrittenTotal#8533094L, shuffleProduceRecordsWrittenTotal#8533095L, shuffleProduceWriteTimeTotal#8533096L, peakExecutionMemory#8533098L, peakExecutionMemoryCliqueDuration#8533099L, peakExecutionMemoryCliqueSize#8533100L, rddStorageDiskSizeTotal#8533102L, rddStorageMemSizeTotal#8533103L, rddNumCachedPartitionsTotal#8533104, rddNumPartitionsTotal#8533105, numberOfExecutors#8533106, replenishmentRunId#8533109L, tenantId#8533110, cornerstoneTenantId#8533111L, marketUnit#8533112, scenario#8533113, activityId#8533114, activityType#8533115, workflowType#8533116, workflowId#8533117, activityAttempt#8533118, gitCommitId#8533120]

(39) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000001445, false, [activityType#8533115], Parquet, [__partition_columns=["activityType"], path=hdlfs://332d7051-0d16-44f5-ae76-bf2dcf30365f.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000001445], Append, [jobId, stageCount, totalTaskCount, minTaskCountPerStage, maxTaskCountPerStage, medianTaskCountPerStage, bytesSpilledToDiskSerializedTotal, bytesSpilledToDiskSerializedMin, bytesSpilledToDiskSerializedMax, bytesSpilledToDiskSerializedMedian, taskCpuTimeTotal, taskCpuTimeMin, taskCpuTimeMax, taskCpuTimeMedian, taskDeserializeCpuTimeTotal, taskDeserializeCpuTimeMin, taskDeserializeCpuTimeMax, taskDeserializeCpuTimeMedian, taskDeserializeTimeTotal, taskDeserializeTimeMin, taskDeserializeTimeMax, taskDeserializeTimeMedian, taskRunTimeTotal, taskRunTimeMin, taskRunTimeMax, ... 67 more fields]

(40) AdaptiveSparkPlan
Output: []
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.activity.hdlfsEnabled	true
spark.activity.isolateSession	true
spark.sql.parquet.fieldId.read.enabled	true
spark.sql.parquet.fieldId.write.enabled	true
spark.sql.shuffle.partitions	30
temporal.activity.id	d687d6be-fc33-35fa-a2ad-21a3f54797f7
temporal.activity.type	RunStreamWithId