Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Java.lang.IllegalArgumentException: Invalid position 5 in block with 1 positions #24765

Open
jrombi opened this issue Jan 22, 2025 · 6 comments · May be fixed by #24767
Open

Java.lang.IllegalArgumentException: Invalid position 5 in block with 1 positions #24765

jrombi opened this issue Jan 22, 2025 · 6 comments · May be fixed by #24767

Comments

@jrombi
Copy link

jrombi commented Jan 22, 2025

I cannot reproduce into a smaller query, yet, but sharing the stacktrace already. I have seen some similar issues in the past in the issue tracker.

Running on Trino 468
Query works in Athena
Query with different partition works.
Issue seems to be an edge in the ArrayHistogramFunction arourd null checks.

java.lang.IllegalArgumentException: Invalid position 5 in block with 1 positions
	at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
	at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
	at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
	at io.trino.$gen.PageProjectionWork_20250120_180928_121.evaluate(Unknown Source)
	at io.trino.$gen.PageProjectionWork_20250120_180928_121.process(Unknown Source)
	at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
	at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
	at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
	at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
	at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
	at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
	at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
	at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
	at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
	at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
	at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
	at io.trino.operator.Driver.processInternal(Driver.java:403)
	at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
	at io.trino.operator.Driver.tryWithLock(Driver.java:709)
	at io.trino.operator.Driver.process(Driver.java:298)
	at io.trino.operator.Driver.processForDuration(Driver.java:269)
	at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
	at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
	at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
	at io.trino.$gen.Trino_468____20250120_180832_2.run(Unknown Source)
	at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
	at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
	at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
	at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:131)
	at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:75)
	at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:82)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1575)
	Suppressed: java.lang.RuntimeException: Task 20250120_180751_00049_ypbz3.9.12.2 failed
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.lambda$checkComplete$4(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at java.base/java.util.ArrayDeque.forEach(ArrayDeque.java:888)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.checkComplete(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.schedule(EventDrivenFaultTolerantQueryScheduler.java:1018)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.run(EventDrivenFaultTolerantQueryScheduler.java:847)
		at io.trino.$gen.Trino_468____20250120_155841_2.run(Unknown Source)
		... 7 more
	Caused by: java.lang.IllegalArgumentException: Invalid position 5 in block with 1 positions
		at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
		at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
		at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.evaluate(Unknown Source)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.process(Unknown Source)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
		at io.trino.operator.Driver.processInternal(Driver.java:403)
		at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
		at io.trino.operator.Driver.tryWithLock(Driver.java:709)
		at io.trino.operator.Driver.process(Driver.java:298)
		at io.trino.operator.Driver.processForDuration(Driver.java:269)
		at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
		at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
		at io.trino.$gen.Trino_468____20250120_180832_2.run(Unknown Source)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
		at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
		at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
		... 7 more
	Suppressed: java.lang.RuntimeException: Task 20250120_180751_00049_ypbz3.9.13.2 failed
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.lambda$checkComplete$4(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at java.base/java.util.ArrayDeque.forEach(ArrayDeque.java:888)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.checkComplete(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.schedule(EventDrivenFaultTolerantQueryScheduler.java:1018)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.run(EventDrivenFaultTolerantQueryScheduler.java:847)
		at io.trino.$gen.Trino_468____20250120_155841_2.run(Unknown Source)
		... 7 more
	Caused by: java.lang.IllegalArgumentException: Invalid position 26 in block with 1 positions
		at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
		at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
		at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.evaluate(Unknown Source)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.process(Unknown Source)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
		at io.trino.operator.Driver.processInternal(Driver.java:403)
		at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
		at io.trino.operator.Driver.tryWithLock(Driver.java:709)
		at io.trino.operator.Driver.process(Driver.java:298)
		at io.trino.operator.Driver.processForDuration(Driver.java:269)
		at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
		at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
		at io.trino.$gen.Trino_468____20250120_180832_2.run(Unknown Source)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
		at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
		at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
		... 7 more
	Suppressed: java.lang.RuntimeException: Task 20250120_180751_00049_ypbz3.9.1.3 failed
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.lambda$checkComplete$4(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at java.base/java.util.ArrayDeque.forEach(ArrayDeque.java:888)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.checkComplete(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.schedule(EventDrivenFaultTolerantQueryScheduler.java:1018)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.run(EventDrivenFaultTolerantQueryScheduler.java:847)
		at io.trino.$gen.Trino_468____20250120_155841_2.run(Unknown Source)
		... 7 more
	Caused by: java.lang.IllegalArgumentException: Invalid position 6 in block with 1 positions
		at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
		at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
		at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.evaluate(Unknown Source)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.process(Unknown Source)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
		at io.trino.operator.Driver.processInternal(Driver.java:403)
		at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
		at io.trino.operator.Driver.tryWithLock(Driver.java:709)
		at io.trino.operator.Driver.process(Driver.java:298)
		at io.trino.operator.Driver.processForDuration(Driver.java:269)
		at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
		at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
		at io.trino.$gen.Trino_468____20250120_180832_2.run(Unknown Source)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
		at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
		at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
		... 7 more
	Suppressed: java.lang.RuntimeException: Task 20250120_180751_00049_ypbz3.9.11.2 failed
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.lambda$checkComplete$4(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at java.base/java.util.ArrayDeque.forEach(ArrayDeque.java:888)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.checkComplete(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.schedule(EventDrivenFaultTolerantQueryScheduler.java:1018)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.run(EventDrivenFaultTolerantQueryScheduler.java:847)
		at io.trino.$gen.Trino_468____20250120_155841_2.run(Unknown Source)
		... 7 more
	Caused by: java.lang.IllegalArgumentException: Invalid position 55 in block with 1 positions
		at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
		at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
		at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
		at io.trino.$gen.PageProjectionWork_20250120_180909_41.evaluate(Unknown Source)
		at io.trino.$gen.PageProjectionWork_20250120_180909_41.process(Unknown Source)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
		at io.trino.operator.Driver.processInternal(Driver.java:403)
		at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
		at io.trino.operator.Driver.tryWithLock(Driver.java:709)
		at io.trino.operator.Driver.process(Driver.java:298)
		at io.trino.operator.Driver.processForDuration(Driver.java:269)
		at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
		at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
		at io.trino.$gen.Trino_468____20250120_180656_2.run(Unknown Source)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
		at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
		at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
		... 7 more
	Suppressed: java.lang.RuntimeException: Task 20250120_180751_00049_ypbz3.9.0.4 failed
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.lambda$checkComplete$4(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at java.base/java.util.ArrayDeque.forEach(ArrayDeque.java:888)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.checkComplete(EventDrivenFaultTolerantQueryScheduler.java:1044)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.schedule(EventDrivenFaultTolerantQueryScheduler.java:1018)
		at io.trino.execution.scheduler.faulttolerant.EventDrivenFaultTolerantQueryScheduler$Scheduler.run(EventDrivenFaultTolerantQueryScheduler.java:847)
		at io.trino.$gen.Trino_468____20250120_155841_2.run(Unknown Source)
		... 7 more
	Caused by: java.lang.IllegalArgumentException: Invalid position 5 in block with 1 positions
		at io.trino.spi.block.BlockUtil.checkValidPosition(BlockUtil.java:71)
		at io.trino.spi.block.DictionaryBlock.isNull(DictionaryBlock.java:389)
		at io.trino.operator.scalar.ArrayHistogramFunction.arrayHistogram(ArrayHistogramFunction.java:77)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.evaluate(Unknown Source)
		at io.trino.$gen.PageProjectionWork_20250120_180928_121.process(Unknown Source)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.processInternal(DictionaryAwarePageProjection.java:182)
		at io.trino.operator.project.DictionaryAwarePageProjection$DictionaryAwarePageProjectionWork.process(DictionaryAwarePageProjection.java:120)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.processBatch(PageProcessor.java:315)
		at io.trino.operator.project.PageProcessor$ProjectSelectedPositions.process(PageProcessor.java:199)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils$BlockingProcess.process(WorkProcessorUtils.java:207)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.lambda$flatten$6(WorkProcessorUtils.java:317)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:359)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:346)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:240)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:261)
		at io.trino.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:255)
		at io.trino.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:423)
		at io.trino.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:133)
		at io.trino.operator.Driver.processInternal(Driver.java:403)
		at io.trino.operator.Driver.lambda$process$8(Driver.java:306)
		at io.trino.operator.Driver.tryWithLock(Driver.java:709)
		at io.trino.operator.Driver.process(Driver.java:298)
		at io.trino.operator.Driver.processForDuration(Driver.java:269)
		at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:890)
		at io.trino.execution.executor.dedicated.SplitProcessor.run(SplitProcessor.java:77)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.lambda$run$0(TaskEntry.java:201)
		at io.trino.$gen.Trino_468____20250120_180832_2.run(Unknown Source)
		at io.trino.execution.executor.dedicated.TaskEntry$VersionEmbedderBridge.run(TaskEntry.java:202)
		at io.trino.execution.executor.scheduler.FairScheduler.runTask(FairScheduler.java:177)
		at io.trino.execution.executor.scheduler.FairScheduler.lambda$submit$0(FairScheduler.java:164)
		... 7 more
@wendigo
Copy link
Contributor

wendigo commented Jan 22, 2025

Can you share the query?

@wendigo wendigo linked a pull request Jan 22, 2025 that will close this issue
Open
@jrombi
Copy link
Author

jrombi commented Jan 22, 2025 •
edited
Loading

The query is very large, but this would the snippet I believe. There are couple of other ARRAY_HISTOGRAM's, but those are very straightforward. No filter, etc.

I can maybe build a docker image from your pr and test it?

Thanks for the quick response!

ARRAY_HISTOGRAM(
      FLATTEN(
        ARRAY_AGG(seller_ids) FILTER (WHERE seller_ids IS NOT NULL)
      )
    ) AS seller_id_frequency,

@wendigo
Copy link
Contributor

wendigo commented Jan 22, 2025

@jrombi sure, if you can test that I'd be grateful!

@wendigo
Copy link
Contributor

wendigo commented Jan 23, 2025

@jrombi any news?

@jrombi
Copy link
Author

jrombi commented Jan 23, 2025

Sorry, I need to fully setup Maven 😅 . So was going to try and create reproduce query. Your fix seems to make sensen though!

@wendigo
Copy link
Contributor

wendigo commented Jan 23, 2025

@jrombi you don't need to - we have a maven wrapper checked in. Just run ./mwnv

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix null check in the array_histogram trinodb/trino
2 participants
@wendigo @jrombi