Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

com.ververica.cdc.connectors.oracle.table.OracleConnectorITCase#testConsumingAllEvents ERROR #1875

Closed
molsionmo opened this issue Jan 16, 2023 · 3 comments
Closed

com.ververica.cdc.connectors.oracle.table.OracleConnectorITCase#testConsumingAllEvents ERROR #1875

molsionmo opened this issue Jan 16, 2023 · 3 comments
Assignees
@molsionmo
Labels
bug Something isn't working
Milestone
V2.4.0

Comments

@molsionmo
Copy link
Contributor

Describe the bug(Please use English)
A clear and concise description of what the bug is.

Environment :

  • Flink version : 1.15
  • Flink CDC version: 2.4_SNAPSHOT
  • Database and version: Oracle 11C

To Reproduce
Steps to reproduce the behavior: com.ververica.cdc.connectors.oracle.table.OracleConnectorITCase#testConsumingAllEvents

Test testAllDataTypesparallelismSnapshot: true is running.

694437 [main] INFO com.ververica.cdc.connectors.oracle.table.OracleConnectorITCase - Starting containers...
694439 [testcontainers-lifecycle-3] INFO 🐳 [jark/oracle-xe-11g-r2-cdc:0.1] - Creating container for image: jark/oracle-xe-11g-r2-cdc:0.1
694542 [testcontainers-lifecycle-3] INFO 🐳 [jark/oracle-xe-11g-r2-cdc:0.1] - Container jark/oracle-xe-11g-r2-cdc:0.1 is starting: 14525f0dcb220ba9f770665ec4f7bf459d6e709d922bdb5b051c4aebfb71ef11
694709 [Source Data Fetcher for Source: debezium_source[16] -> Calc[17] (1/4)#0] INFO com.ververica.cdc.connectors.base.source.reader.IncrementalSourceSplitReader - Close current fetcher com.ververica.cdc.connectors.base.source.reader.external.IncrementalSourceStreamFetcher
694709 [Source Data Fetcher for Source: debezium_source[16] -> Calc[17] (1/4)#0] WARN com.ververica.cdc.connectors.base.source.reader.external.IncrementalSourceStreamFetcher - Failed to close the stream fetcher in 30 seconds.
694709 [Source Data Fetcher for Source: debezium_source[16] -> Calc[17] (1/4)#0] INFO org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher - Split fetcher 2 exited.
694710 [Source: debezium_source[16] -> Calc[17] (1/4)#0] INFO org.apache.flink.runtime.taskmanager.Task - Source: debezium_source[16] -> Calc[17] (1/4)#0 (071168b84eeb73502264935a0d7f9d93_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
694710 [Source: debezium_source[16] -> Calc[17] (1/4)#0] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: debezium_source[16] -> Calc[17] (1/4)#0 (071168b84eeb73502264935a0d7f9d93_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
694710 [flink-akka.actor.default-dispatcher-28] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state CANCELED to JobManager for task Source: debezium_source[16] -> Calc[17] (1/4)#0 071168b84eeb73502264935a0d7f9d93_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
694711 [flink-akka.actor.default-dispatcher-34] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: debezium_source[16] -> Calc[17] (1/4) (071168b84eeb73502264935a0d7f9d93_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
694712 [flink-akka.actor.default-dispatcher-34] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job insert-into_default_catalog.default_database.sink (e7ec4fbbfc6f43affb8c7db1fe65a4a8) switched from state CANCELLING to CANCELED.
694712 [flink-akka.actor.default-dispatcher-28] INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager - Clearing resource requirements of job e7ec4fbbfc6f43affb8c7db1fe65a4a8
694712 [flink-akka.actor.default-dispatcher-34] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job e7ec4fbbfc6f43affb8c7db1fe65a4a8.
694715 [flink-akka.actor.default-dispatcher-36] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job e7ec4fbbfc6f43affb8c7db1fe65a4a8 reached terminal state CANCELED.
694715 [mini-cluster-io-thread-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job e7ec4fbbfc6f43affb8c7db1fe65a4a8 has been registered for cleanup in the JobResultStore after reaching a terminal state.
694718 [flink-akka.actor.default-dispatcher-28] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job 'insert-into_default_catalog.default_database.sink' (e7ec4fbbfc6f43affb8c7db1fe65a4a8).
694760 [Thread-32] INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator - Closing SourceCoordinator for source Source: debezium_source[16].
694760 [flink-akka.actor.default-dispatcher-28] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
694760 [Thread-32] INFO com.ververica.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator - Closing enumerator...
694760 [Thread-32] INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator - Source coordinator for source Source: debezium_source[16] closed.
694760 [flink-akka.actor.default-dispatcher-28] INFO org.apache.flink.runtime.jobmaster.JobMaster - Disconnect TaskExecutor 3d4f1e6d-a630-4435-af3e-49ce9c1f1943 because: Stopping JobMaster for job 'insert-into_default_catalog.default_database.sink' (e7ec4fbbfc6f43affb8c7db1fe65a4a8).
694760 [flink-akka.actor.default-dispatcher-28] INFO org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool - Releasing slot [93344a87fe34809fc3a132d990267484].
694760 [flink-akka.actor.default-dispatcher-28] INFO org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool - Releasing slot [8f1ffc2235f120a19d6a11a7b5d398d6].
694760 [flink-akka.actor.default-dispatcher-28] INFO org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool - Releasing slot [84c3e793cfe764b1d39a3c62e90c424a].
694760 [flink-akka.actor.default-dispatcher-28] INFO org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool - Releasing slot [eb2d103eb4e2971cacf684089292daca].
694760 [flink-akka.actor.default-dispatcher-36] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:3, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=20.000mb (20971520 bytes), networkMemory=16.000mb (16777216 bytes)}, allocationId: 93344a87fe34809fc3a132d990267484, jobId: e7ec4fbbfc6f43affb8c7db1fe65a4a8).
694760 [flink-akka.actor.default-dispatcher-28] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 82e9c127785b6b130c2c80de23c09571: Stopping JobMaster for job 'insert-into_default_catalog.default_database.sink' (e7ec4fbbfc6f43affb8c7db1fe65a4a8).
694761 [flink-akka.actor.default-dispatcher-34] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 8bad818e61b61d465205a424fb684322@akka://flink/user/rpc/jobmanager_10 for job e7ec4fbbfc6f43affb8c7db1fe65a4a8 from the resource manager.
694763 [flink-akka.actor.default-dispatcher-36] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:1, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=20.000mb (20971520 bytes), networkMemory=16.000mb (16777216 bytes)}, allocationId: 8f1ffc2235f120a19d6a11a7b5d398d6, jobId: e7ec4fbbfc6f43affb8c7db1fe65a4a8).
694764 [flink-akka.actor.default-dispatcher-36] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=20.000mb (20971520 bytes), networkMemory=16.000mb (16777216 bytes)}, allocationId: 84c3e793cfe764b1d39a3c62e90c424a, jobId: e7ec4fbbfc6f43affb8c7db1fe65a4a8).
694766 [flink-akka.actor.default-dispatcher-36] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:2, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=20.000mb (20971520 bytes), networkMemory=16.000mb (16777216 bytes)}, allocationId: eb2d103eb4e2971cacf684089292daca, jobId: e7ec4fbbfc6f43affb8c7db1fe65a4a8).
694766 [flink-akka.actor.default-dispatcher-36] INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService - Remove job e7ec4fbbfc6f43affb8c7db1fe65a4a8 from job leader monitoring.
694766 [flink-akka.actor.default-dispatcher-36] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job e7ec4fbbfc6f43affb8c7db1fe65a4a8.
694766 [mini-cluster-io-thread-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job e7ec4fbbfc6f43affb8c7db1fe65a4a8 with leader id 8bad818e61b61d465205a424fb684322 lost leadership.

arrays first differed at element [3]; expected:<+I[jacket, [0.6]00]> but was:<+I[jacket, [1.1]00]>
预期:+I[jacket, 0.600]
实际:+I[jacket, 1.100]

Additional Description
If applicable, add screenshots to help explain your problem.
@molsionmo molsionmo added the bug Something isn't working label Jan 16, 2023
@molsionmo
Copy link
Contributor Author

@leonardBang @GOODBOY008 please assign this task to me, i will fix it

@ruanhang1993 ruanhang1993 added this to the V2.4.0 milestone Mar 24, 2023
@ruanhang1993
Copy link
Contributor

Hi, @molsionmo . Is there any progress about this issue?

@ruanhang1993
Copy link
Contributor

Fixed by #2215

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@molsionmo molsionmo

Labels
bug Something isn't working
Projects
None yet
Milestone
V2.4.0
Development

No branches or pull requests
2 participants
@ruanhang1993 @molsionmo