fix(ingestion/iceberg): Improvements to iceberg source #26675

Job	Run time
setup	1s
Build and Push DataHub Upgrade Docker Image	1s
Build and Push DataHub Frontend Docker Image	1s
Build and Push DataHub MAE Consumer Docker Image	1s
Build and Push DataHub GMS Docker Image	1s
Build and Push DataHub MCE Consumer Docker Image	1s
Build and Push DataHub Ingestion (Base) Docker Image	1s
Build and Push DataHub Kafka Setup Docker Image	1s
Build and Push DataHub Elasticsearch Setup Docker Image	1s
Build and Push DataHub MySQL Setup Docker Image	1s
smoke_test_matrix	1s
[Monitoring] Scan DataHub Upgrade images for vulnerabilities	1s
[Monitoring] Scan Frontend images for vulnerabilities	1s
[Monitoring] Scan GMS images for vulnerabilities	1s
[Monitoring] Scan MAE consumer images for vulnerabilities	1s
[Monitoring] Scan MCE consumer images for vulnerabilities	1s
[Monitoring] Scan ElasticSearch setup images for vulnerabilities	1s
Build and Push DataHub Ingestion (Base-Full) Docker Image	1s
Build and Push DataHub Ingestion (Base-Slim) Docker Image	1s
[Monitoring] Scan Kafka Setup images for vulnerabilities	1s
[Monitoring] Scan MySQL Setup images for vulnerabilities	1s
Build and Push DataHub Ingestion Docker Images	1s
Build and Push DataHub Ingestion (Full) Docker Images	1s
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities	1s
Run Smoke Tests	1s
[Monitoring] Scan Datahub Ingestion images for vulnerabilities	1s
Deploy to Datahub HEAD	1s
	27s

Provide feedback