Use AWS OSS Maven -SNAPSHOT for plugin dependencies

[saratvemulapalli]

Plugins should not build off OpenSearch/plugins for every build.

See https://github.com/opensearch-project/opensearch-plugins/blob/main/BUILDING.md#building-within-the-opensearch-build-system for picking up dependencies from Maven.

• Use SNAPSHOT artifacts from maven for dependencies  common-utils#75
  Updates common-utils version to 1.2 common-utils#77
• Use SNAPSHOT artifacts from maven for dependencies  alerting#183
  Update build to use public Maven repo alerting#184
• Use SNAPSHOT artifacts from maven for dependencies  anomaly-detection#242
• Use SNAPSHOT artifacts from maven for dependencies  asynchronous-search#45
• Use SNAPSHOT artifacts from maven for dependencies dashboards-notebooks#88
• Use SNAPSHOT artifacts from maven for dependencies reporting#179
• Use SNAPSHOT artifacts from maven for dependencies dashboards-visualizations#29
• Updates job scheduler version to 1.2 job-scheduler#68
• Updates performance analyzer version to 1.2 performance-analyzer#71
• Update performance analyzer version to 1.2 performance-analyzer-rca#82
• Use SNAPSHOT artifacts from maven for dependencies security#1466
• Use SNAPSHOT artifacts from maven for dependencies sql#219
• Build from public Maven instead of mavenLocal k-NN#106
• Build from public Maven instead of mavenLocal index-management#155
  [Requirements] IM needs JS 1.2.0 SPI in Maven Snapshots to work opensearch-build#663

[ylwu-amzn]

Is this the goal of GA release? Any guidance

[dblock]

@ylwu-amzn Yes, we're waiting for Maven to be setup.

[joshuali925]

@dblock any eta on when plugins can start this?

[saratvemulapalli]

@dblock any eta on when plugins can start this?

@mch2 is working on it.

[mch2]

Plugins can start updating their scripts to depend on 1.0 artifacts from central.

If a snapshot of an unreleased version is desired you can add https://aws.oss.sonatype.org/content/repositories/snapshots/ to your list of repositories. This is where nightly builds are being pushed of 1.0 and 1.x.

[dblock]

Someone needs to pickup a task of upgrading an existing plugin to use maven -SNAPSHOT dependencies for 1.1, make sure it works, and then open an issue in every repo to do the same.

[abbashus]

Someone needs to pickup a task of upgrading an existing plugin to use maven -SNAPSHOT dependencies for 1.1, make sure it works, and then open an issue in every repo to do the same.

I'll pick this up

[dblock]

https://github.com/opensearch-project/data-prepper/pull/243/files

[dbbaughe]

opensearch-project/index-management#141

[saratvemulapalli]

For all plugins who are onboarding to Maven, please continue to list mavenlocal() as one of the repositories.
Pasting the comment from: https://github.com/opensearch-project/index-management/pull/141/files#r706333121

"As part of the CI/CD we are trying to run integration/bwc tests which qualifies the bundle and allows the maven artifacts to be published.
It would rely on mavenlocal() to run these tests."

[dblock]

Changing the label for 1.2. We need to update https://github.com/opensearch-project/opensearch-plugins/blob/main/BUILDING.md, open an issue in every plugin and make sure this is closed. @abbashus do you still own this?

[abbashus]

@dblock yes I still own this. Will start in a couple of days.

[abbashus]

Plugin	Issue	PR
index-management	opensearch-project/index-management#155	opensearch-project/index-management#158
alerting	opensearch-project/alerting#183	opensearch-project/alerting#184
asynchronous-search	opensearch-project/asynchronous-search#45	opensearch-project/asynchronous-search#48
anomaly-detection	opensearch-project/anomaly-detection#242
k-NN	opensearch-project/k-NN#106	opensearch-project/k-NN#119
sql	opensearch-project/sql#219	opensearch-project/sql#225
common-utils	opensearch-project/common-utils#75

[dblock]

• https://github.com/opensearch-project/opensearch-plugins/blob/main/BUILDING.md needs to be updated
• plugins have to preserve mavenLocal on top of the list (local, aws sonatype, central is probably the right order) otherwise bundle build will become unreliable

[dblock]

I updated the top of this ticket with a complete list of projects that need to do this.

[CEHENKLE]

All tickets closed :)

[dblock]

Verified via meta, found 3 occurrences. Not sure whether these are used, and I know notifications doesn't ship with 1.2. Reopening to fix and re-confirm.

meta exec "git checkout 1.2"
find . -type f -regex '.*/\.github\/workflows\/.*.yml' | xargs grep "'opensearch-project/OpenSearch'"

./dashboards-notebooks/.github/workflows/opensearch-notebooks-test-and-build-workflow.yml:          repository: 'opensearch-project/OpenSearch'
./security-dashboards-plugin/.github/workflows/integration-test.yml:          repository: 'opensearch-project/OpenSearch'
./notifications/.github/workflows/notifications-test-and-build-workflow.yml:          repository: 'opensearch-project/OpenSearch'

• Use SNAPSHOT artifacts from maven for dependencies dashboards-notebooks#98
• Use SNAPSHOT artifacts from maven for dependencies security-dashboards-plugin#859
• Use SNAPSHOT artifacts from maven for dependencies notifications#365

[anirudha]

Notebooks and notifications are not part of 1.2

[dblock]

Looks like dashboards-notebooks is going to get archived, opensearch-project/dashboards-notebooks#98 (comment)

[dblock]

Spot checked again, opensearch-project/security-dashboards-plugin#860 still needs to be backported to 1.2 to close this.

[peterzhuamazon]

@saratvemulapalli @dblock is this task consider complete? This is the only issue labeled as enhancement within 1.2.0.

[dblock]

I don’t see any mention of a backport for opensearch-project/security-dashboards-plugin#860 so that needs to be tracked down.

[dblock]

opensearch-project/security-dashboards-plugin#860 (comment)