Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML-245] Merge oneapi Algo implementations to master #246

Merged
merged 47 commits into from
Apr 3, 2023

Conversation

minmingzhu
Copy link
Collaborator

@minmingzhu minmingzhu commented Mar 15, 2023

What changes were proposed in this pull request?

Add K-means, PCA, Correlation and Summarizer implementations for multi node GPU through oneDAL oneapi interfaces.

minmingzhu and others added 15 commits July 14, 2022 21:38
* 1. add JNI wrapper
2. modify compiler config
3. add unit test

Signed-off-by: minmingzhu <[email protected]>

* add ci test

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* java code style

Signed-off-by: minmingzhu <[email protected]>

* cpp code style

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-test.sh

* Update ci-local-test.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update ci-local-test.sh

* Update ci-local-test.sh

* Update ci-local-test.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update prepare-build-deps.sh

* add convert array, vector to homogentable

Signed-off-by: minmingzhu <[email protected]>

* 1. rollback ci config
2. remove CI test becaue homogentable only support GPU

Signed-off-by: minmingzhu <[email protected]>

* 1. update prepare-build-deps.sh

Signed-off-by: minmingzhu <[email protected]>

* remove ci GPU test

Signed-off-by: minmingzhu <[email protected]>

* 1. remove GPU CI test

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* update Makefile

Signed-off-by: minmingzhu <[email protected]>

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* 1. fix ci

Signed-off-by: minmingzhu <[email protected]>

* update header

Signed-off-by: minmingzhu <[email protected]>

* update header

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update ci-cluster-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci conf

Signed-off-by: minmingzhu <[email protected]>

* update oneapi to 2022.1.2

Signed-off-by: minmingzhu <[email protected]>

* update ci conf

Signed-off-by: minmingzhu <[email protected]>

* fix comment

Signed-off-by: minmingzhu <[email protected]>

* Update build-jni.sh

* update Makefile

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update test.sh

* Update test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update test.sh

* Update test.sh

* update test.sh

Signed-off-by: minmingzhu <[email protected]>

* update test.sh

Signed-off-by: minmingzhu <[email protected]>

* update test.sh

Signed-off-by: minmingzhu <[email protected]>

* fix link libze_loader.so.1

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update ci-local-dpc-test.sh

Signed-off-by: minmingzhu <[email protected]>

* update oneapi to 2022.1.2

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update

Signed-off-by: minmingzhu <[email protected]>

* update Makefile

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* Update prepare-build-deps-gpu.sh

* Update prepare-build-deps-gpu.sh

* Update prepare-build-deps.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update install-build-level-zero-deps-ubuntun.sh

* Update install-build-level-zero-deps-ubuntun.sh

* Update install-build-level-zero-deps-ubuntun.sh

* Update ci-local-dpc-test.sh

* Update GPU.cpp

* Update GPU.cpp

* Update ci-build-test.sh

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update HomogenTableImpl.cpp

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* Update ci-local-dpc-test.sh

* Update ci-local-dpc-test.sh

* update HomogenTable API

Signed-off-by: minmingzhu <[email protected]>

* update install-build-level-zero-deps-ubuntu.sh

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update run.sh

* Update build-jni.sh

* 1. Merge branch 'make_homogen_table' into convert_homogentable
2. update ci
3. add a new parameters for HomogenTable class

Signed-off-by: minmingzhu <[email protected]>

* Update pom.xml

* Update test.sh

* Update Makefile

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ConvertHomogenTableSuite.scala

* Update install-level-zero-ubuntu.sh

* Update install-level-zero-ubuntu.sh

* Update build.sh

* Update test.sh

* Update test.sh

* Update HomogenTableImpl.cpp

* Update install-build-deps-ubuntu.sh

* Update HomogenTableImpl.cpp

* update

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* Update install-build-deps-ubuntu.sh

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update list-compute-devices.cpp

* Convert homogentable to array/vector/matrix (#4)

* 1. convert homogenTable to array/vector/matrix
2. add unit test

Signed-off-by: minmingzhu <[email protected]>

* Merge branch 'make_homogen_table' into convert_homogentable

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* Convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable (#8)

* 1. convert rdd to HomogenTable
* 2. add unit test

Signed-off-by: minmingzhu <[email protected]>

* add empty homogentable

Signed-off-by: minmingzhu <[email protected]>

* Mirgate kmeans daal to DPC++ (#7)

Signed-off-by: minmingzhu <[email protected]>

* 1. Mirgate kmeans daal to DPC++
* 2. add unit test

* 1. move local host to distributed host
2. add cluster test
3. code style

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ci-cluster-test.sh

* Update ci-cluster-test.sh

* Update build.sh

* Update build.sh

* Update OneDAL.cpp

* Update OneDAL.cpp

* Update OneDAL.cpp

* Update com_intel_oap_mllib_OneDAL__.h

* update code style

Signed-off-by: minmingzhu <[email protected]>

* Update NaiveBayesResult.java

* 1. update code style
2. When using the Host/CPU device throws a fail

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* rollback code style

Signed-off-by: minmingzhu <[email protected]>

* rollback code style

Signed-off-by: minmingzhu <[email protected]>

* rollback checkstyle.xml

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* rollback checkstyle.xml

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update OneDAL.scala

Signed-off-by: minmingzhu <[email protected]>

* revert ALS.scala

* revert checkstyle.xml

* :Revert "revert checkstyle.xml"

This reverts commit 4f74bac.

* disable cluster test for gpu

* disable cluster test for gpu

* nit

Co-authored-by: minmingz <[email protected]>
Co-authored-by: Wu, Xiaochang <[email protected]>
* 1. add JNI wrapper
2. modify compiler config
3. add unit test

Signed-off-by: minmingzhu <[email protected]>

* add ci test

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* java code style

Signed-off-by: minmingzhu <[email protected]>

* cpp code style

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-test.sh

* Update ci-local-test.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update ci-local-test.sh

* Update ci-local-test.sh

* Update ci-local-test.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update prepare-build-deps.sh

* add convert array, vector to homogentable

Signed-off-by: minmingzhu <[email protected]>

* 1. rollback ci config
2. remove CI test becaue homogentable only support GPU

Signed-off-by: minmingzhu <[email protected]>

* 1. update prepare-build-deps.sh

Signed-off-by: minmingzhu <[email protected]>

* remove ci GPU test

Signed-off-by: minmingzhu <[email protected]>

* 1. remove GPU CI test

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* update Makefile

Signed-off-by: minmingzhu <[email protected]>

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* 1. fix ci

Signed-off-by: minmingzhu <[email protected]>

* update header

Signed-off-by: minmingzhu <[email protected]>

* update header

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update ci-cluster-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci conf

Signed-off-by: minmingzhu <[email protected]>

* update oneapi to 2022.1.2

Signed-off-by: minmingzhu <[email protected]>

* update ci conf

Signed-off-by: minmingzhu <[email protected]>

* fix comment

Signed-off-by: minmingzhu <[email protected]>

* Update build-jni.sh

* update Makefile

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update test.sh

* Update test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update test.sh

* Update test.sh

* update test.sh

Signed-off-by: minmingzhu <[email protected]>

* update test.sh

Signed-off-by: minmingzhu <[email protected]>

* update test.sh

Signed-off-by: minmingzhu <[email protected]>

* fix link libze_loader.so.1

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update ci-local-dpc-test.sh

Signed-off-by: minmingzhu <[email protected]>

* update oneapi to 2022.1.2

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update

Signed-off-by: minmingzhu <[email protected]>

* update Makefile

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* Update prepare-build-deps-gpu.sh

* Update prepare-build-deps-gpu.sh

* Update prepare-build-deps.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update install-build-level-zero-deps-ubuntun.sh

* Update install-build-level-zero-deps-ubuntun.sh

* Update install-build-level-zero-deps-ubuntun.sh

* Update ci-local-dpc-test.sh

* Update GPU.cpp

* Update GPU.cpp

* Update ci-build-test.sh

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update HomogenTableImpl.cpp

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* Update ci-local-dpc-test.sh

* Update ci-local-dpc-test.sh

* update HomogenTable API

Signed-off-by: minmingzhu <[email protected]>

* update install-build-level-zero-deps-ubuntu.sh

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update run.sh

* Update build-jni.sh

* 1. Merge branch 'make_homogen_table' into convert_homogentable
2. update ci
3. add a new parameters for HomogenTable class

Signed-off-by: minmingzhu <[email protected]>

* Update pom.xml

* Update test.sh

* Update Makefile

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ConvertHomogenTableSuite.scala

* Update install-level-zero-ubuntu.sh

* Update install-level-zero-ubuntu.sh

* Update build.sh

* Update test.sh

* Update test.sh

* Update HomogenTableImpl.cpp

* Update install-build-deps-ubuntu.sh

* Update HomogenTableImpl.cpp

* update

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* Update install-build-deps-ubuntu.sh

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update list-compute-devices.cpp

* Convert homogentable to array/vector/matrix (#4)

* 1. convert homogenTable to array/vector/matrix
2. add unit test

Signed-off-by: minmingzhu <[email protected]>

* Merge branch 'make_homogen_table' into convert_homogentable

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* Convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable (#8)

* 1. convert rdd to HomogenTable
* 2. add unit test

Signed-off-by: minmingzhu <[email protected]>

* add empty homogentable

Signed-off-by: minmingzhu <[email protected]>

* Mirgate kmeans daal to DPC++ (#7)

Signed-off-by: minmingzhu <[email protected]>

* 1. Mirgate kmeans daal to DPC++
* 2. add unit test

* 1. move local host to distributed host
2. add cluster test
3. code style

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ci-cluster-test.sh

* Update ci-cluster-test.sh

* Update build.sh

* Update build.sh

* Update OneDAL.cpp

* Update OneDAL.cpp

* Update OneDAL.cpp

* Update com_intel_oap_mllib_OneDAL__.h

* update code style

Signed-off-by: minmingzhu <[email protected]>

* Update NaiveBayesResult.java

* 1. update code style
2. When using the Host/CPU device throws a fail

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* rollback code style

Signed-off-by: minmingzhu <[email protected]>

* rollback code style

Signed-off-by: minmingzhu <[email protected]>

* rollback checkstyle.xml

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* rollback checkstyle.xml

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update OneDAL.scala

Signed-off-by: minmingzhu <[email protected]>

* revert ALS.scala

* revert checkstyle.xml

* :Revert "revert checkstyle.xml"

This reverts commit 4f74bac.

* disable cluster test for gpu

* disable cluster test for gpu

* nit

* migrate cpa to DPC++

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update OutputHelpers.hpp

* update com_intel_oap_mllib_feature_PCADALImpl.h

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update PCADALImpl.scala

Signed-off-by: minmingzhu <[email protected]>

* 1. update function name and variable name

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update stayHomogenTablePtrToVector to saveHomogenTablePtrToVector

Signed-off-by: minmingzhu <[email protected]>

* change compute_device to ComputeDevice

Signed-off-by: minmingzhu <[email protected]>

Co-authored-by: minmingz <[email protected]>
Co-authored-by: Wu, Xiaochang <[email protected]>
* 1. add JNI wrapper
2. modify compiler config
3. add unit test

Signed-off-by: minmingzhu <[email protected]>

* add ci test

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* java code style

Signed-off-by: minmingzhu <[email protected]>

* cpp code style

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-test.sh

* Update ci-local-test.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update ci-local-test.sh

* Update ci-local-test.sh

* Update ci-local-test.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update install-build-deps-ubuntu.sh

* Update prepare-build-deps.sh

* add convert array, vector to homogentable

Signed-off-by: minmingzhu <[email protected]>

* 1. rollback ci config
2. remove CI test becaue homogentable only support GPU

Signed-off-by: minmingzhu <[email protected]>

* 1. update prepare-build-deps.sh

Signed-off-by: minmingzhu <[email protected]>

* remove ci GPU test

Signed-off-by: minmingzhu <[email protected]>

* 1. remove GPU CI test

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* update Makefile

Signed-off-by: minmingzhu <[email protected]>

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* 1. fix ci

Signed-off-by: minmingzhu <[email protected]>

* update header

Signed-off-by: minmingzhu <[email protected]>

* update header

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update ci-cluster-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci conf

Signed-off-by: minmingzhu <[email protected]>

* update oneapi to 2022.1.2

Signed-off-by: minmingzhu <[email protected]>

* update ci conf

Signed-off-by: minmingzhu <[email protected]>

* fix comment

Signed-off-by: minmingzhu <[email protected]>

* Update build-jni.sh

* update Makefile

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update test.sh

* Update test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update test.sh

* Update test.sh

* update test.sh

Signed-off-by: minmingzhu <[email protected]>

* update test.sh

Signed-off-by: minmingzhu <[email protected]>

* update test.sh

Signed-off-by: minmingzhu <[email protected]>

* fix link libze_loader.so.1

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update ci-local-dpc-test.sh

Signed-off-by: minmingzhu <[email protected]>

* update oneapi to 2022.1.2

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update

Signed-off-by: minmingzhu <[email protected]>

* update Makefile

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* Update prepare-build-deps-gpu.sh

* Update prepare-build-deps-gpu.sh

* Update prepare-build-deps.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update install-build-level-zero-deps-ubuntun.sh

* Update install-build-level-zero-deps-ubuntun.sh

* Update install-build-level-zero-deps-ubuntun.sh

* Update ci-local-dpc-test.sh

* Update GPU.cpp

* Update GPU.cpp

* Update ci-build-test.sh

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update HomogenTableImpl.cpp

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* Update ci-local-dpc-test.sh

* Update ci-local-dpc-test.sh

* update HomogenTable API

Signed-off-by: minmingzhu <[email protected]>

* update install-build-level-zero-deps-ubuntu.sh

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update ci-local-dpc-test.sh

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* update ci

Signed-off-by: minmingzhu <[email protected]>

* Update run.sh

* Update build-jni.sh

* 1. Merge branch 'make_homogen_table' into convert_homogentable
2. update ci
3. add a new parameters for HomogenTable class

Signed-off-by: minmingzhu <[email protected]>

* Update pom.xml

* Update test.sh

* Update Makefile

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ConvertHomogenTableSuite.scala

* Update install-level-zero-ubuntu.sh

* Update install-level-zero-ubuntu.sh

* Update build.sh

* Update test.sh

* Update test.sh

* Update HomogenTableImpl.cpp

* Update install-build-deps-ubuntu.sh

* Update HomogenTableImpl.cpp

* update

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* Update install-build-deps-ubuntu.sh

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update list-compute-devices.cpp

* Convert homogentable to array/vector/matrix (#4)

* 1. convert homogenTable to array/vector/matrix
2. add unit test

Signed-off-by: minmingzhu <[email protected]>

* Merge branch 'make_homogen_table' into convert_homogentable

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* Convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable (#8)

* 1. convert rdd to HomogenTable
* 2. add unit test

Signed-off-by: minmingzhu <[email protected]>

* add empty homogentable

Signed-off-by: minmingzhu <[email protected]>

* Mirgate kmeans daal to DPC++ (#7)

Signed-off-by: minmingzhu <[email protected]>

* 1. Mirgate kmeans daal to DPC++
* 2. add unit test

* 1. migrate pca to DPC++
2. add unit test

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* normalize data

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* 1. migrate correlation to DPC++ interface
2. add unit test

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* 1. move local host to distributed host
2. add cluster test
3. code style

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update ci-cluster-test.sh

* Update ci-cluster-test.sh

* Update build.sh

* Update build.sh

* Update OneDAL.cpp

* Update OneDAL.cpp

* Update OneDAL.cpp

* Update com_intel_oap_mllib_OneDAL__.h

* update code style

Signed-off-by: minmingzhu <[email protected]>

* Update NaiveBayesResult.java

* 1. update code style
2. When using the Host/CPU device throws a fail

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* rollback code style

Signed-off-by: minmingzhu <[email protected]>

* rollback code style

Signed-off-by: minmingzhu <[email protected]>

* rollback checkstyle.xml

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* rollback checkstyle.xml

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update OneDAL.scala

Signed-off-by: minmingzhu <[email protected]>

* revert ALS.scala

* revert checkstyle.xml

* :Revert "revert checkstyle.xml"

This reverts commit 4f74bac.

* disable cluster test for gpu

* disable cluster test for gpu

* nit

* migrate cpa to DPC++

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update OutputHelpers.hpp

* update com_intel_oap_mllib_feature_PCADALImpl.h

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update PCADALImpl.scala

Signed-off-by: minmingzhu <[email protected]>

* 1. update function name and variable name

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update stayHomogenTablePtrToVector to saveHomogenTablePtrToVector

Signed-off-by: minmingzhu <[email protected]>

* change compute_device to ComputeDevice

Signed-off-by: minmingzhu <[email protected]>

* 1. migrate pca to DPC++
2. add unit test

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* normalize data

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* 1. migrate correlation to DPC++ interface
2. add unit test

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* Update prepare-build-deps-gpu.sh

* update

Signed-off-by: minmingzhu <[email protected]>

* Update Makefile

* Update OutputHelpers.hpp

* Update PCAOneAPIImpl.cpp

* Update service.h

* update

Signed-off-by: minmingzhu <[email protected]>

* Update OneDAL.scala

* Update PCADALImpl.scala

* Update KmeansHomogenTableSuite.scala

* Update TestCommon.scala

* Update test.sh

* update

Signed-off-by: minmingzhu <[email protected]>

* fix comments

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update code style

Signed-off-by: minmingzhu <[email protected]>

Signed-off-by: minmingzhu <[email protected]>
Co-authored-by: minmingz <[email protected]>
Co-authored-by: Wu, Xiaochang <[email protected]>
* add low order moments

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* update

Signed-off-by: minmingzhu <[email protected]>

* rename unit filename

Signed-off-by: minmingzhu <[email protected]>

Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
2. add log for KMeansOneAPIImpl.cpp

Signed-off-by: minmingzhu <[email protected]>
2. enable Correlation GPU and CPU
3. format code style

Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
@github-actions
Copy link

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?
https://github.com/oap-project/oap-mllib/issues

Then could you also rename pull request title and commit log in the following format?

[ML-${ISSUES_ID}] ${detailed message}

See also:

Signed-off-by: minmingzhu <[email protected]>
@minmingzhu minmingzhu changed the title Merge oneapi interface to master [ML-245]Merge oneapi interface to master Mar 21, 2023
@github-actions
Copy link

#245

Signed-off-by: minmingzhu <[email protected]>
.github/workflows/ci-tests.yml Show resolved Hide resolved
mllib-dal/src/main/native/CorrelationOneAPIImpl.cpp Outdated Show resolved Hide resolved
mllib-dal/src/main/native/PCAOneAPIImpl.cpp Outdated Show resolved Hide resolved
mllib-dal/src/main/native/PCAOneAPIImpl.cpp Outdated Show resolved Hide resolved
mllib-dal/src/main/native/PCAOneAPIImpl.cpp Outdated Show resolved Hide resolved
minmingzhu and others added 9 commits March 28, 2023 08:21
2. enable CPU/GPU CI tests

Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
2. change yarn to standalone

Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
Signed-off-by: minmingzhu <[email protected]>
@minmingzhu minmingzhu closed this Mar 29, 2023
@minmingzhu minmingzhu reopened this Mar 29, 2023
dev/test-cluster/spark-env.sh Outdated Show resolved Hide resolved
dev/test-cluster/env.sh Outdated Show resolved Hide resolved
.github/workflows/ci-tests.yml Outdated Show resolved Hide resolved
@minmingzhu minmingzhu force-pushed the merge_oneapi_interface_to_master branch from 1d4d703 to a720d9b Compare March 31, 2023 06:47
@xwu99 xwu99 changed the title [ML-245]Merge oneapi interface to master [ML-245] Merge oneapi Algo implementations to master Mar 31, 2023
@xwu99 xwu99 merged commit 2a044b4 into oap-project:master Apr 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants