[ML-250] Replace sycl::gpu_selector{}.select_device() with manual GPU allocation #235

minmingzhu · 2022-11-22T02:22:55Z

What changes were proposed in this pull request?

Used a fixed GPU instead of select_device function

github-actions · 2022-11-22T02:23:07Z

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?
https://github.com/oap-project/oap-mllib/issues

Then could you also rename pull request title and commit log in the following format?

[ML-${ISSUES_ID}] ${detailed message}

See also:

Other pull requests

github-actions · 2023-03-21T02:04:34Z

#250

xwu99 · 2023-04-18T01:43:00Z

mllib-dal/src/main/native/OneCCL.cpp

oneCCL init has a create_communicator for CPU even when another communicator is created for GPU later.

mllib-dal/src/main/native/KMeansImpl.cpp

xwu99 · 2023-04-18T01:44:07Z

mllib-dal/src/main/native/GPU.cpp

+                     "GPU device."
+                  << std::endl;
+        exit(-1);
+    }
    case ComputeDevice::gpu: {
        std::cout << "selector GPU" << std::endl;


remove debug output

mllib-dal/src/main/native/KMeansImpl.cpp

xwu99 · 2023-04-18T01:49:05Z

mllib-dal/src/main/native/KMeansImpl.cpp

-    std::cout << "KMeans (native): rankid  " << rankId
-              << "; training step took " << duration / 1000 << " secs"
-              << std::endl;
+    std::cout << "KMeans (native): training step took " << duration / 1000


why do you need this output? already have one above?

Want to output each task training took and compare with root task training.

xwu99 · 2023-04-18T01:50:16Z

mllib-dal/src/main/native/KMeansImpl.cpp

    ComputeDevice device = getComputeDeviceByOrdinal(computeDeviceOrdinal);
    switch (device) {
 #ifdef CPU_ONLY_PROFILE
    case ComputeDevice::host:
    case ComputeDevice::cpu: {
-        ccl::communicator &comm = getComm();


It's better to create communicator here than in the oneCCL.init.

mllib-dal/src/main/scala/com/intel/oap/mllib/OneDAL.scala

xwu99 · 2023-04-18T02:22:23Z

mllib-dal/src/main/scala/org/apache/spark/mllib/stat/spark321/Statistics.scala

      val executor_num = Utils.sparkExecutorNum(X.sparkContext)
      val executor_cores = Utils.sparkExecutorCores()
      val summary = new SummarizerDALImpl(executor_num, executor_cores)
        .computeSummarizerMatrix(rdd)
      if (handlePersistence) {
-        X.unpersist()
+        rdd.unpersist()


those code changes are irrelevant to this PR?

rollback and fix this in next PR

* 1. add JNI wrapper 2. modify compiler config 3. add unit test Signed-off-by: minmingzhu <[email protected]> * add ci test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * java code style Signed-off-by: minmingzhu <[email protected]> * cpp code style Signed-off-by: minmingzhu <[email protected]> * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update prepare-build-deps.sh * add convert array, vector to homogentable Signed-off-by: minmingzhu <[email protected]> * 1. rollback ci config 2. remove CI test becaue homogentable only support GPU Signed-off-by: minmingzhu <[email protected]> * 1. update prepare-build-deps.sh Signed-off-by: minmingzhu <[email protected]> * remove ci GPU test Signed-off-by: minmingzhu <[email protected]> * 1. remove GPU CI test Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * 1. fix ci Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * fix comment Signed-off-by: minmingzhu <[email protected]> * Update build-jni.sh * update Makefile Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * fix link libze_loader.so.1 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci-local-dpc-test.sh Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update ci-local-dpc-test.sh * Update GPU.cpp * Update GPU.cpp * Update ci-build-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update HomogenTableImpl.cpp Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * update HomogenTable API Signed-off-by: minmingzhu <[email protected]> * update install-build-level-zero-deps-ubuntu.sh Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update run.sh * Update build-jni.sh * 1. Merge branch 'make_homogen_table' into convert_homogentable 2. update ci 3. add a new parameters for HomogenTable class Signed-off-by: minmingzhu <[email protected]> * Update pom.xml * Update test.sh * Update Makefile * update Signed-off-by: minmingzhu <[email protected]> * Update ConvertHomogenTableSuite.scala * Update install-level-zero-ubuntu.sh * Update install-level-zero-ubuntu.sh * Update build.sh * Update test.sh * Update test.sh * Update HomogenTableImpl.cpp * Update install-build-deps-ubuntu.sh * Update HomogenTableImpl.cpp * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * Update install-build-deps-ubuntu.sh * fix comments Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update list-compute-devices.cpp * Convert homogentable to array/vector/matrix (#4) * 1. convert homogenTable to array/vector/matrix 2. add unit test Signed-off-by: minmingzhu <[email protected]> * Merge branch 'make_homogen_table' into convert_homogentable Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * Convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable (#8) * 1. convert rdd to HomogenTable * 2. add unit test Signed-off-by: minmingzhu <[email protected]> * add empty homogentable Signed-off-by: minmingzhu <[email protected]> * Mirgate kmeans daal to DPC++ (#7) Signed-off-by: minmingzhu <[email protected]> * 1. Mirgate kmeans daal to DPC++ * 2. add unit test * 1. move local host to distributed host 2. add cluster test 3. code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * Update ci-cluster-test.sh * Update build.sh * Update build.sh * Update OneDAL.cpp * Update OneDAL.cpp * Update OneDAL.cpp * Update com_intel_oap_mllib_OneDAL__.h * update code style Signed-off-by: minmingzhu <[email protected]> * Update NaiveBayesResult.java * 1. update code style 2. When using the Host/CPU device throws a fail Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update OneDAL.scala Signed-off-by: minmingzhu <[email protected]> * revert ALS.scala * revert checkstyle.xml * :Revert "revert checkstyle.xml" This reverts commit 4f74bac. * disable cluster test for gpu * disable cluster test for gpu * nit Co-authored-by: minmingz <[email protected]> Co-authored-by: Wu, Xiaochang <[email protected]>

* 1. add JNI wrapper 2. modify compiler config 3. add unit test Signed-off-by: minmingzhu <[email protected]> * add ci test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * java code style Signed-off-by: minmingzhu <[email protected]> * cpp code style Signed-off-by: minmingzhu <[email protected]> * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update prepare-build-deps.sh * add convert array, vector to homogentable Signed-off-by: minmingzhu <[email protected]> * 1. rollback ci config 2. remove CI test becaue homogentable only support GPU Signed-off-by: minmingzhu <[email protected]> * 1. update prepare-build-deps.sh Signed-off-by: minmingzhu <[email protected]> * remove ci GPU test Signed-off-by: minmingzhu <[email protected]> * 1. remove GPU CI test Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * 1. fix ci Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * fix comment Signed-off-by: minmingzhu <[email protected]> * Update build-jni.sh * update Makefile Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * fix link libze_loader.so.1 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci-local-dpc-test.sh Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update ci-local-dpc-test.sh * Update GPU.cpp * Update GPU.cpp * Update ci-build-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update HomogenTableImpl.cpp Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * update HomogenTable API Signed-off-by: minmingzhu <[email protected]> * update install-build-level-zero-deps-ubuntu.sh Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update run.sh * Update build-jni.sh * 1. Merge branch 'make_homogen_table' into convert_homogentable 2. update ci 3. add a new parameters for HomogenTable class Signed-off-by: minmingzhu <[email protected]> * Update pom.xml * Update test.sh * Update Makefile * update Signed-off-by: minmingzhu <[email protected]> * Update ConvertHomogenTableSuite.scala * Update install-level-zero-ubuntu.sh * Update install-level-zero-ubuntu.sh * Update build.sh * Update test.sh * Update test.sh * Update HomogenTableImpl.cpp * Update install-build-deps-ubuntu.sh * Update HomogenTableImpl.cpp * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * Update install-build-deps-ubuntu.sh * fix comments Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update list-compute-devices.cpp * Convert homogentable to array/vector/matrix (#4) * 1. convert homogenTable to array/vector/matrix 2. add unit test Signed-off-by: minmingzhu <[email protected]> * Merge branch 'make_homogen_table' into convert_homogentable Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * Convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable (#8) * 1. convert rdd to HomogenTable * 2. add unit test Signed-off-by: minmingzhu <[email protected]> * add empty homogentable Signed-off-by: minmingzhu <[email protected]> * Mirgate kmeans daal to DPC++ (#7) Signed-off-by: minmingzhu <[email protected]> * 1. Mirgate kmeans daal to DPC++ * 2. add unit test * 1. move local host to distributed host 2. add cluster test 3. code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * Update ci-cluster-test.sh * Update build.sh * Update build.sh * Update OneDAL.cpp * Update OneDAL.cpp * Update OneDAL.cpp * Update com_intel_oap_mllib_OneDAL__.h * update code style Signed-off-by: minmingzhu <[email protected]> * Update NaiveBayesResult.java * 1. update code style 2. When using the Host/CPU device throws a fail Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update OneDAL.scala Signed-off-by: minmingzhu <[email protected]> * revert ALS.scala * revert checkstyle.xml * :Revert "revert checkstyle.xml" This reverts commit 4f74bac. * disable cluster test for gpu * disable cluster test for gpu * nit * migrate cpa to DPC++ Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update OutputHelpers.hpp * update com_intel_oap_mllib_feature_PCADALImpl.h Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update PCADALImpl.scala Signed-off-by: minmingzhu <[email protected]> * 1. update function name and variable name Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update stayHomogenTablePtrToVector to saveHomogenTablePtrToVector Signed-off-by: minmingzhu <[email protected]> * change compute_device to ComputeDevice Signed-off-by: minmingzhu <[email protected]> Co-authored-by: minmingz <[email protected]> Co-authored-by: Wu, Xiaochang <[email protected]>

* 1. add JNI wrapper 2. modify compiler config 3. add unit test Signed-off-by: minmingzhu <[email protected]> * add ci test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * java code style Signed-off-by: minmingzhu <[email protected]> * cpp code style Signed-off-by: minmingzhu <[email protected]> * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update prepare-build-deps.sh * add convert array, vector to homogentable Signed-off-by: minmingzhu <[email protected]> * 1. rollback ci config 2. remove CI test becaue homogentable only support GPU Signed-off-by: minmingzhu <[email protected]> * 1. update prepare-build-deps.sh Signed-off-by: minmingzhu <[email protected]> * remove ci GPU test Signed-off-by: minmingzhu <[email protected]> * 1. remove GPU CI test Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * 1. fix ci Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * fix comment Signed-off-by: minmingzhu <[email protected]> * Update build-jni.sh * update Makefile Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * fix link libze_loader.so.1 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci-local-dpc-test.sh Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update ci-local-dpc-test.sh * Update GPU.cpp * Update GPU.cpp * Update ci-build-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update HomogenTableImpl.cpp Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * update HomogenTable API Signed-off-by: minmingzhu <[email protected]> * update install-build-level-zero-deps-ubuntu.sh Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update run.sh * Update build-jni.sh * 1. Merge branch 'make_homogen_table' into convert_homogentable 2. update ci 3. add a new parameters for HomogenTable class Signed-off-by: minmingzhu <[email protected]> * Update pom.xml * Update test.sh * Update Makefile * update Signed-off-by: minmingzhu <[email protected]> * Update ConvertHomogenTableSuite.scala * Update install-level-zero-ubuntu.sh * Update install-level-zero-ubuntu.sh * Update build.sh * Update test.sh * Update test.sh * Update HomogenTableImpl.cpp * Update install-build-deps-ubuntu.sh * Update HomogenTableImpl.cpp * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * Update install-build-deps-ubuntu.sh * fix comments Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update list-compute-devices.cpp * Convert homogentable to array/vector/matrix (#4) * 1. convert homogenTable to array/vector/matrix 2. add unit test Signed-off-by: minmingzhu <[email protected]> * Merge branch 'make_homogen_table' into convert_homogentable Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * Convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable (#8) * 1. convert rdd to HomogenTable * 2. add unit test Signed-off-by: minmingzhu <[email protected]> * add empty homogentable Signed-off-by: minmingzhu <[email protected]> * Mirgate kmeans daal to DPC++ (#7) Signed-off-by: minmingzhu <[email protected]> * 1. Mirgate kmeans daal to DPC++ * 2. add unit test * 1. migrate pca to DPC++ 2. add unit test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * normalize data Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * 1. migrate correlation to DPC++ interface 2. add unit test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * 1. move local host to distributed host 2. add cluster test 3. code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * Update ci-cluster-test.sh * Update build.sh * Update build.sh * Update OneDAL.cpp * Update OneDAL.cpp * Update OneDAL.cpp * Update com_intel_oap_mllib_OneDAL__.h * update code style Signed-off-by: minmingzhu <[email protected]> * Update NaiveBayesResult.java * 1. update code style 2. When using the Host/CPU device throws a fail Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update OneDAL.scala Signed-off-by: minmingzhu <[email protected]> * revert ALS.scala * revert checkstyle.xml * :Revert "revert checkstyle.xml" This reverts commit 4f74bac. * disable cluster test for gpu * disable cluster test for gpu * nit * migrate cpa to DPC++ Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update OutputHelpers.hpp * update com_intel_oap_mllib_feature_PCADALImpl.h Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update PCADALImpl.scala Signed-off-by: minmingzhu <[email protected]> * 1. update function name and variable name Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update stayHomogenTablePtrToVector to saveHomogenTablePtrToVector Signed-off-by: minmingzhu <[email protected]> * change compute_device to ComputeDevice Signed-off-by: minmingzhu <[email protected]> * 1. migrate pca to DPC++ 2. add unit test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * normalize data Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * 1. migrate correlation to DPC++ interface 2. add unit test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update prepare-build-deps-gpu.sh * update Signed-off-by: minmingzhu <[email protected]> * Update Makefile * Update OutputHelpers.hpp * Update PCAOneAPIImpl.cpp * Update service.h * update Signed-off-by: minmingzhu <[email protected]> * Update OneDAL.scala * Update PCADALImpl.scala * Update KmeansHomogenTableSuite.scala * Update TestCommon.scala * Update test.sh * update Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> Signed-off-by: minmingzhu <[email protected]> Co-authored-by: minmingz <[email protected]> Co-authored-by: Wu, Xiaochang <[email protected]>

* add low order moments Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rename unit filename Signed-off-by: minmingzhu <[email protected]> Signed-off-by: minmingzhu <[email protected]>

Signed-off-by: minmingzhu <[email protected]>

2. rollback adjustment cache Signed-off-by: minmingzhu <[email protected]>

Signed-off-by: minmingzhu <[email protected]>

… allocation (oap-project#235) * Migrate KMeans daal to DPC++ (oap-project#209) * 1. add JNI wrapper 2. modify compiler config 3. add unit test Signed-off-by: minmingzhu <[email protected]> * add ci test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * java code style Signed-off-by: minmingzhu <[email protected]> * cpp code style Signed-off-by: minmingzhu <[email protected]> * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update prepare-build-deps.sh * add convert array, vector to homogentable Signed-off-by: minmingzhu <[email protected]> * 1. rollback ci config 2. remove CI test becaue homogentable only support GPU Signed-off-by: minmingzhu <[email protected]> * 1. update prepare-build-deps.sh Signed-off-by: minmingzhu <[email protected]> * remove ci GPU test Signed-off-by: minmingzhu <[email protected]> * 1. remove GPU CI test Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * 1. fix ci Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * fix comment Signed-off-by: minmingzhu <[email protected]> * Update build-jni.sh * update Makefile Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * fix link libze_loader.so.1 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci-local-dpc-test.sh Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update ci-local-dpc-test.sh * Update GPU.cpp * Update GPU.cpp * Update ci-build-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update HomogenTableImpl.cpp Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * update HomogenTable API Signed-off-by: minmingzhu <[email protected]> * update install-build-level-zero-deps-ubuntu.sh Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update run.sh * Update build-jni.sh * 1. Merge branch 'make_homogen_table' into convert_homogentable 2. update ci 3. add a new parameters for HomogenTable class Signed-off-by: minmingzhu <[email protected]> * Update pom.xml * Update test.sh * Update Makefile * update Signed-off-by: minmingzhu <[email protected]> * Update ConvertHomogenTableSuite.scala * Update install-level-zero-ubuntu.sh * Update install-level-zero-ubuntu.sh * Update build.sh * Update test.sh * Update test.sh * Update HomogenTableImpl.cpp * Update install-build-deps-ubuntu.sh * Update HomogenTableImpl.cpp * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * Update install-build-deps-ubuntu.sh * fix comments Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update list-compute-devices.cpp * Convert homogentable to array/vector/matrix (#4) * 1. convert homogenTable to array/vector/matrix 2. add unit test Signed-off-by: minmingzhu <[email protected]> * Merge branch 'make_homogen_table' into convert_homogentable Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * Convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable (#8) * 1. convert rdd to HomogenTable * 2. add unit test Signed-off-by: minmingzhu <[email protected]> * add empty homogentable Signed-off-by: minmingzhu <[email protected]> * Mirgate kmeans daal to DPC++ (#7) Signed-off-by: minmingzhu <[email protected]> * 1. Mirgate kmeans daal to DPC++ * 2. add unit test * 1. move local host to distributed host 2. add cluster test 3. code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * Update ci-cluster-test.sh * Update build.sh * Update build.sh * Update OneDAL.cpp * Update OneDAL.cpp * Update OneDAL.cpp * Update com_intel_oap_mllib_OneDAL__.h * update code style Signed-off-by: minmingzhu <[email protected]> * Update NaiveBayesResult.java * 1. update code style 2. When using the Host/CPU device throws a fail Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update OneDAL.scala Signed-off-by: minmingzhu <[email protected]> * revert ALS.scala * revert checkstyle.xml * :Revert "revert checkstyle.xml" This reverts commit 4f74bac. * disable cluster test for gpu * disable cluster test for gpu * nit Co-authored-by: minmingz <[email protected]> Co-authored-by: Wu, Xiaochang <[email protected]> * Migrate pca daal to DPC++ (oap-project#223) * 1. add JNI wrapper 2. modify compiler config 3. add unit test Signed-off-by: minmingzhu <[email protected]> * add ci test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * java code style Signed-off-by: minmingzhu <[email protected]> * cpp code style Signed-off-by: minmingzhu <[email protected]> * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update prepare-build-deps.sh * add convert array, vector to homogentable Signed-off-by: minmingzhu <[email protected]> * 1. rollback ci config 2. remove CI test becaue homogentable only support GPU Signed-off-by: minmingzhu <[email protected]> * 1. update prepare-build-deps.sh Signed-off-by: minmingzhu <[email protected]> * remove ci GPU test Signed-off-by: minmingzhu <[email protected]> * 1. remove GPU CI test Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * 1. fix ci Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * fix comment Signed-off-by: minmingzhu <[email protected]> * Update build-jni.sh * update Makefile Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * fix link libze_loader.so.1 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci-local-dpc-test.sh Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update ci-local-dpc-test.sh * Update GPU.cpp * Update GPU.cpp * Update ci-build-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update HomogenTableImpl.cpp Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * update HomogenTable API Signed-off-by: minmingzhu <[email protected]> * update install-build-level-zero-deps-ubuntu.sh Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update run.sh * Update build-jni.sh * 1. Merge branch 'make_homogen_table' into convert_homogentable 2. update ci 3. add a new parameters for HomogenTable class Signed-off-by: minmingzhu <[email protected]> * Update pom.xml * Update test.sh * Update Makefile * update Signed-off-by: minmingzhu <[email protected]> * Update ConvertHomogenTableSuite.scala * Update install-level-zero-ubuntu.sh * Update install-level-zero-ubuntu.sh * Update build.sh * Update test.sh * Update test.sh * Update HomogenTableImpl.cpp * Update install-build-deps-ubuntu.sh * Update HomogenTableImpl.cpp * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * Update install-build-deps-ubuntu.sh * fix comments Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update list-compute-devices.cpp * Convert homogentable to array/vector/matrix (#4) * 1. convert homogenTable to array/vector/matrix 2. add unit test Signed-off-by: minmingzhu <[email protected]> * Merge branch 'make_homogen_table' into convert_homogentable Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * Convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable (#8) * 1. convert rdd to HomogenTable * 2. add unit test Signed-off-by: minmingzhu <[email protected]> * add empty homogentable Signed-off-by: minmingzhu <[email protected]> * Mirgate kmeans daal to DPC++ (#7) Signed-off-by: minmingzhu <[email protected]> * 1. Mirgate kmeans daal to DPC++ * 2. add unit test * 1. move local host to distributed host 2. add cluster test 3. code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * Update ci-cluster-test.sh * Update build.sh * Update build.sh * Update OneDAL.cpp * Update OneDAL.cpp * Update OneDAL.cpp * Update com_intel_oap_mllib_OneDAL__.h * update code style Signed-off-by: minmingzhu <[email protected]> * Update NaiveBayesResult.java * 1. update code style 2. When using the Host/CPU device throws a fail Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update OneDAL.scala Signed-off-by: minmingzhu <[email protected]> * revert ALS.scala * revert checkstyle.xml * :Revert "revert checkstyle.xml" This reverts commit 4f74bac. * disable cluster test for gpu * disable cluster test for gpu * nit * migrate cpa to DPC++ Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update OutputHelpers.hpp * update com_intel_oap_mllib_feature_PCADALImpl.h Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update PCADALImpl.scala Signed-off-by: minmingzhu <[email protected]> * 1. update function name and variable name Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update stayHomogenTablePtrToVector to saveHomogenTablePtrToVector Signed-off-by: minmingzhu <[email protected]> * change compute_device to ComputeDevice Signed-off-by: minmingzhu <[email protected]> Co-authored-by: minmingz <[email protected]> Co-authored-by: Wu, Xiaochang <[email protected]> * [ML-226] Migrate correlation daal to DPC++ (oap-project#215) * 1. add JNI wrapper 2. modify compiler config 3. add unit test Signed-off-by: minmingzhu <[email protected]> * add ci test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * java code style Signed-off-by: minmingzhu <[email protected]> * cpp code style Signed-off-by: minmingzhu <[email protected]> * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update ci-local-test.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update install-build-deps-ubuntu.sh * Update prepare-build-deps.sh * add convert array, vector to homogentable Signed-off-by: minmingzhu <[email protected]> * 1. rollback ci config 2. remove CI test becaue homogentable only support GPU Signed-off-by: minmingzhu <[email protected]> * 1. update prepare-build-deps.sh Signed-off-by: minmingzhu <[email protected]> * remove ci GPU test Signed-off-by: minmingzhu <[email protected]> * 1. remove GPU CI test Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * 1. fix ci Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update header Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update ci conf Signed-off-by: minmingzhu <[email protected]> * fix comment Signed-off-by: minmingzhu <[email protected]> * Update build-jni.sh * update Makefile Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update test.sh * Update test.sh * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * update test.sh Signed-off-by: minmingzhu <[email protected]> * fix link libze_loader.so.1 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci-local-dpc-test.sh Signed-off-by: minmingzhu <[email protected]> * update oneapi to 2022.1.2 Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Makefile Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps-gpu.sh * Update prepare-build-deps.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update install-build-level-zero-deps-ubuntun.sh * Update ci-local-dpc-test.sh * Update GPU.cpp * Update GPU.cpp * Update ci-build-test.sh * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update HomogenTableImpl.cpp Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * Update ci-local-dpc-test.sh * update HomogenTable API Signed-off-by: minmingzhu <[email protected]> * update install-build-level-zero-deps-ubuntu.sh Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * Update ci-local-dpc-test.sh * update ci Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * update ci Signed-off-by: minmingzhu <[email protected]> * Update run.sh * Update build-jni.sh * 1. Merge branch 'make_homogen_table' into convert_homogentable 2. update ci 3. add a new parameters for HomogenTable class Signed-off-by: minmingzhu <[email protected]> * Update pom.xml * Update test.sh * Update Makefile * update Signed-off-by: minmingzhu <[email protected]> * Update ConvertHomogenTableSuite.scala * Update install-level-zero-ubuntu.sh * Update install-level-zero-ubuntu.sh * Update build.sh * Update test.sh * Update test.sh * Update HomogenTableImpl.cpp * Update install-build-deps-ubuntu.sh * Update HomogenTableImpl.cpp * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * Update install-build-deps-ubuntu.sh * fix comments Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update list-compute-devices.cpp * Convert homogentable to array/vector/matrix (#4) * 1. convert homogenTable to array/vector/matrix 2. add unit test Signed-off-by: minmingzhu <[email protected]> * Merge branch 'make_homogen_table' into convert_homogentable Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * Convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable (#8) * 1. convert rdd to HomogenTable * 2. add unit test Signed-off-by: minmingzhu <[email protected]> * add empty homogentable Signed-off-by: minmingzhu <[email protected]> * Mirgate kmeans daal to DPC++ (#7) Signed-off-by: minmingzhu <[email protected]> * 1. Mirgate kmeans daal to DPC++ * 2. add unit test * 1. migrate pca to DPC++ 2. add unit test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * normalize data Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * 1. migrate correlation to DPC++ interface 2. add unit test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * 1. move local host to distributed host 2. add cluster test 3. code style Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update ci-cluster-test.sh * Update ci-cluster-test.sh * Update build.sh * Update build.sh * Update OneDAL.cpp * Update OneDAL.cpp * Update OneDAL.cpp * Update com_intel_oap_mllib_OneDAL__.h * update code style Signed-off-by: minmingzhu <[email protected]> * Update NaiveBayesResult.java * 1. update code style 2. When using the Host/CPU device throws a fail Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback code style Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rollback checkstyle.xml Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update OneDAL.scala Signed-off-by: minmingzhu <[email protected]> * revert ALS.scala * revert checkstyle.xml * :Revert "revert checkstyle.xml" This reverts commit 4f74bac. * disable cluster test for gpu * disable cluster test for gpu * nit * migrate cpa to DPC++ Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update OutputHelpers.hpp * update com_intel_oap_mllib_feature_PCADALImpl.h Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update PCADALImpl.scala Signed-off-by: minmingzhu <[email protected]> * 1. update function name and variable name Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update stayHomogenTablePtrToVector to saveHomogenTablePtrToVector Signed-off-by: minmingzhu <[email protected]> * change compute_device to ComputeDevice Signed-off-by: minmingzhu <[email protected]> * 1. migrate pca to DPC++ 2. add unit test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * normalize data Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * 1. migrate correlation to DPC++ interface 2. add unit test Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * Update prepare-build-deps-gpu.sh * update Signed-off-by: minmingzhu <[email protected]> * Update Makefile * Update OutputHelpers.hpp * Update PCAOneAPIImpl.cpp * Update service.h * update Signed-off-by: minmingzhu <[email protected]> * Update OneDAL.scala * Update PCADALImpl.scala * Update KmeansHomogenTableSuite.scala * Update TestCommon.scala * Update test.sh * update Signed-off-by: minmingzhu <[email protected]> * fix comments Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> Signed-off-by: minmingzhu <[email protected]> Co-authored-by: minmingz <[email protected]> Co-authored-by: Wu, Xiaochang <[email protected]> * [ML-227] Migrate moments daal to DPC++ (oap-project#229) * add low order moments Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * rename unit filename Signed-off-by: minmingzhu <[email protected]> Signed-off-by: minmingzhu <[email protected]> * change select_device to assign gpus Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * update GPU.cpp Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update GPU.cpp Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * update Signed-off-by: minmingzhu <[email protected]> * oneccl clean Signed-off-by: minmingzhu <[email protected]> * data cache Signed-off-by: minmingzhu <[email protected]> * data cache Signed-off-by: minmingzhu <[email protected]> * data cache Signed-off-by: minmingzhu <[email protected]> * update scala style Signed-off-by: minmingzhu <[email protected]> * 1. update output 2. rollback adjustment cache Signed-off-by: minmingzhu <[email protected]> * update PCA.scala Signed-off-by: minmingzhu <[email protected]> * update output Signed-off-by: minmingzhu <[email protected]> * update code style Signed-off-by: minmingzhu <[email protected]> * Refactor header file references Signed-off-by: minmingzhu <[email protected]> * rename cpp Signed-off-by: minmingzhu <[email protected]> --------- Signed-off-by: minmingzhu <[email protected]> Co-authored-by: minmingz <[email protected]> Co-authored-by: Wu, Xiaochang <[email protected]>

minmingzhu changed the title ~~Assign gpu~~ [ML-250]Assign gpu Mar 21, 2023

minmingzhu closed this Apr 9, 2023

minmingzhu reopened this Apr 10, 2023

minmingzhu changed the base branch from oneapi_interface to master April 10, 2023 02:31

minmingzhu changed the title ~~[ML-250]Assign gpu~~ [ML-250] Assign gpu Apr 12, 2023

minmingzhu force-pushed the assign_gpu branch from 4c9922b to 43bf54d Compare April 14, 2023 03:15

minmingzhu changed the title ~~[ML-250] Assign gpu~~ [ML-250] Replace select_gpu with manual GPU allocation Apr 17, 2023

minmingzhu changed the title ~~[ML-250] Replace select_gpu with manual GPU allocation~~ [ML-250] Replace sycl::gpu_selector{}.select_device() with manual GPU allocation Apr 17, 2023

xwu99 requested changes Apr 18, 2023

View reviewed changes

minmingzhu force-pushed the assign_gpu branch from a73e2a1 to 406062f Compare April 19, 2023 14:12

minmingzhu and others added 18 commits April 19, 2023 14:13

change select_device to assign gpus

ef1df32

Signed-off-by: minmingzhu <[email protected]>

update code style

bd6bd88

Signed-off-by: minmingzhu <[email protected]>

update GPU.cpp

6fe7b19

Signed-off-by: minmingzhu <[email protected]>

update

9929883

Signed-off-by: minmingzhu <[email protected]>

update GPU.cpp

1ee2180

Signed-off-by: minmingzhu <[email protected]>

update

5d3906c

Signed-off-by: minmingzhu <[email protected]>

update

296a00d

Signed-off-by: minmingzhu <[email protected]>

update

610ba45

Signed-off-by: minmingzhu <[email protected]>

update

7b0d4c8

Signed-off-by: minmingzhu <[email protected]>

update

da69a50

Signed-off-by: minmingzhu <[email protected]>

update

49a1715

Signed-off-by: minmingzhu <[email protected]>

oneccl clean

17acf28

Signed-off-by: minmingzhu <[email protected]>

data cache

c7b8a88

Signed-off-by: minmingzhu <[email protected]>

data cache

9b7b3e0

Signed-off-by: minmingzhu <[email protected]>

minmingzhu added 8 commits April 19, 2023 14:13

data cache

0ffc272

Signed-off-by: minmingzhu <[email protected]>

update scala style

4da9700

Signed-off-by: minmingzhu <[email protected]>

1. update output

117775a

2. rollback adjustment cache Signed-off-by: minmingzhu <[email protected]>

update PCA.scala

52c9375

Signed-off-by: minmingzhu <[email protected]>

update output

bbf0ef9

Signed-off-by: minmingzhu <[email protected]>

update code style

627dd42

Signed-off-by: minmingzhu <[email protected]>

Refactor header file references

406062f

Signed-off-by: minmingzhu <[email protected]>

rename cpp

c20a4e6

Signed-off-by: minmingzhu <[email protected]>

xwu99 approved these changes Apr 21, 2023

View reviewed changes

xwu99 merged commit c97b1b2 into oap-project:master Apr 21, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[ML-250] Replace sycl::gpu_selector{}.select_device() with manual GPU allocation #235

[ML-250] Replace sycl::gpu_selector{}.select_device() with manual GPU allocation #235

minmingzhu commented Nov 22, 2022

github-actions bot commented Nov 22, 2022

github-actions bot commented Mar 21, 2023

xwu99 Apr 18, 2023

xwu99 Apr 18, 2023

xwu99 Apr 18, 2023

minmingzhu Apr 18, 2023

xwu99 Apr 18, 2023

xwu99 Apr 18, 2023

minmingzhu Apr 18, 2023

[ML-250] Replace sycl::gpu_selector{}.select_device() with manual GPU allocation #235

[ML-250] Replace sycl::gpu_selector{}.select_device() with manual GPU allocation #235

Conversation

minmingzhu commented Nov 22, 2022

What changes were proposed in this pull request?

github-actions bot commented Nov 22, 2022

github-actions bot commented Mar 21, 2023

xwu99 Apr 18, 2023

Choose a reason for hiding this comment

xwu99 Apr 18, 2023

Choose a reason for hiding this comment

xwu99 Apr 18, 2023

Choose a reason for hiding this comment

minmingzhu Apr 18, 2023

Choose a reason for hiding this comment

xwu99 Apr 18, 2023

Choose a reason for hiding this comment

xwu99 Apr 18, 2023

Choose a reason for hiding this comment

minmingzhu Apr 18, 2023

Choose a reason for hiding this comment