-
Notifications
You must be signed in to change notification settings - Fork 75
Encountered Hadoop version (3.2.1) conflict issue on AWS EMR-6.3.0 #368
Comments
@zhouyuan @weiting-chen @zhixingheyi-tian Please help to track the issue. Thanks! |
please try to re-build your package by |
Yes, I can confirm this issue is from hadoop version support. |
the |
@zhouyuan @weiting-chen After I rebuild native-sql-engine by "mvn clean package -am -DskipTests -Dcpp_tests=OFF -Dbuild_arrow=OFF -Dstatic_arrow=OFF -Dbuild_protobuf=ON -Phadoop-3.2", we meet new issue like: |
Let's use Hadoop 3.2.1 and ignore the error in 3.2.0 since AWS EMR 6.3.0 supports 3.2.1. |
For OAP-1.2, we target to support all features on cloud. We choose emr-6.3.0 and the versions of software are showed below:
![image](https://user-images.githubusercontent.com/44394375/122194105-b70f9e80-cec7-11eb-9ff7-9ff17cbd98c9.png)
![image](https://user-images.githubusercontent.com/44394375/122194530-1c638f80-cec8-11eb-9180-65ba583d9664.png)
We try to start spark-shell after adding extra configurations for native-sql-engine and we encounter the issue like:
Is the issued caused by incompatible hadoop version?
The text was updated successfully, but these errors were encountered: