Skip to content

Commit

Permalink
[SPARK-7050] [BUILD] Fix Python Kafka test assembly jar not found iss…
Browse files Browse the repository at this point in the history
…ue under Maven build

 To fix Spark Streaming unit test with maven build. Previously the name and path of maven generated jar is different from sbt, which will lead to following exception. This fix keep the same behavior with both Maven and sbt build.

```
Failed to find Spark Streaming Kafka assembly jar in /home/xyz/spark/external/kafka-assembly
You need to build Spark with  'build/sbt assembly/assembly streaming-kafka-assembly/assembly' or 'build/mvn package' before running this program
```

Author: jerryshao <[email protected]>

Closes #5632 from jerryshao/SPARK-7050 and squashes the following commits:

74b068d [jerryshao] Fix mvn build issue
  • Loading branch information
jerryshao authored and srowen committed Jul 8, 2015
1 parent 351a36d commit 8a9d9cc
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions external/kafka-assembly/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -58,6 +58,7 @@
<artifactId>maven-shade-plugin</artifactId>
<configuration>
<shadedArtifactAttached>false</shadedArtifactAttached>
<outputFile>${project.build.directory}/scala-${scala.binary.version}/spark-streaming-kafka-assembly-${project.version}.jar</outputFile>
<artifactSet>
<includes>
<include>*:*</include>
Expand Down

0 comments on commit 8a9d9cc

Please sign in to comment.