Skip to content

Commit

Permalink
[SPARK-2859] Update url of Kryo project in related docs
Browse files Browse the repository at this point in the history
JIRA Issue: https://issues.apache.org/jira/browse/SPARK-2859

Kryo project has been migrated from googlecode to github, hence we need to update its URL in related docs such as tuning.md.

Author: Guancheng (G.C.) Chen <[email protected]>

Closes #1782 from gchen/kryo-docs and squashes the following commits:

b62543c [Guancheng (G.C.) Chen] update url of Kryo project
(cherry picked from commit ac3440f)

Signed-off-by: Patrick Wendell <[email protected]>
  • Loading branch information
gchen authored and pwendell committed Aug 5, 2014
1 parent 388ab53 commit 0f541ab
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/tuning.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ in your operations) and performance. It provides two serialization libraries:
[`java.io.Externalizable`](http://docs.oracle.com/javase/6/docs/api/java/io/Externalizable.html).
Java serialization is flexible but often quite slow, and leads to large
serialized formats for many classes.
* [Kryo serialization](http://code.google.com/p/kryo/): Spark can also use
* [Kryo serialization](https://github.com/EsotericSoftware/kryo): Spark can also use
the Kryo library (version 2) to serialize objects more quickly. Kryo is significantly
faster and more compact than Java serialization (often as much as 10x), but does not support all
`Serializable` types and requires you to *register* the classes you'll use in the program in advance
Expand Down Expand Up @@ -68,7 +68,7 @@ conf.set("spark.kryo.registrator", "mypackage.MyRegistrator")
val sc = new SparkContext(conf)
{% endhighlight %}

The [Kryo documentation](http://code.google.com/p/kryo/) describes more advanced
The [Kryo documentation](https://github.com/EsotericSoftware/kryo) describes more advanced
registration options, such as adding custom serialization code.

If your objects are large, you may also need to increase the `spark.kryoserializer.buffer.mb`
Expand Down

0 comments on commit 0f541ab

Please sign in to comment.