Skip to content

Distributed Data Management - Exercises

License

Notifications You must be signed in to change notification settings

elangenhan/distriba

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

94 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

distriba

Distributed Data Management - Exercises

DDM-LMP

Notes

LargeMessageProxy Excercise is solved using Akka 2.6.0 -> reference.conf in Tests has been modified to conform with new regulations

Kryo currently has a Problem with Illegal reflective access by com.esotericsoftware.kryo.util.UnsafeUtil (EsotericSoftware/kryo#543)

-> this can be avoided by starting java with the "--illegal-access=deny" option enabled. Functionality seems unaffected for the purpose of the exercise.

Tests

The implementation was tested on serveral machines:

  1. Normal Machines: 13" MacBook Pro 2017 (8GB Ram i5), a 15" MacBook Pro 2019 (32GB Ram, i9), a desktop machine (24GB Ram i5) --> on these machines remote execution works flawlessly up to 9 workers

  2. Raspberry Pi: 2 Raspberry Pi 3B+ (1GB Ram, Cortex-A53)

    • Remote execution works with up to 10 workers (when using one Raspberry Pi as slave)
    • Remote execution works with up to 18 workers (when using two Raspberry Pis, with 9 workers each)

    JVM memory is extended with "-Xmx1800m" (Swap is configured to 2048 on both machines)

    This is only the tested maximum after which we stopped. Potentially more workes possible!

About

Distributed Data Management - Exercises

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 88.3%
  • Scala 11.7%