Skip to content
/ mentos Public
forked from daskos/mentos

Fresh Python Mesos Scheduler and Executor driver

License

Notifications You must be signed in to change notification settings

Fifan31/mentos

 
 

Repository files navigation

mentos - A Pure Python implementation of a Mesos Scheduler/Executor driver

Long Lasting Mesos freshness for Python

Build Status Coverage Status

The main goal is to provide a low-complexity and feature rich support for pure python Mesos Frameworks, but also to learn things.

There be dragons

mentos is still quite experimental right now. No production frameworks have been built using it.

Notable Features

  • Pure python so no C++ meddling
  • Full featured Zookeeper and Redirect based Master detection
  • Dict based for simplicity
  • Task scheduling should be quite fast due to the asynchronous nature of the networking engine
  • Nice policy based reconnect and retry system
  • Fancy Testing and Development enviroment based on docker-compose

Install

Not on pypi right now. Install from this repository.

Tested Python Versions:

  • 2.7
  • 3.5
  • 3.6

Requirements:

  • Mesos > 0.28
  • Zookeeper

Development

Run docker-compose up to get a working instalation of Mesos going.

Requirements:

  • docker
  • docker-compose > 1.6.0

Examples

An example Mesos Scheduler and Executor can be found in the examples folder. It runs one task and then starts declining offers. The Task basically transmits and prints a message. Excuse the magic.

Tests

  • utils
  • states
  • interface
  • retry
  • exceptions
  • connection
  • subscription
  • executor
  • scheduler

Documentation

Not there yet

Outlook

The long term goal is for this to serve as a base for Satyr and other more high level Python based frameworks.

Acknowledgements

This has been heavily based on zoonado and was influenced by Satyr and PyMesos and shares some utility code with both. The RecordIO format parsing was lifted from mrocklins gist.

About

Fresh Python Mesos Scheduler and Executor driver

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 99.4%
  • Shell 0.6%