Sacred

Sacred is a tool to help you configure, organize, log and reproduce experiments. It is designed to do all the tedious overhead work that you need to do around your actual experiment. A very convenient way of the local variables in a function to define the parameters your experiment uses. You can access all parameters of your configuration from every function. They are automatically injected by name. You get a powerful command-line interface for each experiment that you can use to change parameters and run different variants. Observers that log all kinds of information about your experiment, its dependencies, the configuration you used, the machine it is run on, and of course the result. These can be saved to a MongoDB, for easy access later.