Open Source Python Distributed Computing Software

CGRU is an open source CG tools pack, includes Afanasy render farm manager and RULES project tracker.

<<Hack|Track GNU/Linux is an open source operating system developed by the HTGL Project from Indonesia which provides penetration testing.

Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids. It is based on a hierarchical design targeted at federations of clusters. Supports clusters up to 2000 nodes in size.

FRODO is a Java platform to solve Distributed Constraint Satisfaction Problems (DisCSPs) and Optimization Problems (DCOPs). It provides implementations for a variety of algorithms, including DPOP (and its variants), ADOPT, SynchBB, DSA...

CloudI is an open-source private cloud computing framework for efficient, secure, and internal data processing. CloudI provides scaling for previously unscalable source code with efficient fault-tolerant execution of ATS, C/C++, Erlang/Elixir, Go, Haskell, Java, JavaScript/node.js, OCaml, Perl, PHP, Python, Ruby, or Rust services. The bare essentials for efficient fault-tolerant processing on a cloud!

The purpose of the project is to develop a portable programming framework that facilitates distributed and multi-threaded programming for C++, Java, and Python. MADARA was originally developed as an agent-based middleware specifically for real-time, distributed artificial intelligence, but is now more general purpose for distributed timing, control, knowledge and reasoning, and quality-of-service. MADARA is composed of several tools and middleware, and the main entry point into the system is the Knowledge and Reasoning Language (KaRL) Engine, which provides a real-time scripting language for nanosecond execution times hooked into a flexible transport layer for distributed reasoning. The KaRL engine also supports object-oriented C++, Java, and Python programming through Containers, classes that provide abstractions and references for variable location within the KaRL Knowledge Base. This project is currently in process of being ported from http://madara.googlecode.com.

Released August 22, 2013 Lubuntu Blends: Biochemistry 13.04 (Raring) v5.44 Linux Kernel Image 3.8.0-29 Lubuntu Blends are pre-installed Wubi disk image remixes of Ubuntu and Debian Science meta packages, A custom boot loader allows installations to be copied and automatically booted from most external or USB flash drives. Once up and running, use earlier Lubuntu Remix README instructions here until documentation is updated. https://sourceforge.net/projects/portable-linux/files/ Installation 1. Download the Wubi installer http://releases.ubuntu.com/saucy/wubi.exe 2. Install any flavor of Ubuntu. 3. Swap out the root.disk with the ones provided here. Overview LAMP stack running on localhost (127.0.0.1). Scientific, productivity & media packages include R (Rattle Data Miner), GridEngine, Condor, cooperative computing tools, WINE, LibreOffice, Evolution, Clinica, Neuro Debian Desktop, PsycoPy, OpenVibe, 3DSlicer, Paraview, Openshot. Cheers, Gregory Remington

dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing.

Dispyte is an expendable, fault tolerant task scheduler which distributes computationally expensive tasks across a heterogeneous network.

Dowser is a research tool for the web. It clusters results from search engines, associates words that appear in previous searches, and keeps a local cache of all the results you click on in a searchable database. It helps you keep track of what you find.

A modern secure, robust, multithreaded, exception aware, internationalisable, portable GUI toolkit library designed for mission-critical work in C++ and Python forked from the FOX library. Replicates the Qt API in many places.

Slurm is a replacement for other resource management software and schedulers like gridengine or torque. The slurm roll integrates very well into a rocks clusters installation. In the folder addons, there are a lot of useful rolls for rocks clusters 6.1 and 6.2. These rolls do not depend on slurm. Please see Discussion for further information and support

isectd is a middleware daemon that provides many-to-many client-to-server connectivity. Supports multiplexing requests to multiple server processes over IP networks.

SnowFlock enables high performance computing on virtual machine (VM)-based cloud environments. In SnowFlock, a VM transparently becomes a cluster of VMs by cloning in sub-second time into multiple copies executing on different physical hosts.

FLoM is a free open source distributed lock manager that can be used to synchronize shell commands, scripts and custom developed software. When used in a shell environment, FLoM manages process synchronization in the same way that "nice" manages process prioritization. Shell commands, scripts and custom programs can be synchronized inside a single system or in a network of IP connected systems. FLoM supports different types of abstract resources: simple, numeric, set, hierarchical and transactional sequence. libflom, the library shipped with FLoM, allows you to develop your own application using a simple C, C++, Java, Perl, PHP or Python client API. SSL/TLS security for network communication, X.509 certificates for peer to peer mutual authentication.

A Console-based BitTorrent Client with built-in scheduler for handling multiple sessions. It is designed to manage sessions in queue easily without heavy-weight GUI. External module can search for new torrents in trackers and submit it automatically.

The goal of this project is to make possible to access Progress database from any external program that can use sockets. The server (broker and agents) are written in Progress 4GL and made use of sockets capabilities of Progress V9.

HaDeS is a deployment system for large scale installation. Designed to be scalable with respect the number of nodes and agnostic with respect the OS deployed, it has a Web Service interface that allows an easy integration in complex SOA systems.

The Job Jar is a simple batch queuing system for Unix. Its main distinguishing feature is that there is no central daemon. Instead, an arbitrary set of workers cooperatively claim jobs from a central directory. A job is any Unix executable file.

Maui Scheduler is an advanced reservation HPC parallel batch scheduler for use with Linux and BSD clusters. Maui provides a complete scientific scheduling solution, supporting running custom parallel and MPI jobs over Myrinet and ethernet.

PBS Cluster Viz is a project to display information useful to admins and users about a computing cluster managed by a PBS-compatible resource manager. Information includes load and job distribution. Interactive as well as static output is available.

RPyC, or Remote Python Call, is a transparent and symmetrical python library for remote procedure calls, clustering and distributed-computing.

The Systems Biology Workbench(SBW) is a framework for application intercommunications. It uses a broker-based, distributed, message-passing architecture, supports many languages including Java, C++, Perl & Python, and runs under Linux,OSX & Win32. It comes with a large number of modules, encompassing the whole modeling cycle: creating computational models, simulating and analyzing them, visualizing the information, in order to improve the models. All using community standards, such as SED-ML, SBML and MIRIAM.

TaskManager is an open source infrastructure software for distributing and managing calculation jobs in a Unix computer cluster environment. The TaskManager was designed to control the utilization of a set of hosts even if you are not the administrator of the system. The hosts are embedded in a Unix environment and the user's home directories are mounted on each host. The hosts may have different numbers of CPUs/cores and different kernels. Keep in mind that a user is able to log into each host and calculate on it. However, he should use the TaskManager to submit calculation jobs to the cluster to avoid an overload of the hosts. Jobs which are under the control of the TaskManager are executed on a host of the computer cluster with the rights of the respective user to ensure that the executing jobs have the permission to access the user's files.