Concurrency and Parallelism

Parallelformers, which is based on Megatron LM, is designed to make model parallelization easier.

Reference links for my live demo talk from DockerCon 21.

python wrappers for easy multiprocessing and threading

A guide to using Lua in Neovim

pagmo IMPORTANT NOTICE: pygmo, the Python bindings for pagmo, have been split off into a separate project, hosted here. Please update your bookmarks! pagmo is a C++ scientific library for massively parallel

Decorated Concurrency A simplified parallel computing model for Python. DECO automatically parallelizes Python programs, and requires minimal modifications to existing serial programs. Install using pip: pip insta

KAIST CS492: Design and Analysis of Concurrent Programs Logistics Instructor: Jeehoon Kang Time & Place: Mon & Wed 09:00am-10:15am, Rm 2111, Bldg E3-1 Website: https://github.com/kaist

aiochan Aiochan is a library written to bring the wonderful idiom of CSP-style concurrency to python. The implementation is based on the battle-tested Clojure library core.async, while the API is careful

Charm4py Charm4py (Charm++ for Python -formerly CharmPy-) is a distributed computing and parallel programming framework for Python, for the productive development of fast, parallel and scalable applications. It i

SCOOP (Scalable COncurrent Operations in Python) is a distributed task module allowing concurrent parallel programming on various environments, from heterogeneous grids to supercomputers. Its documentation is available on http:/

Tomorrow Magic decorator syntax for asynchronous code in Python 2.7. Please don't actually use this in production. It's more of a thought experiment than anything else, and relies heavily on behavior specific to Pyt

The greenlet package is a spin-off of Stackless, a version of CPython that supports micro-threads called "tasklets". Tasklets run pseudo-concurrently (typically in a single or a few OS-level threads) and are synchronized with da