A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.

Toil is a scalable, efficient, cross-platform (Linux & macOS) pipeline management system, written entirely in Python, and designed around the principles of functional programming. Check the website for a description of Toil and i

Join the chat at https://gitter.im/bd2k-genomics-toil/Lobby

Toil is a scalable, efficient, cross-platform (Linux & macOS) pipeline management system, written entirely in Python, and designed around the principles of functional programming.

Check the website for a description of Toil and its features.
Full documentation for the latest stable release can be found at Read the Docs.
Please subscribe to low-volume announce mailing list so we keep you informed
Google Groups discussion forum
See our occasional blog for tutorials.

Notes:

Toil moved from https://github.com/BD2KGenomics/toil to https://github.com/DataBiosphere/toil on July 5th, 2018.
Toil dropped python 2.7 support on February 13, 2020 (last working py2.7 version is 3.24.0).

307 Open More issues

Closed

Continue the pymesos port

I'm PR-ing this against the other PR to see if I can convince the tests to run, because Courtyard can't run the tests properly due to the absence of Docker availability.

opened Aug 31, 2018 by adamnovak 75

Closed

WDL basic support. Alpha testing phase.

Support for .wdl files currently working for the GATK tutorials 1-4 on the WDL webpage. Have not tested on any other files, so currently this is still in alpha.

in progress

opened Aug 14, 2017 by DailyDreaming 74

Closed

Initial PBS/Torque support and AbstractBatchSystem refactoring

This is a preliminary run at adding PBS/Torque support, designed off the SLURM and SGE classes. Tests have also been added.

Resolves #1163

opened Oct 6, 2016 by cjfields 68

Closed

Add Spark cluster service (resolves #774)

Resolves #774.

Ping @benedictpaten

firecloud services spark/adam

opened Apr 13, 2016 by fnothaft 63

Closed

Support for Slurm batchSystem (resolves #682)

Implements support for slurm scheduler

SlurmBatchSystem class is modeled after GridengineBatchSystem
Maps AbstractBatchSystem methods to sbatch, squeue, scancel, sacct, sinfo subprocess calls
Includes SlurmBatchSystemTest for testing system

opened Mar 17, 2016 by dleehr 49

Closed

Set workdir to default to the executor sandbox in mesos (resolves #1143)

resolves #1143

The hierarchy of workdir is now: User-specified workdir > (sandox if mesos) > ENV TOIL_WORKDIR > ENV TMPDIR

opened Sep 7, 2016 by arkal 45

Open

document toil-cwl-runner + "Running the Leader Outside Kubernetes"

I'm trying to execute a CWL workflow on a local Kubernetes cluster. The basic example described in the documentation works perfectly (Option 2). However, my specific CWL workflow requires --no-match-user option when running using toil-cwl-runner. How to specify this option in a script? Thanks in advance!

┆Issue is synchronized with this Jira Task ┆Issue Number: TOIL-780

opened Jan 18, 2021 by imilos 3

Open

Add basic WDL 1.0 support

Changelog Entry

To be copied to the draft changelog by merger:

Add basic WDL 1.0 support.

opened Jan 14, 2021 by w-gao 0

Open

Additional check for predecessors.

I don't think that not promises[s].hasFollowOn(wfjob) was doing what it was supposed to do.

Resolves #3408.

Changelog Entry

To be copied to the draft changelog by merger:

Additional check for predecessors.

opened Jan 11, 2021 by DailyDreaming 1

Open

Balance across spot pools in deployed Kubernetes ASGs

┆Issue is synchronized with this Jira Task ┆Epic: Scalable kubernetes ┆Issue Number: TOIL-777

opened Jan 8, 2021 by unito-bot 1

Open

Unable to run toil launch-cluster with version 5.2

I am attempting to finally migrate cactus from toil 4.2 to toil 5.2, and am running into problems. First, using my usual command to make a cluster, I get this Invalid provisioner error:

toil launch-cluster glenn-toil52 --leaderNodeType t2.medium --keyPairName [email protected]
Traceback (most recent call last):
  File "/home/hickey/dev/cactus/venv52/bin/toil", line 8, in <module>
    sys.exit(main())
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/toil/utils/toilMain.py", line 26, in main
    module.main()
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/toil/utils/toilLaunchCluster.py", line 99, in main
    check_valid_node_types(options.provisioner, worker_node_types + [options.leaderNodeType])
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/toil/provisioners/__init__.py", line 102, in check_valid_node_types
    raise RuntimeError(f"Invalid provisioner: {provisioner}")
RuntimeError: Invalid provisioner: None

Despite being a new requirement, this option is not described in the short help

usage: Toil [-h] [-p {aws,gce}] [-z ZONE] [--logCritical] [--logError]
            [--logWarning] [--logDebug] [--logInfo] [--logOff]
            [--logLevel {Critical,Error,Warning,Debug,Info,critical,error,warning,debug,info,CRITICAL,ERROR,WARNING,DEBUG,INFO}]
            [--logFile LOGFILE] [--rotatingLogging] [--version]
            [--tempDirRoot TEMPDIRROOT] --leaderNodeType LEADERNODETYPE
            [--keyPairName KEYPAIRNAME] [--owner OWNER] [--boto BOTOPATH]
            [-t NAME=VALUE] [--vpcSubnet VPCSUBNET] [--nodeTypes NODETYPES]
            [-w WORKERS] [--leaderStorage LEADERSTORAGE]
            [--nodeStorage NODESTORAGE] [--forceDockerAppliance]
            [--awsEc2ProfileArn AWSEC2PROFILEARN]
            [--awsEc2ExtraSecurityGroupId AWSEC2EXTRASECURITYGROUPIDS]
            clusterName

and while I'm griping, perhaps a more explicit error for failing to provide a required option would be helpful?

When I try running with --provisioner aws I get this

toil launch-cluster glenn-toil52 --leaderNodeType t2.medium --keyPairName [email protected] --provisioner aws
[2021-01-08T16:12:21-0500] [MainThread] [I] [toil] Using default docker registry of quay.io/ucsc_cgl as TOIL_DOCKER_REGISTRY is not set.
[2021-01-08T16:12:21-0500] [MainThread] [I] [toil] Using default docker name of toil as TOIL_DOCKER_NAME is not set.
[2021-01-08T16:12:21-0500] [MainThread] [I] [toil] Using default docker appliance of quay.io/ucsc_cgl/toil:5.2.0-047d0c4f2949c576c80e452a0807c5be6355c63d-py3.6 as TOIL_APPLIANCE_SELF is not set.
[2021-01-08T16:12:26-0500] [MainThread] [I] [toil] Using default user-defined custom docker init command of  as TOIL_CUSTOM_DOCKER_INIT_COMMAND is not set.
[2021-01-08T16:12:26-0500] [MainThread] [I] [toil] Using default docker registry of quay.io/ucsc_cgl as TOIL_DOCKER_REGISTRY is not set.
[2021-01-08T16:12:26-0500] [MainThread] [I] [toil] Using default docker name of toil as TOIL_DOCKER_NAME is not set.
[2021-01-08T16:12:26-0500] [MainThread] [I] [toil] Using default docker appliance of quay.io/ucsc_cgl/toil:5.2.0-047d0c4f2949c576c80e452a0807c5be6355c63d-py3.6 as TOIL_APPLIANCE_SELF is not set.
[2021-01-08T16:12:26-0500] [MainThread] [I] [toil] Using default user-defined custom init command of  as TOIL_CUSTOM_INIT_COMMAND is not set.
[2021-01-08T16:12:26-0500] [MainThread] [I] [toil.lib.ec2] Creating t2.medium instance(s) ...

Then it asks me for my MFA code, I paste it in, then it asks me again (I've tried several times)

Enter MFA code for arn:aws:iam::652235167018:mfa/[email protected]: 
Enter MFA code for arn:aws:iam::652235167018:mfa/[email protected]:

Then it eventually fails presumably because it didn't like my MFA code?

[2021-01-08T16:12:43-0500] [MainThread] [I] [toil.lib.ec2] Creating t2.medium instance(s) ... 
[2021-01-08T16:12:48-0500] [MainThread] [I] [toil.lib.ec2] Creating t2.medium instance(s) ... 
[2021-01-08T16:12:58-0500] [MainThread] [I] [toil.lib.ec2] Creating t2.medium instance(s) ... 
[2021-01-08T16:13:18-0500] [MainThread] [I] [toil.lib.ec2] Creating t2.medium instance(s) ... 
[2021-01-08T16:13:38-0500] [MainThread] [I] [toil.lib.ec2] Creating t2.medium instance(s) ... 
[2021-01-08T16:13:58-0500] [MainThread] [I] [toil.lib.ec2] Creating t2.medium instance(s) ... 
[2021-01-08T16:14:19-0500] [MainThread] [I] [toil.lib.ec2] Creating t2.medium instance(s) ... 
Traceback (most recent call last):
  File "/home/hickey/dev/cactus/venv52/bin/toil", line 8, in <module>
    sys.exit(main())
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/toil/utils/toilMain.py", line 26, in main
    module.main()
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/toil/utils/toilLaunchCluster.py", line 132, in main
    awsEc2ExtraSecurityGroupIds=options.awsEc2ExtraSecurityGroupIds)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/toil/provisioners/aws/awsProvisioner.py", line 200, in launchCluster
    subnet_id=self._vpcSubnet)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/toil/lib/retry.py", line 246, in call
    return func(*args, **kwargs)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/toil/lib/ec2.py", line 313, in create_instances
    return ec2.create_instances(**actual_request)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/boto3/resources/factory.py", line 520, in do_action
    response = action(self, *args, **kwargs)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(*args, **params)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/client.py", line 663, in _make_api_call
    operation_model, request_dict, request_context)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/client.py", line 682, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/endpoint.py", line 132, in _send_request
    request = self.create_request(request_dict, operation_model)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/endpoint.py", line 116, in create_request
    operation_name=operation_model.name)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/signers.py", line 90, in handler
    return self.sign(operation_name, request)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/signers.py", line 154, in sign
    auth = self.get_auth_instance(**kwargs)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/signers.py", line 234, in get_auth_instance
    frozen_credentials = self._credentials.get_frozen_credentials()
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/credentials.py", line 612, in get_frozen_credentials
    self._refresh()
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/credentials.py", line 507, in _refresh
    self._protected_refresh(is_mandatory=is_mandatory_refresh)
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/credentials.py", line 523, in _protected_refresh
    metadata = self._refresh_using()
  File "/home/hickey/dev/cactus/venv52/lib/python3.6/site-packages/botocore/credentials.py", line 269, in __call__
    raise RefreshWithMFAUnsupportedError()
botocore.exceptions.RefreshWithMFAUnsupportedError: Cannot refresh credentials: MFA token required.

I have never seen anything like this with toil 4.2.

┆Issue is synchronized with this Jira Task ┆Issue Number: TOIL-776

opened Jan 8, 2021 by glennhickey 2

Open

--batchSystem : warn if /tmp is being used for temporary files

if --batchSystem is being used and the result of tempfile.gettempdir() starts with /tmp then we should warn that this location is likely not shared on all the nodes and that one of TEMPDIR/TEMP/TMP should be set to a shared path

┆Issue is synchronized with this Jira Task ┆Issue Number: TOIL-775

opened Jan 8, 2021 by mr-c 0

releases/5.2.0(Jan 8, 2021)

Changelog

CWL

Update to the latest cwltool (3.0.20201121085451 -> 3.0.20201203173111). #3375
Add better handling for potentially mis-ordered CWL args. #3395
Confirm CommandInputParameter expression can receive a File object. #3350

WDL

Make AnalyzeWDL abstract to allow implementation for different WDL versions #3391

Misc

Clean up memoize.py. #3374
Refactor bioio library, simplify logging, and small adjustments to utils. #3351
Use regular division for memory calculation on LSF. #3387
Remove unused --nodeOptions arg. #3397
Get boto S3 args for minio from environment variables. (#3370)
Update EC2 lists. #3376
Add a retry to AWS destroy. #3379
Regular division for memory calculation in LSF. #3387
Add option to blank mem allocation for SLURM. #3399
Preserve file permissions on imported/exported files #3322

Bug Fixes

Preserve file permissions on imported/exported files. #3322
Make building a flattened list of live jobs non-recursive. #3394
Move AWS job store uploads/downloads to boto3 (reopened) #3400
Use a Docker Hub mirror when pulling Docker images. #3411
Corrected gridengine maxMEM check to use memorystring #3410

Thank you to our contributors: @mr-c, @adamnovak, @w-gao, @jonathanxu18, @douglowe, @stevekm , @thiagogenez!

Source code(tar.gz)
Source code(zip)

releases/5.1.0(Dec 16, 2020)

Version 5.1.0

Changelog

WDL

Add WDL cross function. #3360

Bug Fixes

Better error message for insufficient disk. #3362
Fix maxMEM comparison in LSF. #3369

Thank you to our contributors: @mr-c , @adamnovak , @w-gao , @jonathanxu18 !

Source code(tar.gz)
Source code(zip)

releases/5.0.0(Dec 3, 2020)

Caching is now turned on by default.

CWL v1.1 is also now fully supported and passing all conformance tests.

The following batch system names are now deprecated (#3225) and replaced by:

singleMachine -> single_machine
gridEngine -> grid_engine
LSF -> lsf
Mesos -> mesos
Slurm -> slurm
Torque -> torque
HTCondor -> htcondor
Kubernetes -> kubernetes
k8s -> kubernetes

Changelog

CWL

Upgrade to a CWL v1.2.0 capable cwltool (3.0.20200709181526 -> 3.0.20200807132242). #3137
Export to a bucket if cwl's CreateFile is specified. #3124
CWL v1.1 Support: loadContents if True for StepValueFrom objects. #3266
CWL: Fix workdir permissions. #3229
Test CWL secondary file from s3. #3311
CWL v1.1 Support: Inplace update has side effect on directory content. #3280
More CWL v1.2 conformance tests. #3336
CWL: Reformat w/ Black and better support for tmpdir_prefix with suffix. #3333

WDL

Add ceil() and floor() WDL functions. #3168
Create a stdout and stderr file for each WDL task. #3181
Add WDL write functions and builtin tests. #3236
- write_lines
- write_tsv
- write_json
- write_map
Add WDL read functions and builtin tests. #3244
- read_lines
- read_tsv
- read_json
- read_map
- read_int
- read_string
- read_float
- read_boolean
Add transpose() WDL function. #3273
Add length() WDL function. #3307
Add sub() WDL function. #3252
Add range() WDL function. #3277
Add size() WDL function. #3255
Add zip() WDL function. #3355
Implement WDL Pair type. #3304
Refactor WDL types #3335

Kubernetes

Adding Labels to Pods/Jobs. #3233
Make kubernetes & botocore packages fully optional. #3259 #3261
KubeWatch optimization. #3227
Catch other kubernetes imports. #3261
Automatically infer singularity for kubernetes. #3279

Misc

Allow Caching By Default. #3111
Update dependencies and loosen restrictions slightly. #3139
Ensure that falsey (but non-null) values are considered. #3143
Remove pathlib. #3169
Move AWS job store uploads/downloads to boto3. #3153
Update prom/node-exporter to use quay.io. #3186
Add support for TOIL_CUSTOM_INIT_COMMAND. #3183
Update docker module version to 4.3.1. #3222
Add 'stream' and 'demux' options to apiDockerCall. #3224
Use boto3 to create our leader node. #3145
Prevent job kind filenames from getting too long. #3230
Add a retry decorator. #3144
Remove mesos offer messages. #3308
Job Concept Unification. #3250
Add reporting for accessed files of failed jobs. #3309
Add coverage and refactor. #3314
Expose --statePollingWait param through toil. #3321
Record the maximum memory used by LSF jobs. #3327
Remove custom math functions and replace with built ins. #3338
Define a changelog process. #3316
SLURM: getting job details from scontrol show jobs was non-functional and has now been fixed. This behavior in the case of sacct not being configured now works. #3346
LSF: handle unicode configuration files #3354
Replace abssympath w/ builtin. #3356

Bug Fixes

Turn off watch code in Kubernetes. #3175
Check against joining the current thread during CachingFileStore destructor. #3187
Slurm.py error, undefined stdout - stdout should be stderr in code. #3194
Fix restart flag error (issue #3094). #3142
Batch System generates a key error instead of a usage message. #3225
Remove Python 2 imports in WDL. #3228
Move checkForDeadlocks() in the leader. #3234
Fix boto3 migration bugs. #3243
Fix None check when parsing WDL JSON file. #3272
Fix broken stdout/stderr in torque job. #3306
Add doubleMem for LSF jobs that die due to imposed memory limit. #3313
Add 500 status to the list of retriable SDB BotoServerErrors. #3329
Add a retry logic for BucketNotEmpty error. #3341
Fix None check when parsing WDL JSON file. #3272
Warn when trying to clean non-existent job store #3288
Only rm a statefile that exists. #3348
CWL: Remove unprocessed secondaryFiles from both Dict and List types.

Thank you to our contributors: @mr-c, @arostamianfar, @adamnovak, @diekhans, @w-gao, @jonathanxu18, @jeffrey856, @davidlougheed, @altairwei, @mberacochea, @drkennetz, @ionox0!

Source code(tar.gz)
Source code(zip)

releases/4.2.0(Aug 12, 2020)

Don't log in the inner scheduling loop. #3065
Handle anticipated 404 errors without retrying. #3067
Test and reimplement AMI finding via Flatcar JSON feed. #3061
Bump Enlighten version to partly fix #3069. #3070
Get wait duration is far too short of a rest for lsf. #3076
Unify logging format. #3073
Support CWL 1.1 Listing. #3058
Enable CWL v1.2.0-dev3 (3.0.20200324120055 -> 3.0.20200530110633). #3092
Enable CWL v1.2.0-dev4 (3.0.20200530110633 -> 3.0.20200709181526). #3105
Add --nodeStorageOverrides option. #3096
More robust CWL filepaths and secondary files. #3114
Replace custom mkdir_p with the built in. #3123
Move conditional execution test to before fill_in_defaults. #3117

Bug Fixes

Stop CWL from trying to copy downloaded directories from somewhere local. #3053
Exit the worker with 1 when jobs fail so the batch system can see. #3052
Eliminate recursion in root finding to fix #3080. #3081
Add a Cactus Kubernetes test to the integration tests on Gitlab. #3077
Chaining doesn't make sense for CWL. #3091
Fix failed job accounting. #3103
Improve lsf batchsystem stability. #3101
Deduplicate updated jobs. #3108
Redundant virtualenv check. #3135
Change Slurm command output processing. #3133
Fix for log file being linked more than once. #3130
Wrap Kubernetes watches to fix #3125. #3126
Create dirs that do not exist when bind-mounting to docker. #3120
Fix database state when file upload fails. #3122

Thank you to our contributors: @mr-c, @arostamianfar, @adamnovak, @diekhans, @nikhil, @drkennetz, @jonathanxu18, @tobiaszjarosiewicz, @ionox0!

Source code(tar.gz)
Source code(zip)

releases/4.1.0(May 7, 2020)

Attempt to make batch system more robust and debuggable. #2959
Kubernetes Shared Caching. #3012
Test python3.8 and build a python3.8 appliance. #3028
Use the original pymesos. #3036
Detect more kinds of virtual environment and normalize prefixes. #3035
Do More Hashing. Can't have enough. #3025
Replace reissued jobs message with better progress indicators. #3044
Detect insufficient resources and deadlocks more usefully. #3043

Bug Fixes

Don't list specific CWL features, try them all (and fix some CWL running bugs). #3015
Always honor TOIL_GRIDENGINE_PE and never assume a site-dependent default. #3041

Thank you to our contributors: @mr-c, @arostamianfar, @adamnovak, @diekhans!

Source code(tar.gz)
Source code(zip)

releases/4.0.0(May 7, 2020)

This release moves to python3 only, dropping all python2.7 compatibility, and also deprecates the command "cwltoil" in favor of "toil-cwl-runner".

Update cwltool version (==1.0.20190906054215 -> <=2.0.20200126090152). #2969
Drop the long-deprecated cwltoil. #2843
Dropped python2.7. #2973
Port provisioner tests and only test py3.6. #2842
CWL: Refactor of link merge + conditionals + pickValue. #2845
Add import subprocess to executor.py. #2976
Encode mtail stdin to utf-8 and flush. #2978
Encode framework message as utf-8 as well. #2981
Make the output files for grid engine batch systems not try and be in per-host directories. #2956
Use file locks instead of PID polling to see if other processes sharing the cache are alive. #2982
Size downloads during download. #2989
Add timeouts to all SQLite connect statements. #2993
Eliminate sleep time on --restart. #2990
Add support for --awsEc2ExtraSecurityGroupId. #2997
Add moveExports option. #2983
Set worker threads as dameon to prevent hanging process on error. #2998
Cut the Threads. #2999
[Part 1] CWL v1.1 Support #2985
[Part 2] CWL v1.1 Support #3000
Update Sphinx and let its version float. #3011
Add --enableUnlimitedPreemptableRetries option. #2896
Add less and vim to docker. #3017
Improve and Unify Log Dumping. #3008
Make dependency on Python3.6+ machine-readable in setup.py. #3021
Improve slurm update frequency. #3026
Make Sphinx a make prepare component and not a dependency. #3023
Use forked pymesos and http-parser dependencies. #3024

Bug Fixes

Fix python3 string/bytes error when using --printLogs. #3005
Fix connection between Kubernetes and Leader. #3004

Thank you to our contributors: @mr-c, @arostamianfar, @adamnovak, @jeffrey856, @kaushik-work, @glmxndr, @johnbradley, @cmarkello, @diekhans!

Source code(tar.gz)
Source code(zip)

Information

Category: Python / Miscellaneous
Watchers: 55
Star: 719
Fork: 200
Last update: Jan 18, 2021

Resource links

https://github.com/DataBiosphere/toil

Share this repo

Related Repos

Miscellaneous

215

Graph-based Approximate Nearest Neighbor Search

Miscellaneous

943

Generate colors based on a desired contrast ratio

Leonardo Authoring adaptive color palettes for generating color based on a desired contrast ratio. For a detailed walkthrough of Leonardo, check out this article. Project Goals To make it easier for designers

Miscellaneous

171

Source files for "Lectures in Quantitative Economics" -- Python version

Miscellaneous

A maze generator and solver written in Python, which uses a backtracker algorithm and Djik...

Maze Creator / Solver Maze Creation Algorithm To create the mazes, I used the backtracker algorithm, this algorithm utilises a stack data structure and is a depth-first search algorithm. It can be described

Miscellaneous

154

Unix commands for Jupyter notebooks!

nbcommands nbcommands bring the goodness of Unix commands to Jupyter notebooks. Installation You can simply use pip to install nbcommands: $ pip install nbcommands Usage nbcommands gives you the foll

Miscellaneous

1.6k

Solutions for various coding/algorithmic problems and many useful resources for learning a...

Coding Problems Here you can find solutions for various coding/algorithmic problems and many useful resources for learning algorithms and data structures. Also, this repo will be updated with new solutions and resources from time

Miscellaneous

170

Tensorflow's Fairness Evaluation and Visualization Toolkit

Miscellaneous

187

Create interactive webpages from Jupyter Notebooks

nbinteract nbinteract is a Python package that creates interactive webpages from Jupyter notebooks. nbinteract also has built-in support for interactive plotting. These interactions are driven by data, not callbacks, allow