A module optimizing the task graph in Dask's threaded scheduler in order to faster I/O operations.
Use requirements.txt or requirements_conda.txt to install the dependencies.
For a conda environment:
conda create --name <env> --file requirements_conda.txt
For a pip environment:
python3 -m venv env
source env/bin/activate
pip install -r requirements.txt
-
- Create a new conda environement
conda create --name <envname>
- Create a new conda environement
-
- activate the environment
conda activate <envname>
- activate the environment
-
- 'cd' inside the dask_io directory (where the requirements_conda.txt file is)
-
- install the dependencies that are not missing
while read requirement; do conda install --yes $requirement; done < requirements_conda.txt
- install the dependencies that are not missing
To create the requirements_conda file:
conda list -e > requirements_conda.txt
To create the ``requirements.txt" file from conda environment:
pip freeze > requirements.txt
Remove mkl dependencies from ``requirements.txt" to get rid of compatibility issues.