Rocksolid Light

News from da outaworlds

mail  files  register  groups  login

Message-ID:  

BOFH excuse #90: Budget cuts

comp / comp.lang.python.announce / [Python-announce] [ANN] pipefunc 0.32.1: Simplified function composition and pipeline creation for scientific workflows

SubjectAuthor
o [Python-announce] [ANN] pipefunc 0.32.1: Simplified function composition and pipBas Nijholt

1
Subject: [Python-announce] [ANN] pipefunc 0.32.1: Simplified function composition and pipeline creation for scientific workflows
From: Bas Nijholt
Newsgroups: comp.lang.python.announce
Date: Thu, 19 Sep 2024 19:42 UTC
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!fu-berlin.de!uni-berlin.de!not-for-mail
From: basnijholt@gmail.com (Bas Nijholt)
Newsgroups: comp.lang.python.announce
Subject: [Python-announce] [ANN] pipefunc 0.32.1: Simplified function composition and pipeline creation for scientific workflows
Date: Thu, 19 Sep 2024 19:42:23 -0000
Lines: 42
Approved: python-announce-list@python.org
Message-ID: <172677494385.31365.10964182452325736818@mail.python.org>
Reply-To: python-list@python.org
Mime-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
X-Trace: news.uni-berlin.de 2yF5qPxohn/tHJjq2c9+sAEEv0KH1fKXPq8HA1OTUMdw==
Cancel-Lock: sha1:L9DYB72fB/WnJI+J/t2r+tVWJsA= sha256:u77CQ7RqOeIgByHDgrIGMWaPCKkht0voa6ag6dru9ig=
Authentication-Results: mail.python.org; dkim=none reason="no signature";
dkim-adsp=none (unprotected policy); dkim-atps=neutral
User-Agent: HyperKitty on https://mail.python.org/
X-MailFrom: basnijholt@gmail.com
X-Mailman-Rule-Hits: emergency
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; loop; banned-address; header-match-python-announce-list.python.org-0; header-match-python-announce-list.python.org-1; header-match-python-announce-list.python.org-2; header-match-python-announce-list.python.org-3; header-match-python-announce-list.python.org-4
Message-ID-Hash: 7ZQ2Y6QG3EQAROU3RHAQ52XPZ5RZMBMX
X-Message-ID-Hash: 7ZQ2Y6QG3EQAROU3RHAQ52XPZ5RZMBMX
X-Mailman-Approved-At: Thu, 19 Sep 2024 16:01:45 -0400
X-Mailman-Version: 3.3.10b1
Precedence: list
List-Id: Announcement-only list for the Python programming language <python-announce-list.python.org>
Archived-At: <https://mail.python.org/archives/list/python-announce-list@python.org/message/7ZQ2Y6QG3EQAROU3RHAQ52XPZ5RZMBMX/>
List-Archive: <https://mail.python.org/archives/list/python-announce-list@python.org/>
List-Help: <mailto:python-announce-list-request@python.org?subject=help>
List-Owner: <mailto:python-announce-list-owner@python.org>
List-Post: <mailto:python-announce-list@python.org>
List-Subscribe: <mailto:python-announce-list-join@python.org>
List-Unsubscribe: <mailto:python-announce-list-leave@python.org>
View all headers

Dear Python community,

I am pleased to announce the release of pipefunc, a new open-source Python library
designed to simplify function composition and pipeline creation for scientific computing,
data processing, and machine learning workflows.

BACKGROUND:
In scientific computing and data science, we often deal with complex workflows
involving multiple interdependent functions and large parameter spaces. pipefunc addresses
these challenges by automatically generating Directed Acyclic Graphs (DAGs) from Python
functions and efficiently handling N-dimensional parameter sweeps.

KEY FEATURES:
1. Automatic DAG generation from Python functions
2. Efficient handling of N-dimensional parameter sweeps
3. Seamless scaling from local execution to HPC environments (including SLURM clusters)
4. Built-in pipeline visualization
5. Integrated resource usage profiling
6. N-dimensional map-reduce support
7. Automatic type checking through annotations
8. Minimal boilerplate code required

VERSION: 0.32.1
PYTHON REQUIRED: 3.10+
LICENSE: MIT

INSTALLATION:
pip install pipefunc
or
conda install pipefunc

For more information, please visit:
Documentation: https://pipefunc.readthedocs.io/
Source Code: https://github.com/pipefunc/pipefunc
PyPI: https://pypi.org/project/pipefunc/

We welcome feedback, contributions, and feature requests from the community. Please visit
our GitHub repository for more information on how to get involved.

Best regards,
Bas Nijholt
bas@nijho.lt

1

rocksolid light 0.9.8
clearnet tor