DASF Logo

Welcome to DASF’s documentation!

CI Code coverage Docs Latest Release PyPI version Code style: black Imports: isort PEP8 Checked with mypy REUSE status

The python module wrapper for the data analytics software framework DASF

The Data Analytics Software Framework DASF supports scientists to conduct data analysis in distributed IT infrastructures by sharing data analysis tools and data. For this purpose, DASF defines a remote procedure call (RPC) messaging protocol that uses a central message broker instance. Scientists can augment their tools and data with this protocol to share them with others or re-use them in different contexts.

Language support

The DASF RPC messaging protocol is based on JSON and uses Websockets for the underlying data exchange. Therefore the DASF RPC messaging protocol in general is language agnostic, so all languages with Websocket support can be utilized. As a start DASF provides two ready-to-use language bindings for the messaging protocol, one for Python and one for the Typescript programming language.

Needed infrastructure

DASF distributes messages via a central message broker. Currently we support a self-developed message broker called dasf-broker-django, as well as an ‘off-the-shelf’ solution called Apache Pulsar. Both are quite versatile and highly configurable depending on your requirements. (also see: Choosing the message broker)

How to cite this software

Please do cite this software!

Eggert D., Sips M., Sommer P.S., Dransch D. Data Analytics Software Framework URL: https://codebase.helmholtz.cloud/dasf/dasf-messaging-python

@misc{YourReferenceHere,
author = {Eggert, Daniel and Sips, Mike and Sommer, Philipp S. and Dransch, Doris},
title = {Data Analytics Software Framework},
url = {https://codebase.helmholtz.cloud/dasf/dasf-messaging-python}
}

TY  - GEN
AB  - python module wrapper for the data analytics software framework DASF

AU  - Eggert, Daniel
AU  - Sips, Mike
AU  - Sommer, Philipp S.
AU  - Dransch, Doris
KW  - digital-earth
KW  - dasf
KW  - pulsar
KW  - gfz
KW  - hzg
KW  - hereon
KW  - hgf
KW  - helmholtz
KW  - remote procedure call
KW  - rpc
KW  - django
KW  - python
KW  - websocket
TI  - Data Analytics Software Framework
UR  - https://codebase.helmholtz.cloud/dasf/dasf-messaging-python
ER

%0 Generic
%A Eggert, Daniel
%A Sips, Mike
%A Sommer, Philipp S.
%A Dransch, Doris
%K digital-earth
%K dasf
%K pulsar
%K gfz
%K hzg
%K hereon
%K hgf
%K helmholtz
%K remote procedure call
%K rpc
%K django
%K python
%K websocket
%T Data Analytics Software Framework
%U https://codebase.helmholtz.cloud/dasf/dasf-messaging-python

# SPDX-FileCopyrightText: 2019-2024 Helmholtz Centre Potsdam GFZ German Research Centre for Geosciences
# SPDX-FileCopyrightText: 2021-2024 Helmholtz-Zentrum hereon GmbH
#
# SPDX-License-Identifier: CC0-1.0

authors:
  # list author information. see
  # https://github.com/citation-file-format/citation-file-format/blob/main/schema-guide.md#definitionsperson
  # for metadata
  - family-names: "Eggert"
    given-names: "Daniel"
    affiliation: "Helmholtz Centre Potsdam GFZ German Research Centre for Geosciences"
    orcid: https://orcid.org/0000-0003-0251-4390
    email: "daniel.eggert@gfz-potsdam.de"
  - family-names: "Sips"
    given-names: "Mike"
    affiliation: "Helmholtz Centre Potsdam GFZ German Research Centre for Geosciences"
    orcid: https://orcid.org/0000-0003-3941-7092
  - family-names: "Sommer"
    given-names: "Philipp S."
    affiliation: "Helmholtz Centre Potsdam GFZ German Research Centre for Geosciences"
    orcid: https://orcid.org/0000-0001-6171-7716
    email: "philipp.sommer@hereon.de"
  - family-names: "Dransch"
    given-names: "Doris"
    affiliation: "Helmholtz Centre Potsdam GFZ German Research Centre for Geosciences"
    # orcid: null
cff-version: 1.2.0
message: "If you use this software, please cite it using these metadata."
title: "Data Analytics Software Framework"
keywords:
  - "digital-earth"
  - "dasf"
  - "pulsar"
  - "gfz"
  - "hzg"
  - "hereon"
  - "hgf"
  - "helmholtz"
  - "remote procedure call"
  - "rpc"
  - "django"
  - "python"
  - "websocket"

license: 'Apache-2.0'
repository-code: "https://codebase.helmholtz.cloud/dasf/dasf-messaging-python"
url: "https://codebase.helmholtz.cloud/dasf/dasf-messaging-python"
contact:
  # list maintainer information. see
  # https://github.com/citation-file-format/citation-file-format/blob/main/schema-guide.md#definitionsperson
  # for metadata
  - family-names: "Sommer"
    given-names: "Philipp S."
    affiliation: "Helmholtz Centre Potsdam GFZ German Research Centre for Geosciences"
    # orcid: null
    email: "philipp.sommer@hereon.de"
abstract: |
  python module wrapper for the data analytics software framework DASF

Open Source and Open Science

License information

Copyright © 2019-2024 Helmholtz Centre Potsdam GFZ German Research Centre for Geosciences Copyright © 2020-2021 Helmholtz-Zentrum Geesthacht Copyright © 2021-2024 Helmholtz-Zentrum hereon GmbH

The source code of dasf-messaging-python is licensed under Apache-2.0.

If not stated otherwise, the contents of this documentation is licensed under CC-BY-4.0.

Repository

The individual DASF modules are developed via the following git group. Feel free to checkout the source code or leave comment via the service desk or directly via the issue tracker.

Acknowledgment

DASF is developed at the GFZ German Research Centre for Geosciences (https://www.gfz-potsdam.de) in collaboration with the Helmholtz-Zentrum Hereon https://www.hereon.de and was funded by the Initiative and Networking Fund of the Helmholtz Association through the Digital Earth project (https://www.digitalearth-hgf.de/).