demessaging package

Data Analytics Software Framework

python module wrapper for the data analytics software framework DASF

Classes:

BackendModule([root])

A base class for a backend module.

Functions:

configure([js])

Configuration decorator for function or modules.

main([module_name])

Main function for starting a backend module from the command line.

class demessaging.BackendModule(root: RootModelRootType = PydanticUndefined)[source]

Bases: RootModel

A base class for a backend module.

Do not directly instantiate from this class, rather use the create_model() method.

Parameters:

root (typing.Union[demessaging.backend.function.BackendFunction, demessaging.backend.class_.BackendClass]) – None

Attributes:

backend_config

model_config

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

model_fields

Metadata about the fields defined on the model, mapping of field names to [FieldInfo][pydantic.fields.FieldInfo].

pulsar

root

Methods:

compute()

Send this request to the backend module and compute the result.

create_model([module_name, members, config, ...])

Generate a module for a backend module.

generate([line_length, use_formatters, ...])

Generate the code for the frontend module.

handle_message(request_msg)

listen()

Connect to the message pulsar.

send_request(request)

Test a request to the backend.

shell()

Start a shell with the module defined.

test_connect()

Connect to the message pulsar.

backend_config: ClassVar[BackendModuleConfig]
compute() BaseModel[source]

Send this request to the backend module and compute the result.

This method updates the model inplace.

classmethod create_model(module_name: str | None = None, members: List[Type[BackendFunction] | Type[BackendClass] | Callable | str | Type[object]] | None = None, config: ModuleConfig | None = None, class_name: str | None = None, **config_kws) Type[BackendModule][source]

Generate a module for a backend module.

Parameters:
  • module_name (str) – The name of the module to import. If none is given, the members must be specified

  • members (list of members) –

    The list of members that shall be added to this module. It can be a list of

  • config (ModuleConfig, optional) – The configuration for the module. If this is not given, you must provide config_kws or define a backend_config variable within the module corresponding to module_name

  • class_name (str, optional) – The name for the generated subclass of pydantic.BaseModel. If not given, the name of Class is used

  • **config_kws – An alternative way to specify the configuration for the backend module.

Returns:

The newly generated class that represents this module.

Return type:

Subclass of BackendFunction

classmethod generate(line_length: int = 79, use_formatters: bool = True, use_autoflake: bool = True, use_black: bool = True, use_isort: bool = True) str[source]

Generate the code for the frontend module.

classmethod handle_message(request_msg)[source]
classmethod listen()[source]

Connect to the message pulsar.

member: BackendClass | BackendFunction
model_config: ClassVar[ConfigDict] = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

model_fields: ClassVar[dict[str, FieldInfo]] = {'root': FieldInfo(annotation=Union[BackendFunction, BackendClass], required=True)}

Metadata about the fields defined on the model, mapping of field names to [FieldInfo][pydantic.fields.FieldInfo].

This replaces Model.__fields__ from Pydantic V1.

pulsar: ClassVar[MessageConsumer]
root: BackendFunction | BackendClass
classmethod send_request(request: BackendModule | IO | Dict[str, Any]) BaseModel[source]

Test a request to the backend.

Parameters:

request (dict or file-like object) – A request to the backend module.

classmethod shell()[source]

Start a shell with the module defined.

classmethod test_connect()[source]

Connect to the message pulsar.

demessaging.configure(js: str | None = None, **kwargs) Callable[[T], T][source]

Configuration decorator for function or modules.

Use this function as a decorator for classes or functions in the backend module like so:

>>> @configure(field_params={"a": {"gt": 0}}, returns={"gt": 0})
... def sqrt(a: float) -> float:
...     import math
...
...     return math.sqrt(a)

The available parameters for this function vary depending on what you are decorating. If you are decorating a class, your parameters must be valid for the ClassConfig. If you are decorating a function, your parameters must be valid for a FunctionConfig.

Parameters:
  • js (Optional[str]) – A JSON-formatted string that can be used to setup the config.

  • **kwargs – Any keyword argument that can be used to setup the config.

Notes

If you are specifying any kwargs, your first argument (js) should be None.

demessaging.main(module_name: str = '__main__', *args, **config_kws) Type[BackendModule][source]

Main function for starting a backend module from the command line.

Parameters:

Subpackages

Submodules