agatha.construct.dask_process_global module

This util is intended to be a universal initializer for all process-specific helper data that is loaded at the start of the construction process. This is only intended for expensive complex structures that must be loaded at startup, and we don’t want to reload each function call.

class agatha.construct.dask_process_global.LocalMockWorker

Bases: object

class agatha.construct.dask_process_global.WorkerPreloader

Bases: object

clear(worker)

get(key, worker)

Return type

Any

register(key, init)

Adds a global object to the preloader

Return type

None

setup(worker)

teardown(worker)

agatha.construct.dask_process_global.add_global_preloader(preloader, client=None)

Return type

None

agatha.construct.dask_process_global.clear()

Deletes all preloaded data. To be called following a ckpt.

Return type

None

agatha.construct.dask_process_global.get(key)

Gets a value from the global preloader

Return type

Any

agatha.construct.dask_process_global.get_global_preloader()

agatha.construct.dask_process_global.get_worker_lock()

agatha.construct.dask_process_global.safe_get_worker()