geowatch.utils.util_globals module

Utilities for handling global resources

geowatch.utils.util_globals.configure_global_attributes(**config)[source]

Configures hacks to fix global settings in external modules

Parameters:

config (dict) – expected to contain certain special keys.

  • “workers” with an integer value equal to the number of dataloader

    processes.

  • “torch_sharing_strategy” to specify the torch multiprocessing backend

  • “request_rlimit_nofile”

    the maximum number of open files to request ulimit raise the soft limit to.

Modules we currently hack:
  • cv2 - fix thread count

  • torch sharing strategy

References

https://pytorch.org/docs/stable/multiprocessing.html#torch.multiprocessing.get_all_sharing_strategies