geowatch.utils package

Subpackages

• geowatch.utils.lightning_ext package
  • Subpackages
    • geowatch.utils.lightning_ext.callbacks package
      • Submodules
      • Module contents
  • Submodules
    • geowatch.utils.lightning_ext.argparse_ext module
      • get_init_arguments_and_types()
      • str_to_bool_or_str()
      • str_to_bool_or_int()
      • str_to_bool()
      • parse_docstring_args()
      • add_arginfos_to_parser()
      • add_argparse_args()
    • geowatch.utils.lightning_ext.demo module
      • LightningToyNet2d
      • demo_trainer()
    • geowatch.utils.lightning_ext.lightning_cli_ext module
      • LightningCLI_Extension
    • geowatch.utils.lightning_ext.monkeypatches module
    • geowatch.utils.lightning_ext.old_parser_devices module
      • parse_gpu_ids()
    • geowatch.utils.lightning_ext.util_device module
      • coerce_devices()
      • coerce_accelerator_devices()
    • geowatch.utils.lightning_ext.util_globals module
    • geowatch.utils.lightning_ext.util_model module
      • model_hparams()
  • Module contents

Submodules

• geowatch.utils.configargparse_ext module
  • RawDescriptionDefaultsHelpFormatter
  • ArgumentParser
    • ArgumentParser.parse_known_args()
• geowatch.utils.ext_monai module
  • FocalLoss
    • FocalLoss.forward()
  • DiceLoss
    • DiceLoss.forward()
  • MaskedDiceLoss
    • MaskedDiceLoss.forward()
  • GeneralizedWassersteinDiceLoss
    • GeneralizedWassersteinDiceLoss.forward()
    • GeneralizedWassersteinDiceLoss.wasserstein_distance_map()
  • DiceCELoss
    • DiceCELoss.ce()
    • DiceCELoss.forward()
  • DiceFocalLoss
    • DiceFocalLoss.forward()
  • Dice
  • dice_ce
  • dice_focal
  • generalized_wasserstein_dice
• geowatch.utils.ijson_ext module
  • UnexpectedSymbol
  • utf8_encoder()
  • Lexer()
  • parse_value()
  • parse_string()
  • basic_parse_basecoro()
• geowatch.utils.kwcoco_extensions module
  • filter_image_ids()
  • populate_watch_fields()
  • coco_populate_geo_heuristics()
  • coco_populate_geo_img_heuristics2()
  • coco_populate_geo_video_stats()
  • check_kwcoco_spatial_transforms()
  • check_geo_transform_consistency()
  • check_unique_channel_names()
  • coco_list_asset_infos()
  • check_geotiff_formats()
  • rewrite_geotiffs()
  • geotiff_format_info()
  • ensure_transfered_geo_data()
  • transfer_geo_metadata()
  • transfer_geo_metadata2()
  • coco_channel_stats()
  • TrackidGenerator
    • TrackidGenerator.update_generator()
    • TrackidGenerator.exclude_trackids()
  • coco_img_wld_info()
  • warp_annot_segmentations_from_geos()
  • warp_annot_segmentations_to_geos()
  • visualize_rois()
  • covered_image_geo_regions()
  • covered_video_geo_regions()
  • covered_annot_geo_regions()
  • associate_images()
  • reorder_video_frames()
  • pick_channels()
• geowatch.utils.process_context module
• geowatch.utils.remedian module
  • Remedian
    • Remedian.add_obs()
• geowatch.utils.result_analysis module
  • Result
    • Result.to_dict()
    • Result.demo()
  • ResultTable
    • ResultTable.table
    • ResultTable.result_list
    • ResultTable.demo()
    • ResultTable.coerce()
    • ResultTable.varied
  • ResultAnalysis
    • ResultAnalysis.demo()
    • ResultAnalysis.run()
    • ResultAnalysis.analysis()
    • ResultAnalysis.table
    • ResultAnalysis.metric_table()
    • ResultAnalysis.varied
    • ResultAnalysis.abaltion_groups()
    • ResultAnalysis.tune()
    • ResultAnalysis.ablate()
    • ResultAnalysis.abalation_groups()
    • ResultAnalysis.abalate()
    • ResultAnalysis.test_group()
    • ResultAnalysis.build()
    • ResultAnalysis.report()
    • ResultAnalysis.conclusions()
    • ResultAnalysis.plot()
  • SkillTracker
    • SkillTracker.predict_win()
    • SkillTracker.observe()
  • UnhashablePlaceholder
  • varied_values()
  • varied_value_counts()
  • GroupbyFutureWrapper
  • fix_groupby()
  • aggregate_stats()
  • stats_dict()
  • combine_stats()
  • combine_stats_arrs()
• geowatch.utils.reverse_hashid module
  • ReverseHashTable
    • ReverseHashTable.load()
    • ReverseHashTable.register()
    • ReverseHashTable.query()
  • condense_config()
• geowatch.utils.simple_dvc module
  • SimpleDVC
    • SimpleDVC.init()
    • SimpleDVC.cache_dir
    • SimpleDVC.demo_dpath()
    • SimpleDVC.coerce()
    • SimpleDVC.find_root()
    • SimpleDVC.add()
    • SimpleDVC.pathsremove()
    • SimpleDVC.check_ignore()
    • SimpleDVC.git_pull()
    • SimpleDVC.git_push()
    • SimpleDVC.git_commit()
    • SimpleDVC.git_commitpush()
    • SimpleDVC.push()
    • SimpleDVC.pull()
    • SimpleDVC.request()
    • SimpleDVC.unprotect()
    • SimpleDVC.is_tracked()
    • SimpleDVC.find_file_tracker()
    • SimpleDVC.find_dir_tracker()
    • SimpleDVC.read_dvc_sidecar()
    • SimpleDVC.resolve_cache_paths()
    • SimpleDVC.find_sidecar_paths()
    • SimpleDVC.resolve_sidecar()
  • SimpleDVC_CLI
    • SimpleDVC_CLI.Add
      • SimpleDVC_CLI.Add.main()
      • SimpleDVC_CLI.Add.default
    • SimpleDVC_CLI.Request
      • SimpleDVC_CLI.Request.main()
      • SimpleDVC_CLI.Request.default
    • SimpleDVC_CLI.CacheDir
      • SimpleDVC_CLI.CacheDir.main()
      • SimpleDVC_CLI.CacheDir.default
• geowatch.utils.util_bands module
  • Sentinal 2 Band Table
  • Landsat 8 Band Table
  • Worldview 3 MUL Band Table
  • Worldview 3 PAN Band Table
  • dicts_contain()
  • SENTINEL2
  • LANDSAT8
  • LANDSAT7
  • PLANETSCOPE_8BAND
  • ALL_BANDS
  • EO_COMMONNAMES
  • GROUND
  • specialized_index_bands()
  • specialized_index_bands2()
• geowatch.utils.util_codes module
  • parse_delimited_argstr()
• geowatch.utils.util_data module
  • DataRegistry
    • DataRegistry.pandas()
    • DataRegistry.list()
    • DataRegistry.add()
    • DataRegistry.set()
    • DataRegistry.remove()
    • DataRegistry.read()
    • DataRegistry.query()
    • DataRegistry.find()
  • find_dvc_dpath()
  • find_smart_dvc_dpath()
• geowatch.utils.util_dotdict module
  • dotdict_to_nested()
  • dotkeys_to_nested()
  • DotDict
    • DotDict.from_nested()
    • DotDict.to_nested()
    • DotDict.to_nested_keys()
    • DotDict.prefix_get()
    • DotDict.add_prefix()
    • DotDict.insert_prefix()
    • DotDict.print_graph()
    • DotDict.query_keys()
  • indexable_to_graph()
  • explore_nested_dict()
• geowatch.utils.util_exception module
• geowatch.utils.util_framework module
  • egress_item()
  • ingress_item()
  • download_mtd_msil1c()
  • download_file()
  • download_http_file()
  • CacheItemOutputS3Wrapper
  • IngressProcessEgressWrapper
  • download_region()
  • determine_region_id()
  • AWS_S3_Command
    • AWS_S3_Command.cmd_known_flags
    • AWS_S3_Command.cmd_known_keyvals
    • AWS_S3_Command.update()
    • AWS_S3_Command.finalize()
    • AWS_S3_Command.run()
  • ta2_collate_output()
  • fixup_and_validate_site_and_region_models()
  • check_region_and_site_models_agree()
  • NodeStateDebugger
    • NodeStateDebugger.print_environment()
    • NodeStateDebugger.print_local_invocation()
    • NodeStateDebugger.print_current_state()
    • NodeStateDebugger.print_directory_contents()
  • PrintLogger
    • PrintLogger.info()
    • PrintLogger.debug()
    • PrintLogger.error()
    • PrintLogger.warning()
    • PrintLogger.critical()
• geowatch.utils.util_fsspec module
  • FSPath
    • FSPath.get_filesystem_class()
    • FSPath.fs
    • FSPath.coerce()
    • FSPath.path
    • FSPath.relative_to()
    • FSPath.is_remote()
    • FSPath.is_local()
    • FSPath.open()
    • FSPath.ls()
    • FSPath.touch()
    • FSPath.move()
    • FSPath.delete()
    • FSPath.rm()
    • FSPath.mkdir()
    • FSPath.stat()
    • FSPath.is_dir()
    • FSPath.is_file()
    • FSPath.is_link()
    • FSPath.exists()
    • FSPath.write_text()
    • FSPath.read_text()
    • FSPath.walk()
    • FSPath.parent
    • FSPath.name
    • FSPath.stem
    • FSPath.suffix
    • FSPath.suffixes
    • FSPath.parts
    • FSPath.copy()
    • FSPath.joinpath()
    • FSPath.tree()
  • LocalPath
    • LocalPath.ensuredir()
    • LocalPath.absolute()
    • LocalPath.appdir()
  • MemoryPath
  • RemotePath
  • S3Path
    • S3Path.ensuredir()
    • S3Path.register_bucket()
    • S3Path.coerce()
  • SSHPath
    • SSHPath.host
• geowatch.utils.util_gdal module
• geowatch.utils.util_girder module
  • grabdata_girder()
• geowatch.utils.util_gis module
  • utm_epsg_from_zoneletter()
• geowatch.utils.util_globals module
  • configure_global_attributes()
• geowatch.utils.util_hardware module
  • get_cpu_mem_info()
  • get_cpu_info()
  • get_mem_info()
  • disk_info_of_path()
• geowatch.utils.util_iter module
  • consume()
  • chunks()
• geowatch.utils.util_kwarray module
  • cartesian_product()
  • tukey_biweight_loss()
  • asymptotic()
  • robust_limits()
  • unique_rows()
  • find_robust_normalizers()
  • apply_normalizer()
  • normalize()
  • balanced_number_partitioning()
  • torch_array_equal()
  • combine_mean_stds()
  • apply_robust_normalizer()
  • biased_1d_weights()
  • argsort_threshold()
• geowatch.utils.util_kwimage module
  • upweight_center_mask()
  • perchannel_colorize()
  • ensure_false_color()
  • colorize_label_image()
  • local_variance()
  • find_lowvariance_regions()
  • find_samecolor_regions()
  • find_high_frequency_values()
  • polygon_distance_transform()
  • multiple_polygon_distance_transform_weighting()
  • devcheck_frame_poly_weights()
  • find_low_overlap_covering_boxes()
  • find_low_overlap_covering_boxes_optimize()
  • exactly_1channel()
  • load_image_shape()
  • draw_multiclass_clf_on_image()
• geowatch.utils.util_kwplot module
  • TitleBuilder
    • TitleBuilder.add_part()
    • TitleBuilder.newline()
    • TitleBuilder.ensure_newline()
    • TitleBuilder.finalize()
  • cropwhite_ondisk()
  • dataframe_table()
  • humanize_dataframe()
  • scatterplot_highlight()
  • humanize_labels()
  • relabel_xticks()
  • LabelModifier
    • LabelModifier.copy()
    • LabelModifier.add_mapping()
    • LabelModifier.update()
    • LabelModifier.relabel_yticks()
    • LabelModifier.relabel_xticks()
    • LabelModifier.relabel_axes_labels()
    • LabelModifier.relabel_legend()
    • LabelModifier.relabel()
  • FigureFinalizer
    • FigureFinalizer.copy()
    • FigureFinalizer.update()
    • FigureFinalizer.finalize()
  • fix_matplotlib_dates()
  • fix_matplotlib_timedeltas()
  • extract_legend()
  • ArtistManager
    • ArtistManager.plot()
    • ArtistManager.add_linestring()
    • ArtistManager.add_ellipse()
    • ArtistManager.add_circle()
    • ArtistManager.add_ellipse_marker()
    • ArtistManager.add_circle_marker()
    • ArtistManager.build_collections()
    • ArtistManager.add_to_axes()
    • ArtistManager.bounds()
    • ArtistManager.setlims()
  • time_sample_arcplot()
  • Palette
    • Palette.coerce()
    • Palette.update()
    • Palette.add_labels()
    • Palette.make_legend_img()
    • Palette.sorted_keys()
    • Palette.reorder()
  • PaletteManager
  • color_new_labels()
  • autompl2()
  • FigureManager
    • FigureManager.figure()
    • FigureManager.finalize()
    • FigureManager.set_figtitle()
  • fix_seaborn_palette_issue()
• geowatch.utils.util_kwutil module
  • distributed_subitems()
  • farthest_first()
• geowatch.utils.util_logging module
  • setup_logging()
  • get_logger()
  • PrintLogger
    • PrintLogger.setLevel()
    • PrintLogger.debug()
    • PrintLogger.info()
    • PrintLogger.warning()
    • PrintLogger.error()
    • PrintLogger.exception()
    • PrintLogger.critical()
    • PrintLogger.log()
    • PrintLogger.findCaller()
    • PrintLogger.makeRecord()
    • PrintLogger.filter()
    • PrintLogger.handle()
    • PrintLogger.addHandler()
    • PrintLogger.removeHandler()
    • PrintLogger.hasHandlers()
    • PrintLogger.callHandlers()
    • PrintLogger.getEffectiveLevel()
    • PrintLogger.isEnabledFor()
    • PrintLogger.getChild()
• geowatch.utils.util_nesting module
  • debug_shapes()
  • shape_summary()
• geowatch.utils.util_netharn module
  • Optimizer
    • Optimizer.coerce()
  • Initializer
    • Initializer.forward()
    • Initializer.history()
    • Initializer.get_initkw()
    • Initializer.coerce()
  • NoOp
    • NoOp.forward()
  • Orthogonal
    • Orthogonal.forward()
  • KaimingUniform
    • KaimingUniform.forward()
  • KaimingNormal
    • KaimingNormal.forward()
  • apply_initializer()
  • trainable_layers()
  • number_of_parameters()
  • ToyNet2d
    • ToyNet2d.forward()
  • ToyData2d
    • ToyData2d.make_loader()
  • InputNorm
    • InputNorm.forward()
  • MultiLayerPerceptronNd
    • MultiLayerPerceptronNd.forward()
  • rectify_dropout()
  • rectify_nonlinearity()
  • rectify_normalizer()
  • Identity
  • Conv0d
    • Conv0d.forward()
    • Conv0d.extra_repr()
  • Conv1d
    • Conv1d.forward()
    • Conv1d.extra_repr()
  • Conv2d
    • Conv2d.forward()
    • Conv2d.extra_repr()
  • Conv3d
    • Conv3d.forward()
    • Conv3d.extra_repr()
  • rectify_conv()
  • weight_standardization_nd()
  • ConvNormNd
  • ConvNorm1d
  • ConvNorm2d
  • ConvNorm3d
  • Swish
    • Swish.forward()
  • beta_mish()
  • Mish_Function
    • Mish_Function.forward()
    • Mish_Function.backward()
  • Mish
    • Mish.forward()
  • default_kwargs()
  • CollateException
  • padded_collate()
• geowatch.utils.util_nvidia module
  • NvidiaSMIError
  • nvidia_smi()
• geowatch.utils.util_pandas module
  • DataFrame
    • DataFrame.random()
    • DataFrame.coerce()
    • DataFrame.safe_drop()
    • DataFrame.reorder()
    • DataFrame.groupby()
    • DataFrame.match_columns()
    • DataFrame.search_columns()
    • DataFrame.varied_values()
    • DataFrame.varied_value_counts()
    • DataFrame.shorten_columns()
    • DataFrame.argextrema()
  • pandas_reorder_columns()
  • pandas_argmaxima()
  • pandas_suffix_columns()
  • pandas_nan_eq()
  • pandas_shorten_columns()
  • pandas_condense_paths()
  • pandas_truncate_items()
  • DotDictDataFrame
    • DotDictDataFrame.nested_columns
    • DotDictDataFrame.find_column()
    • DotDictDataFrame.query_column()
    • DotDictDataFrame.lookup_suffix_columns()
    • DotDictDataFrame.lookup_prefix_columns()
    • DotDictDataFrame.find_columns()
    • DotDictDataFrame.match_columns()
    • DotDictDataFrame.search_columns()
    • DotDictDataFrame.subframe()
  • pandas_add_prefix()
  • aggregate_columns()
  • SpecialAggregators
    • SpecialAggregators.hash()
    • SpecialAggregators.hash12()
    • SpecialAggregators.unique()
    • SpecialAggregators.min_max()
    • SpecialAggregators.normalize_special_key()
    • SpecialAggregators.special_lut
  • NonConstantError
  • nan_eq()
  • GroupbyFutureWrapper
  • pandas_fixed_groupby()
• geowatch.utils.util_param_grid module
  • handle_yaml_grid()
  • coerce_list_of_action_matrices()
  • prevalidate_param_grid()
  • expand_param_grid()
  • github_action_matrix()
  • extended_github_action_matrix()
• geowatch.utils.util_raster module
  • mask()
  • ResampledRaster
    • ResampledRaster.raster
    • ResampledRaster.scale
    • ResampledRaster.read
    • ResampledRaster.resampling
• geowatch.utils.util_regex module
  • VimRegexBuilder
  • PythonRegexBuilder
• geowatch.utils.util_resolution module
  • ExtendedTransformer
    • ExtendedTransformer.parser()
    • ExtendedTransformer.parse()
  • ResolvedTransformer
    • ResolvedTransformer.magnitude()
    • ResolvedTransformer.unit()
    • ResolvedTransformer.implicit_unit()
    • ResolvedTransformer.numeric_unit()
    • ResolvedTransformer.resolved_unit()
  • ResolvedUnitTransformer
  • ResolvedScalarTransformer
    • ResolvedScalarTransformer.resolved_scalar()
  • ResolvedWindowTransformer
    • ResolvedWindowTransformer.window_1d_dim()
    • ResolvedWindowTransformer.window_2d_dim()
    • ResolvedWindowTransformer.window()
    • ResolvedWindowTransformer.resolved_window()
  • Resolved
    • Resolved.parse()
    • Resolved.coerce()
  • ResolvedUnit
    • ResolvedUnit.coerce()
  • ResolvedScalar
    • ResolvedScalar.at_resolution()
  • ResolvedWindow
    • ResolvedWindow.at_resolution()
• geowatch.utils.util_retry module
  • DummyLogger
    • DummyLogger.warning()
  • Retry
  • retry_call()
• geowatch.utils.util_rgdc module
• geowatch.utils.util_s3 module
  • get_file_from_s3()
  • send_file_to_s3()
• geowatch.utils.util_stringalgo module
  • shortest_unique_prefixes()
  • shortest_unique_suffixes()
• geowatch.utils.util_torchmetrics module
  • BinaryF1Score
    • BinaryF1Score.compute()
  • BinaryOverallAccuracy
    • BinaryOverallAccuracy.compute()
  • BinaryBalancedAccuracy
    • BinaryBalancedAccuracy.compute()
  • BinaryTruePositiveRate
    • BinaryTruePositiveRate.compute()
• geowatch.utils.util_units module
  • unit_registry()

Module contents

geowatch.utils.find_dvc_dpath(name=NoParam, on_error='raise', **kwargs)

Return the location of the GeoWATCH DVC Data path if it exists and is in a “standard” location.

NOTE: other team members can add their “standard” locations if they want.

SeeAlso:

GEOWATCH_DATA_DPATH=$(geowatch_dvc)

python -m geowatch.cli.find_dvc –hardware=hdd python -m geowatch.cli.find_dvc –hardware=ssd

geowatch.utils.find_smart_dvc_dpath(*args, **kw)