geowatch package¶
Subpackages¶
- geowatch.cli package
- Subpackages
- Submodules
- geowatch.cli.animate_visualizations module
- geowatch.cli.baseline_framework_ingress module
- geowatch.cli.cluster_sites module
- geowatch.cli.coco_add_ignore_buffer module
- geowatch.cli.coco_add_watch_fields module
- geowatch.cli.coco_align module
- geowatch.cli.coco_average_features module
- geowatch.cli.coco_clean_geotiffs module
- geowatch.cli.coco_combine_features module
- geowatch.cli.coco_crop_tracks module
- geowatch.cli.coco_reformat_channels module
- geowatch.cli.coco_remove_bad_images module
- geowatch.cli.coco_spectra module
- geowatch.cli.coco_time_combine module
- geowatch.cli.coco_update_geotiff_metadata module
- geowatch.cli.coco_visualize_videos module
- geowatch.cli.collect_env module
- geowatch.cli.concat_kwcoco_videos module
- geowatch.cli.crop_sites_to_regions module
- geowatch.cli.draw_region module
- geowatch.cli.extend_sc_sites module
- geowatch.cli.find_dvc module
- geowatch.cli.fit module
- geowatch.cli.fix_region_models module
- geowatch.cli.geojson_site_stats module
- geowatch.cli.geotiffs_to_kwcoco module
- geowatch.cli.merge_region_models module
- geowatch.cli.mlops_cli module
- geowatch.cli.predict module
- geowatch.cli.pseudolive_consolidate module
- geowatch.cli.reproject_annotations module
ReprojectAnnotationsConfig
main()
check_sitemodel_assumptions()
separate_region_model_types()
expand_site_models_with_site_summaries()
make_pseudo_sitemodels()
validate_site_dataframe()
assign_sites_to_images()
propogate_site()
keyframe_interpolate()
plot_poc_keyframe_interpolate()
plot_image_and_site_times()
draw_geospace()
is_nonish()
- geowatch.cli.run_fusion_predict module
- geowatch.cli.run_metrics_framework module
- geowatch.cli.run_tracker module
KWCocoToGeoJSONConfig
coco_create_observation()
predict_phase_changes()
smooth_observation_scores()
classify_site()
coco_create_site_header()
convert_kwcoco_to_iarpa()
coco_track_to_site()
assign_sites_to_videos()
add_site_summary_to_kwcoco()
main()
coco_video_gdf()
assign_videos_to_regions()
coco_remove_out_of_bound_tracks()
demo()
- geowatch.cli.smartflow_egress module
- geowatch.cli.smartflow_ingress module
- geowatch.cli.split_videos module
- geowatch.cli.stac_search module
- geowatch.cli.stac_to_kwcoco module
- geowatch.cli.torch_model_stats module
- geowatch.cli.validate_annotation_schemas module
- geowatch.cli.watch_coco_stats module
- Module contents
- geowatch.demo package
- geowatch.geoannots package
- geowatch.gis package
- geowatch.mlops package
- Submodules
- geowatch.mlops.aggregate module
- geowatch.mlops.aggregate_loader module
- geowatch.mlops.aggregate_plots module
- geowatch.mlops.confusor_analysis module
- geowatch.mlops.manager module
- geowatch.mlops.pipeline_nodes module
- geowatch.mlops.repackager module
- geowatch.mlops.schedule_evaluation module
- geowatch.mlops.smart_global_helper module
- geowatch.mlops.smart_pipeline module
FeatureComputation
FeatureUnion
HeatmapPrediction
PolygonPrediction
PolygonEvaluation
HeatmapEvaluation
KWCocoVisualization
InvariantFeatureComputation
MaterialFeatureComputation
LandcoverFeatureComputation
BAS_HeatmapPrediction
SC_HeatmapPrediction
BAS_PolygonPrediction
SC_PolygonPrediction
BAS_HeatmapEvaluation
SC_HeatmapEvaluation
BAS_PolygonEvaluation
SC_PolygonEvaluation
BAS_Visualization
SC_Visualization
Cropping
SiteClustering
SC_Cropping
SV_Cropping
SV_DepthPredict
SV_DepthFilter
DinoBoxDetector
SV_DinoFilter
bas_nodes()
sc_nodes()
make_smart_pipeline_nodes()
make_smart_pipeline()
dzyne_sv_only_pipeline()
- geowatch.mlops.smart_result_parser module
parse_json_header()
parse_json_header_cached()
trace_json_lineage()
load_iarpa_evaluation()
load_pxl_eval()
Found
resolve_cross_machine_path()
global_ureg()
relevant_pred_pxl_config()
parse_resource_item()
find_pred_pxl_item()
find_info_items()
find_track_item()
find_metrics_framework_item()
find_pxl_eval_item()
- Module contents
- Submodules
- geowatch.monkey package
- Submodules
- geowatch.monkey.monkey_albumentations module
- geowatch.monkey.monkey_kwcoco module
- geowatch.monkey.monkey_kwutil module
- geowatch.monkey.monkey_lightning module
- geowatch.monkey.monkey_numpy module
- geowatch.monkey.monkey_pil module
- geowatch.monkey.monkey_scriptconfig module
- geowatch.monkey.monkey_tensorflow module
- geowatch.monkey.monkey_torch module
- geowatch.monkey.monkey_torchmetrics module
- Module contents
- Submodules
- geowatch.rc package
- geowatch.stac package
- geowatch.tasks package
- Subpackages
- geowatch.tasks.cold package
- geowatch.tasks.depth package
- geowatch.tasks.depth_pcd package
- geowatch.tasks.dino_detector package
- geowatch.tasks.fusion package
- geowatch.tasks.invariants package
- geowatch.tasks.landcover package
- geowatch.tasks.mae package
- geowatch.tasks.metrics package
- geowatch.tasks.poly_from_point package
- geowatch.tasks.sam package
- geowatch.tasks.tracking package
- geowatch.tasks.uky_temporal_prediction package
- Module contents
- Subpackages
- geowatch.utils package
- Subpackages
- Submodules
- geowatch.utils.configargparse_ext module
- geowatch.utils.ext_monai module
- geowatch.utils.ijson_ext module
- geowatch.utils.kwcoco_extensions module
filter_image_ids()
populate_watch_fields()
coco_populate_geo_heuristics()
coco_populate_geo_img_heuristics2()
coco_populate_geo_video_stats()
check_kwcoco_spatial_transforms()
check_geo_transform_consistency()
check_unique_channel_names()
coco_list_asset_infos()
check_geotiff_formats()
rewrite_geotiffs()
geotiff_format_info()
ensure_transfered_geo_data()
transfer_geo_metadata()
transfer_geo_metadata2()
coco_channel_stats()
TrackidGenerator
coco_img_wld_info()
warp_annot_segmentations_from_geos()
warp_annot_segmentations_to_geos()
visualize_rois()
covered_image_geo_regions()
covered_video_geo_regions()
covered_annot_geo_regions()
associate_images()
reorder_video_frames()
pick_channels()
- geowatch.utils.process_context module
- geowatch.utils.remedian module
- geowatch.utils.result_analysis module
- geowatch.utils.reverse_hashid module
- geowatch.utils.simple_dvc module
- geowatch.utils.util_bands module
- geowatch.utils.util_codes module
- geowatch.utils.util_data module
- geowatch.utils.util_dotdict module
- geowatch.utils.util_exception module
- geowatch.utils.util_framework module
egress_item()
ingress_item()
download_mtd_msil1c()
download_file()
download_http_file()
CacheItemOutputS3Wrapper
IngressProcessEgressWrapper
download_region()
determine_region_id()
AWS_S3_Command
ta2_collate_output()
fixup_and_validate_site_and_region_models()
check_region_and_site_models_agree()
NodeStateDebugger
PrintLogger
- geowatch.utils.util_fsspec module
- geowatch.utils.util_gdal module
- geowatch.utils.util_girder module
- geowatch.utils.util_gis module
- geowatch.utils.util_globals module
- geowatch.utils.util_hardware module
- geowatch.utils.util_iter module
- geowatch.utils.util_kwarray module
- geowatch.utils.util_kwimage module
upweight_center_mask()
perchannel_colorize()
ensure_false_color()
colorize_label_image()
local_variance()
find_lowvariance_regions()
find_samecolor_regions()
find_high_frequency_values()
polygon_distance_transform()
multiple_polygon_distance_transform_weighting()
devcheck_frame_poly_weights()
find_low_overlap_covering_boxes()
find_low_overlap_covering_boxes_optimize()
exactly_1channel()
load_image_shape()
draw_multiclass_clf_on_image()
- geowatch.utils.util_kwplot module
TitleBuilder
cropwhite_ondisk()
dataframe_table()
humanize_dataframe()
scatterplot_highlight()
humanize_labels()
relabel_xticks()
LabelModifier
FigureFinalizer
fix_matplotlib_dates()
fix_matplotlib_timedeltas()
extract_legend()
ArtistManager
time_sample_arcplot()
Palette
PaletteManager
color_new_labels()
autompl2()
FigureManager
fix_seaborn_palette_issue()
- geowatch.utils.util_kwutil module
- geowatch.utils.util_logging module
- geowatch.utils.util_nesting module
- geowatch.utils.util_netharn module
Optimizer
Initializer
NoOp
Orthogonal
KaimingUniform
KaimingNormal
apply_initializer()
trainable_layers()
number_of_parameters()
ToyNet2d
ToyData2d
InputNorm
MultiLayerPerceptronNd
rectify_dropout()
rectify_nonlinearity()
rectify_normalizer()
Identity
Conv0d
Conv1d
Conv2d
Conv3d
rectify_conv()
weight_standardization_nd()
ConvNormNd
ConvNorm1d
ConvNorm2d
ConvNorm3d
Swish
beta_mish()
Mish_Function
Mish
default_kwargs()
CollateException
padded_collate()
- geowatch.utils.util_nvidia module
- geowatch.utils.util_pandas module
DataFrame
pandas_reorder_columns()
pandas_argmaxima()
pandas_suffix_columns()
pandas_nan_eq()
pandas_shorten_columns()
pandas_condense_paths()
pandas_truncate_items()
DotDictDataFrame
pandas_add_prefix()
aggregate_columns()
SpecialAggregators
NonConstantError
nan_eq()
GroupbyFutureWrapper
pandas_fixed_groupby()
- geowatch.utils.util_param_grid module
- geowatch.utils.util_raster module
- geowatch.utils.util_regex module
- geowatch.utils.util_resolution module
- geowatch.utils.util_retry module
- geowatch.utils.util_rgdc module
- geowatch.utils.util_s3 module
- geowatch.utils.util_stringalgo module
- geowatch.utils.util_torchmetrics module
- geowatch.utils.util_units module
- Module contents
Submodules¶
- geowatch.exceptions module
- geowatch.heuristics module
DEFAULT_QA_ENCODING
IARPA_REAL_STATUS
iarpa_assign_truth_confusion()
iarpa_assign_pred_confusion()
TAG_IF()
CONDITION()
ALL()
hack_track_categories()
ensure_heuristic_coco_colors()
ensure_heuristic_category_tree_colors()
category_tree_ensure_color()
category_category_colors()
dummy_legend()
build_image_header_text()
auto_expt_dvc()
auto_data_dvc()
normalize_sensors()
extract_region_id()
register_known_fsspec_s3_buckets()
Module contents¶
The GeoWATCH module
The GeoWATCH Gitlab Repo |
|
The GeoWATCH Github Repo (Mirror) |
|
Pypi |
|
Read the docs |
|
Slides |
Main modules of interest are:
Main Tasks:
Supported Feature Tasks:
geowatch.tasks.rutgers_material_seg_v2
Also see:
You probably wont need:
# Useful environs
# Phase 3
DVC_DATA_DPATH=$(geowatch_dvc --tags='phase3_data' --hardware=auto)
DVC_EXPT_DPATH=$(geowatch_dvc --tags='phase3_expt' --hardware=auto)
echo "$DVC_DATA_DPATH"
echo "$DVC_EXPT_DPATH"
# Phase 2
DVC_DATA_DPATH=$(geowatch_dvc --tags='phase2_data' --hardware=auto)
DVC_EXPT_DPATH=$(geowatch_dvc --tags='phase2_expt' --hardware=auto)
HIGHRES_DVC_EXPT_DPATH=$(geowatch_dvc --tags='smart_drop7' --hardware=auto)
DATA_DVC_DPATH=$DVC_DATA_DPATH
EXPT_DVC_DPATH=$DVC_EXPT_DPATH
# To get the above make sure you have run:
geowatch_dvc add my_phase2_data_repo --path=<path-to-your-phase2-data-dvc-repo> --hardware=hdd --priority=100 --tags=phase2_data
geowatch_dvc add my_phase2_expt_repo --path=<path-to-your-phase2-expt-dvc-repo> --hardware=hdd --priority=100 --tags=phase2_expt
# Useful Python Snippets
import geowatch
data_dvc_dpath = geowatch.find_dvc_dpath(tags='phase3_data', hardware='auto')
expt_dvc_dpath = geowatch.find_dvc_dpath(tags='phase3_expt', hardware='auto')
- geowatch.coerce_kwcoco(data='geowatch-msi', **kwargs)[source]¶
coerce with geowatch special datasets
Calls kwcoco.CocoDataset.coerce unless the code is geowatch-msi, and then we construct a special dataset with extra variables expected by the watch project.
- Parameters:
data (str | Coercible[kwcoco.CocoDataset]) – the special code to coerce
**kwargs – modify how the demodata is created. For geowatch-msi, see
demo_kwcoco_multisensor()
, a selection of useful args are:dates: bool - add random dates to images geodata: bool | dict - assign images to random geo locations.
Can be a dict with extra options. See: func:hack_seed_geometadata_in_dset. valid keys are: enabled, region_geom
heatmap: bool - add noisy heatmaps as channels image_size: Tuple[int, int] - control size of images num_videos: int - control number of videos num_frames: int - control length of videos num_tracks: int - control number of objects multispectral: bool - control dummy channels multisensor: bool - control dummy sensors bad_nodata: bool - control if nodata values exist max_speed: float - control speed of demo objects anchors - bounding box templates for objects, see kwcoco demo docs..
Example
>>> import geowatch >>> dates=True >>> geodata=True >>> heatmap=True >>> kwargs = {} >>> coco_dset = geowatch.coerce_kwcoco(data='geowatch-msi', dates=dates, geodata=geodata, heatmap=heatmap) >>> coco_dset2 = geowatch.coerce_kwcoco(data='geowatch-msi-dates-geodata-gsize32') >>> assert 'date_captured' in coco_dset2.images().peek()
- geowatch.find_dvc_dpath(name=NoParam, on_error='raise', **kwargs)[source]¶
Return the location of the GeoWATCH DVC Data path if it exists and is in a “standard” location.
NOTE: other team members can add their “standard” locations if they want.
- SeeAlso:
GEOWATCH_DATA_DPATH=$(geowatch_dvc)
python -m geowatch.cli.find_dvc –hardware=hdd python -m geowatch.cli.find_dvc –hardware=ssd