geowatch.mlops package¶
Submodules¶
- geowatch.mlops.__main__ module
- geowatch.mlops.aggregate module
AggregateLoader
AggregateEvluationConfig
main()
TopResultsReport
AggregatorAnalysisMixin
AggregatorAnalysisMixin.macro_analysis()
AggregatorAnalysisMixin.varied_param_counts()
AggregatorAnalysisMixin.analyze()
AggregatorAnalysisMixin.report_best()
AggregatorAnalysisMixin.resource_summary_table()
AggregatorAnalysisMixin.report_resources()
AggregatorAnalysisMixin.make_summary_analysis()
AggregatorAnalysisMixin.make_result_node_symlinks()
AggregatorAnalysisMixin.build_plotter()
AggregatorAnalysisMixin.plot_all()
AggregatorAnalysisMixin._wip_build_per_region_variance_tables()
Aggregator
Aggregator.demo()
Aggregator.build()
Aggregator.primary_macro_region
Aggregator.filterto()
Aggregator.compress()
Aggregator.metrics
Aggregator.resources
Aggregator.index
Aggregator.params
Aggregator.requested_params
Aggregator.specified_params
Aggregator.resolved_params
Aggregator.build_effective_params()
Aggregator.find_macro_comparable()
Aggregator.gather_macro_compatable_groups()
Aggregator._coerce_rois()
Aggregator.build_macro_tables()
Aggregator.build_single_macro_table()
inspect_node()
aggregate_param_cols()
macro_aggregate()
hash_param()
hash_regions()
nan_eq()
- geowatch.mlops.aggregate_loader module
- geowatch.mlops.aggregate_plots module
- geowatch.mlops.confusor_analysis module
ConfusorAnalysisConfig
main()
ConfusionAnalysis
ConfusionAnalysis.reload()
ConfusionAnalysis.load_geojson_models()
ConfusionAnalysis.load_confusion_assignment()
ConfusionAnalysis.load_new_stage_stuff()
ConfusionAnalysis.add_confusion_to_geojson_models()
ConfusionAnalysis.build_hard_cases()
ConfusionAnalysis.dump_confusion_geojson()
ConfusionAnalysis.dump_hardneg_geojson()
ConfusionAnalysis.dump_hardneg_kwcoco()
ConfusionAnalysis.dump_confusion_kwcoco()
ConfusionAnalysis.dump_summary_viz()
ConfusionAnalysis.dump_site_case_viz()
ConfusionAnalysis.build_site_confusion_cases()
make_case()
visualize_case()
make_pred_score_timeline()
make_case_timeline()
visualize_all_timelines()
differentiate_site_id()
fix_site_id()
coco_upgrade_track_ids()
make_summary_visualization()
to_styled_kml()
nan_to_null()
safediv()
- geowatch.mlops.manager module
ManagerConfig
main()
DVCExptManager
ExperimentState
ExperimentState.VERSIONED_COLUMNS
ExperimentState.STAGING_COLUMNS
ExperimentState._build_path_patterns()
ExperimentState._parse_pattern_attrs()
ExperimentState.staging_rows()
ExperimentState.versioned_rows()
ExperimentState.staging_table()
ExperimentState.versioned_table()
ExperimentState.cross_referenced_tables()
ExperimentState.list()
ExperimentState.summarize()
ExperimentState.package_checkpoints()
ExperimentState.copy_packages_to_dvc()
ExperimentState.add_packages_to_dvc()
ExperimentState.add_packages()
ExperimentState.push_packages()
checkpoint_filepath_info()
summarize_tables()
UserAbort
- geowatch.mlops.pipeline_nodes module
Pipeline
glob_templated_path()
_has_jq()
Node
IONode
InputNode
OutputNode
_classvar_init()
memoize_configured_method
memoize_configured_property()
ProcessNode
ProcessNode.name
ProcessNode.executable
ProcessNode.algo_params
ProcessNode.perf_params
ProcessNode.in_paths
ProcessNode.out_paths
ProcessNode.group_dname
ProcessNode.configure()
ProcessNode.condensed
ProcessNode._build_templates()
ProcessNode._finalize_templates()
ProcessNode.final_config
ProcessNode._depends_config()
ProcessNode.final_perf_config
ProcessNode.final_algo_config
ProcessNode.final_in_paths
ProcessNode.template_out_paths
ProcessNode.final_out_paths
ProcessNode.final_node_dpath
ProcessNode.final_root_dpath
ProcessNode.template_group_dpath
ProcessNode.template_node_dpath
ProcessNode.template_root_dpath
ProcessNode.predecessor_process_nodes()
ProcessNode.successor_process_nodes()
ProcessNode.ancestor_process_nodes()
ProcessNode._uncached_ancestor_process_nodes()
ProcessNode.depends
ProcessNode.algo_id
ProcessNode.process_id
ProcessNode._make_argstr()
ProcessNode.inputs
ProcessNode.outputs
ProcessNode.command
ProcessNode.test_is_computed_command()
ProcessNode.does_exist
ProcessNode.outputs_exist
ProcessNode._raw_command()
ProcessNode.final_command()
ProcessNode.find_template_outputs()
_load_json()
_add_prefix()
_fixup_config_serializability()
demodata_pipeline()
demo_pipeline_run()
PipelineDAG
- geowatch.mlops.repackager module
- geowatch.mlops.schedule_evaluation module
- geowatch.mlops.smart_global_helper module
SmartGlobalHelper
SmartGlobalHelper.VIZ_BLOCKLIST
SmartGlobalHelper.EXTRA_HASHID_IGNORE_COLUMNS
SmartGlobalHelper.EXTRA_PATH_COLUMNS
SmartGlobalHelper.LABEL_MAPPINGS
SmartGlobalHelper.shared_palettes()
SmartGlobalHelper.make_param_palette()
SmartGlobalHelper.label_modifier()
SmartGlobalHelper.default_vantage_points()
SmartGlobalHelper._default_metrics()
SmartGlobalHelper.mark_star_models()
SmartGlobalHelper.old_hacked_model_case()
SmartGlobalHelper.mark_delivery()
SmartGlobalHelper.populate_test_dataset_bundles()
SmartGlobalHelper.get_delivered_model_params()
SmartGlobalHelper.custom_channel_relabel()
SmartGlobalHelper.print_minmax_times()
SmartGlobalHelper.threshold_param_groups()
- geowatch.mlops.smart_pipeline module
FeatureComputation
FeatureUnion
HeatmapPrediction
PolygonPrediction
PolygonEvaluation
_phase2_dvc_data_dpath()
HeatmapEvaluation
KWCocoVisualization
InvariantFeatureComputation
MaterialFeatureComputation
LandcoverFeatureComputation
BAS_HeatmapPrediction
SC_HeatmapPrediction
BAS_PolygonPrediction
SC_PolygonPrediction
BAS_HeatmapEvaluation
SC_HeatmapEvaluation
BAS_PolygonEvaluation
SC_PolygonEvaluation
BAS_Visualization
SC_Visualization
Cropping
SiteClustering
SC_Cropping
SV_Cropping
SV_DepthPredict
SV_DepthFilter
DinoBoxDetector
SV_DinoFilter
bas_nodes()
sc_nodes()
make_smart_pipeline_nodes()
make_smart_pipeline()
dzyne_sv_only_pipeline()
- geowatch.mlops.smart_result_parser module
parse_json_header()
trace_json_lineage()
load_iarpa_evaluation()
load_bas_poly_eval()
load_iarpa_poly_eval()
load_sc_poly_eval()
_handle_crop_and_trk_params()
parse_tracker_params()
_handle_process_item()
load_pxl_eval()
Found
resolve_cross_machine_path()
global_ureg()
_add_prefix()
relevant_pred_pxl_config()
relevant_fit_config()
relevant_track_config()
parse_resource_item()
find_pred_pxl_item()
find_info_items()
parse_pred_pxl_params()
_load_json()
find_track_item()
find_metrics_framework_item()
find_pxl_eval_item()
shrink_channels()
is_teamfeat()
Module contents¶
THIS IS AN EXPERIMENTAL MODULE.
The goal of this submodule is to provide tooling to create, manage, and interact with DVC respositories of datasets and experiments.