Manual Docs

• GeoWATCH System
• Sensor Channel Spec
• TA2 Deep Dive Notes
• Baseline 2023-06-22 BAS
• Baseline 2023-06-22 Joint BAS+AC/SC
• Tips and Tricks
• Troubleshooting
• Baseline 2023-06-22 Joint AC/SC Truth
• Baseline 2023-10-12 Full
• Baseline 2024-06-11 BAS
• Variation 2023-11-14 Full
• Beginner’s Python
  • Python Keywords
  • Dunder Methods
  • Standard Library Modules
  • Pypi Modules
  • Builtins
  • Advanced Terms
  • Python Package Structure / Importing
• Accessing GeoWATCH DVC Repos
  • Prerequistes
  • Clone the Repos
  • Access data in the Data DVC repo
• Accessing Phase3 GeoWATCH DVC Repos
  • Prerequistes
  • Clone the Repos
  • Register Repos
  • Access Data
• Internal Resources
• Using GeoWATCH DVC
• Debugging Cmd-Queue Powered Scripts
• Coding Conventions in the GeoWATCH REPO
  • Spaces
• Coding Environment
  • Enable Argcomplete
  • Useful Aliases
• Coding Tips
• Valuable Code Properties
  • Code Patterns
  • Testing
  • Filesystems
• Misc
• Contributing New Models to the WATCH Project
  • Assumptions:
  • Steps to sharing your model:
  • Whats going on behind the scenes:
• How to Contribute
• Forking Workflow
• Rebasing Procedure
• Roadmap
  • Features
  • Quality of Life
  • Bugs
  • Performance
  • Research
  • Compatibility
  • Documentation
  • System Design
  • Algorithmic Exploration
  • User Interface
• TA2 Feature Integration
• Getting started with AWS
  • Installing AWS CLI
  • AWS Credentials
    • Obtaining Credentials
    • Using Credentials
  • AWS Security
  • Next Steps
• Minimal DVC
• Installation
• Core Commands
• Details
• Use Cases
• Getting started with AWS
  • Prerequisites
  • Install Kubernetes CLI
  • Next Steps
• Getting started with PostgreSQL
• Setup your SSH Keys
  • Generating SSH Keys
  • Register SSH Keys with a Gitlab
  • Modify An Existing Clone to Use SSH
  • Register SSH Keys with a DVC server
  • Troubleshooting SSH Keys
• Installing Python
• Installing Python With Conda
  • Create GeoWATCH Environment with Conda
• Installing Pyenv
  • Create GeoWATCH environment with Pyenv
• Installing GeoWATCH For Development
  • Option 1: Local Install
    • Install Python
    • Non-Python Requirements
    • Installing
    • Submodules
    • Testing
  • Option 2: Docker Image
• Understanding Editable Installs
  • Installing to Site Packages
• See Also
• GeoWATCH On Windows
  • Installer Miniconda
  • Install Bash
  • Environment Setup
  • Optional: Installing From Source
  • Running The Tutorial
    • WSL2 Instructions
  • Running on WSL2
• Examles
• FAQ on CloudMasks
  • Question
  • Answer
• FAQ: Model Prediction
  • Question
  • Answer
• FAQ: STAC
  • Question
  • Answer
• Refactoring Datasets and Models
  • The Model
  • The Dataset
  • Ambiguous / Other
• Directory Structure for Multi-task Integration
  • Design Goals (2021):
  • Design Goals (2023):
  • Directory Structure:
    • Usage:
    • Fit API:
    • Predict API:
    • Evaluation:
  • Examples:
• Supporting Projects
• Using the MLOps tool to run GeoWATCH
  • using DVC and geowatch_dvc
    • sidebar: setting up a shared DVC cache on a shared machine
  • using mlops to checkout a model
  • using mlops to run an evaluation
  • debugging/examining a running mlops invocation
    • sidebar: help, my predict step is hanging!
  • What does an mlops invocation run?
• GeoWATCH Onboarding
  • Tutorials
  • Module Structure
• GeoWATCH Overview
  • KWCOCO Data Interchange
  • Semantically Rich Features
  • Training Pipeline
  • Prediction Pipeline
  • Software Testing
  • MLOps
  • Relationship to RasterVision
• SMART Activity Characterization Tutorial
  • 1. Access AC Data
  • 2. Modify AC Data
  • 3. Train an AC Model
  • 4. Evaluate an AC Model with MLOps
• SMART Ensemble Tutorial
• Getting Started With Smartflow
  • Requirements
  • Configure Kubernetes
  • Troubleshooting
  • Running the Webserver
  • References
  • Next Steps
  • SeeAlso
• Copying Large Files to EFS
  • Prerequisites
  • AWS Configuration
  • Configuring kubctl to reach smartflow
    • rsync and kubernetes
• Connecting to Smartflow
• Launch a KIT_DEMO_WAIT job
• Finally we can copy!
• Common pitfalls
• Running The System In Smartflow
  • Prerequisites
  • Section 0: NOTICE OF AUTOMATION
  • Section 1: The GeoWATCH Docker Image
    • Building the Pyenv Base Image
    • Building the GeoWATCH Image
    • How to Bake a Model into a Pyenv Dockerfile
    • Update An Existing Image
  • How to Submit a DAG
  • Building / Modifying a DAG
    • Running DAGS
    • Debuggging DAGS
  • Old Notes
    • How to Bake a Model into a Dockerfile (OLD)
    • Running Dags After Containers are Using (OLD)
    • SeeAlso
• Prerequisites
  • AWS Configuration
  • Configuring kubctl to reach smartflow
• Connecting to Smartflow
• Launch a KIT_TRAIN_WITH_YAML job
• Copying your own DAG to Smartflow’s S3 Bucket
• Logging into a running DAG step / K8s pod
• Running CI Locally
• Running tests
• Writing tests
• Tutorials
• Important GeoWATCH Scripts
• Summary of GeoWATCH Scripts
  • Main Commands / Scripts
  • Dataset Preparation / Management
  • Production / Prediction / Evaluation
  • Secondary Scripts
• The “geowatch_dvc” command