Introduction
The Transit Corridor Analytics are designed to work with configuration files at various levels. A specific Python process is designed to validate and parse these configuration settings. Below is a summary of the configuration settings used:
- Main Configuration
The Main Configuration is essential for establishing access to data at different stages of the process. It must be set up for the ETL process to function correctly. The configuration module is used to parse and validate the main configuration files. - Run Configuration
The Run Configuration sets up the arguments needed to execute one or more steps of the ETL process. While this configuration is optional, it is highly recommended for maintaining transparency within the process. The run_config module is responsible to parse these configuration files. - Calculation Configurations
The Calculation Configurations serves as a recipe for the sequential operations applied to incoming data. These configuration require minimal user intervention unless there is a need to update the formulation, change the order of operations, or add new operations. These files are read by thetransformer
module within thetransit_metrics_aggregate
module where the data validation occurs as part of the process.