| .. | ||
| base | ||
| bin | ||
| default | ||
| schemas | ||
| update | ||
| OWNERS | ||
| PRESUBMIT.py | ||
| pylintrc | ||
| README.md | ||
Firefighter
Firefighter is an App Engine dashboard that visualizes time series data.
The overall process is to:
- Ingest multiple streams of data, either by polling data sources, or by bot uploads.
- Convert everything to a trace event and tag it with metadata.
- Filter the events on dozens of parameters with low cost and latency, using BigQuery.
- Produce arbitrary visualizations for arbitrary data on-demand.
Prerequisites
Follow the instructions for setting up Google App Engine Managed VMs.
-
Download and install the Google Cloud SDK.
-
Ensure you are authorized to run gcloud commands.
$ gcloud auth login -
Set the default project name.
$ gcloud config set project PROJECT -
Install the gcloud app component.
$ gcloud components update app
Development Server
You must have the Google Cloud SDK installed. Run:
stats$ bin/run
Deployment
You must have the Google Cloud SDK installed. Run:
stats$ bin/deploy
Code Organization
The app is divided into two modules: default and update. The update module handles ingestion of data, through either polling or uploading from an external service. The default module handles user queries. base/ contains code shared between both modules.