Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zone Aggregation Take 2 #19

Closed
wants to merge 33 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
c0035e5
initial zone agg
jpn-- Apr 29, 2022
e0c3e9b
Adding aggregation fields for zone aggregation
vivekyadav26 May 2, 2022
6681e1e
Updating column references
vivekyadav26 May 2, 2022
44095f4
implementing explicit aggregation
vivekyadav26 May 2, 2022
ab6f497
zone agg updates
jpn-- May 3, 2022
660dbad
notebook
jpn-- May 5, 2022
d11f655
Merge branch 'main' into zone-agg
jpn-- May 5, 2022
bc38c45
zone agg on TAZs
jpn-- May 9, 2022
136c7b9
test data
jpn-- May 9, 2022
10f1de6
git lfs
jpn-- May 9, 2022
08433d0
git-lfs in env
jpn-- May 9, 2022
dbb91f1
add pyarrow dependency
jpn-- May 9, 2022
89b6d4c
notes
jpn-- May 11, 2022
943d495
script to create test data
jpn-- May 12, 2022
279bee7
Remove GIT LFS, point notebook to `resources` dir
DavidOry May 26, 2022
8652779
remove big files
jpn-- Jun 8, 2022
2d1df97
remove big file
jpn-- Jun 8, 2022
cb305fd
crosswalks and centroids
jpn-- Jun 21, 2022
46edf95
crosswalks and centroid mapping in notebook
jpn-- Jun 21, 2022
c4e4c09
Translate Demand, initial commit
elias-sanz Jun 29, 2022
cb98e9c
sandag model - 14.2.2
vivekyadav26 Jun 30, 2022
c848a73
Merge pull request #10 from elias-sanz/zone-agg
elias-sanz Jun 30, 2022
0f4598e
customizable start values for cluster_id
jpn-- Jul 11, 2022
57d84bb
Network Centroid Connectors
vivekyadav26 Jul 15, 2022
e2d8f61
Implement as method
vivekyadav26 Jul 15, 2022
23202e5
add load data function
jpn-- Oct 19, 2022
5fc4822
test data loader
jpn-- Oct 19, 2022
fea623d
Merge branch 'data-loader' into zone-agg
jpn-- Oct 19, 2022
b99c07b
fix error when no chdir
jpn-- Oct 19, 2022
13ce926
update notebook
jpn-- Oct 19, 2022
cc5609e
translate demand code for aggregating omx matrices
AshishKuls Oct 27, 2022
da991df
add gitignore to ignore test files
AshishKuls Oct 27, 2022
41e8daf
Remove `sandag_abm` files
DavidOry Nov 9, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Empty file added .gitattributes
Empty file.
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -4,3 +4,5 @@ sandag_rsm/__pycache__
.ipynb_checkpoints
sandag_rsm.egg-info
_version.py
.DS_Store
test/data/*
8 changes: 4 additions & 4 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
repos:

- repo: https://github.com/pre-commit/pre-commit-hooks
rev: v4.1.0
rev: v4.3.0
hooks:
- id: check-yaml
- id: end-of-file-fixer
exclude: .*\.ipynb
- id: trailing-whitespace

- repo: https://github.com/kynan/nbstripout
rev: 0.5.0
rev: 0.6.1
hooks:
- id: nbstripout

Expand All @@ -20,11 +20,11 @@ repos:
args: ["--profile", "black", "--filter-files"]

- repo: https://github.com/psf/black
rev: 21.12b0
rev: 22.10.0
hooks:
- id: black

- repo: https://github.com/PyCQA/flake8
rev: 4.0.1
rev: 5.0.4
hooks:
- id: flake8
32 changes: 29 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,16 @@
# RSM
Rapid Strategic Model for the San Diego Association of Governments

## Source Code Access

The source code for the RSM is stored in this repository. You can access it
via GitHub, or check out the repository using Git. Some larger files (especially
for testing) are stored using [git-lfs](https://git-lfs.github.com/) (large file
storage). This is mostly transparent, but for best results you do need to make
sure that the LFS extension is installed before you clone the repository. Visit
[git-lfs](https://git-lfs.github.com/) for platform-specific instructions.


## Installing

To install, activate the python or conda environment you want to use,
Expand All @@ -10,6 +20,13 @@ the cd into the repository directory and run:
python -m pip install -e .
```

This will make the `sandag_rsm` package available, so you can `import sandag_rsm`
to access the functions in this tool, without regard for the current working
directory or pointing the python path to the right place(s). Using the `-e` flag
installs in `editable` mode, so if you make changes or pull updates from GitHub,
those updates will be available to Python without re-installing.


## Code Formatting

This repo use several tools to ensure a consistent code format throughout the project:
Expand All @@ -34,19 +51,28 @@ with `git commit --no-verify`.

## Developing with Docker

To build the docker container, change into the repository root and run:
This project uses [Docker](https://www.docker.com/). For development, to build
the docker container, change into the repository root and run:

```shell
docker build --tag sandag_rsm .
````

### Jupyter Notebook for Development

On the host machine, run:
On the host machine, on linux or macOS run:

```shell
docker run -v $(pwd):/home/mambauser/sandag_rsm -p 8899:8899 \
-it sandag_rsm jupyter notebook --ip 0.0.0.0 --no-browser --allow-root \
-it --rm sandag_rsm jupyter notebook --ip 0.0.0.0 --no-browser --allow-root \
--port 8899 --notebook-dir=/home/mambauser
```

or in `cwd` on Windows, run:

```shell
docker run -v %cd%:/home/mambauser/sandag_rsm -p 8899:8899 ^
-it --rm sandag_rsm jupyter notebook --ip 0.0.0.0 --no-browser --allow-root ^
--port 8899 --notebook-dir=/home/mambauser
```

Expand Down
3 changes: 3 additions & 0 deletions environment.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,12 +10,15 @@ dependencies:
- numpy>=1.19
- geopandas
- git
- git-lfs
- jupyter
- libpysal
- networkx
- notebook
- openmatrix
- pandas
- plotly
- pyarrow
- pyproj
- requests=2.25.1
- scikit-learn
Loading