feat: wecc congestion stats

[victoriahunt]

WECC congestion statistics code added to transmission.py.
Function to generate utilization as proportion of capacity (power flow divided by capacity) added to transmission.py.

[victoriahunt]

I'm currently adding a version of the wecc congestion stats that will allow the user to pick the congestion thresholds. Will commit to the branch as this work is completed.

[rouille]

I believe your branch should be merged to develop and not master. If @kasparm agrees, you will need to edit your PR. Also you have pushed a lot of binary files (in the pycache folder), would you mind removing them?

[victoriahunt]

I changed the branch to merge into to develop. Also removed the pycache binary files.

[kasparm]

Also, create a function that only takes an instance of the scenario object and returns the congestion analysis.

[victoriahunt]

I've fixed several of the issues identified: removing name from input parameter, removing function from within the function, and adding doc strings to all the functions for documentation. I am still working on 'create a function that only takes an instance of the scenario object and returns the congestion analysis"

[victoriahunt]

I've successfully created a function that only takes an instance of the scenario object and returns the congestion analysis.

It's a bit slow, taking 5 min or so to run -- I will work on speeding it up.

[victoriahunt]

Per conversation earlier today with Kaspar, I've put the mapping function into transmission.py, and a demo in the demo folder. I removed the outdated p-value based function, and associated notebooks (mapping and analysis).

[victoriahunt]

Per conversation today with Kaspar, will move the mapping function to it's own py script in the analyze folder of PostREISE. Also will remove unnecessary imports and will adhere to punctuation conventions using spaces etc.

[rouille]

In function generate_cong_df, the branch data frame is modified (a new column capacity is added). Data frames are mutable meaning that the original data frame will be in turn modified. I believe this should not be the case.

branch data frame before call to generate_cong_df:

grid.branch.columns
Index(['from_bus_id', 'to_bus_id', 'r', 'x', 'b', 'rateA', 'rateB', 'rateC',
       'ratio', 'angle', 'status', 'angmin', 'angmax', 'Pf', 'Qf', 'Pt', 'Qt',
       'mu_Sf', 'mu_St', 'mu_angmin', 'mu_angmax', 'branch_device_type',
       'interconnect', 'from_lat', 'from_lon', 'to_lat', 'to_lon',
       'from_zone_id', 'to_zone_id', 'from_zone_name', 'to_zone_name'],
      dtype='object')

branch data frame after call to generate_cong_df:

grid.branch.columns
Index(['from_bus_id', 'to_bus_id', 'r', 'x', 'b', 'rateA', 'rateB', 'rateC',
       'ratio', 'angle', 'status', 'angmin', 'angmax', 'Pf', 'Qf', 'Pt', 'Qt',
       'mu_Sf', 'mu_St', 'mu_angmin', 'mu_angmax', 'branch_device_type',
       'interconnect', 'from_lat', 'from_lon', 'to_lat', 'to_lon',
       'from_zone_id', 'to_zone_id', 'from_zone_name', 'to_zone_name',
       'capacity'],
      dtype='object')

If you want to learn more about passage by copy/reference, mtability/immutability, I recommend these two blog posts:
https://medium.com/@tyastropheus/tricky-python-i-memory-management-for-mutable-immutable-objects-21507d1e5b95
https://medium.com/@tyastropheus/tricky-python-ii-parameter-passing-for-mutable-immutable-objects-10e968cbda35

I am going to rewrite this function.

[victoriahunt]

update: I spoke with Ben about this and agree that rewriting to not directly modify the dataframe (preserve original) makes sense. Also that rateA == 0 capacity should be NA as it isn't applicable. When rateA == 0 that means capacity is unconstrained on branch. It will not be congested and therefore isn't included in congestion analyses.

[kasparm]

Waiting for changes by @victoriahunt and @danielolsen before merging into develop.

[victoriahunt]

Confirmed with Ben last week that his code calculates same values that mine did. It is ready to be merged.

[danielolsen]

I talked to @kasparm and @rouille and @victoriahunt and didn't learn of any changes that I need to make to this branch.

[rouille]

The las commit reorganize the modules: mapping is moved in plot/ as test_transmission. Docstrings have been written and demo notebook illustrates the analysis. Interactive rebase will be down tomorrow morning and merge into develop. Thanks to @victoriahunt for her patience. Great job.

[rouille]

I will do the rebase tomorrow and merge into develop.