Skip to content

OpenQuake Engine 3.3.0

Compare
Choose a tag to compare
@nastasi-oq nastasi-oq released this 07 Jan 14:39
· 134577 commits to master since this release

[Graeme Weatherill (@g-weatherill)]

  • Adds GMPE suite for national PSHA for Germany

[Daniele Viganò (@daniviga)]

  • Added a warning box when an unsupported browser is used to view the WebUI
  • Updated Docker containers to support a multi-node deployment
    with a shared directory
  • Moved the Docker containers source code from oq-builders
  • Updated the documentation related to the shared directory
    which is now mandatory for multi-node deployments

[Matteo Nastasi (@nastasi-oq)]

  • Removed tests folders

[Stéphane Drouet (@stephane-on)]

  • Added Drouet & Cotton (2015) GMPE including 2017 erratum

[Michele Simionato (@micheles)]

  • Optimized the memory occupation in classical calculations (Context.poe_map)
  • Fixed a wrong counting of the ruptures in split fault sources with
    an hypo_list/slip_list causing the calculation to fail
  • Made the export of uniform hazard spectra fast
  • Made the std hazard output properly exportable
  • Replaced the ~ in the header of the UHS csv files with a -
  • Restored the individual_curves flag even for the hazard curves
  • Implemented dGMPE weights per intensity measure type
  • Extended --reuse-hazard to all calculators
  • Fixed a bug in event_based_risk from GMFs with coefficients of variations

[Graeme Weatherill (@g-weatherill)]

  • Adds magnitude scaling relation for Germany

[Michele Simionato (@micheles)]

  • Used floats for the the GSIM realization weights, not Python Decimals
  • Added a flag fast_sampling, by default False
  • Added an API /extract/src_loss_table/<loss_type>
  • Removed the rupture filtering from sample_ruptures and optimized it in
    the RuptureGetter by making use of the bounding box
  • Raised the limit on ses_per_logic_tree_path from 216 to 232;
  • Added a parameter max_num_sites to increase the number of sites accepted
    by an event based calculation up to 2 ** 32 (the default is still 2 ** 16)
  • Added a command oq compare to compare hazard curves and maps within
    calculations
  • Extended the engine to read transparently zipped source models and exposures
  • Restored the check for invalid source IDs in applyToSources
  • Extended the command oq zip to zip source models and exposures
  • Parallelized the associations event ID -> realization ID
  • Improved the message when assets are discarded in scenario calculations
  • Implemented aggregation by multiple tags, plus a special case for the
    country code in event based risk

[Marco Pagani (@mmpagani)]

  • Added two modified versions of the Bindi et al. (2011) to be used in a
    backbone approach to compute hazard in Italy
  • Added a modified version of Berge-Thierry et al. 2003 supporting Mw

[Michele Simionato (@micheles)]

  • Changed the way loss curves and loss maps are stored in order to unify
    the aggregation logic with the one used for the average losses
  • Now it is possible to compute the ruptures without specifying the sites
  • Added an early check for the case of missing intensity measure types
  • Deprecated the case of exposure, site model and region_grid_spacing all
    set at the same time
  • Implemented multi-exposure functionality in event based risk
  • Changed the event based calculator to store the ruptures incrementally
    without keeping them all in memory
  • Refactored the UCERF event based calculator to work as much as possible
    the regular calculator
  • Optimized the management and storage of the aggregate losses in the event
    based risk calculation; also, reduced the memory consumption
  • Changed the default for individual_curves to "false", which is the right
    default for large calculations
  • Optimized the saving of the events
  • Removed the save_ruptures flag in the job.ini since ruptures must be saved
    always
  • Optimized the rupture generation in case of sampling and changed the
    algorithm and seeds
  • Fixed a bug with the IMT SA(1) considered different from SA(1.0)
  • Removed the long-time deprecated GMF exporter in XML format for event_based
  • Added a re-use hazard feature in event_based_risk in single-file mode
  • Made the event ID unique also in scenario calculations with
    multiple realizations
  • Removed the annoying hidden .zip archives littering the export directory
  • Added an easy way to read the exposure header
  • Added a way to run Python scripts using the engine libraries via oq shell
  • Improved the minimum_magnitude feature
  • Fixed the check on missing hazard IMTs
  • Reduced substantially the memory occupation in event based risk
  • Added the option spatial_correlation=no correlation for risk calculations
    from ShakeMaps
  • Removed the experimental calculator ucerf_risk
  • Optimized the sampling of time-independent sources for the case of
    prefilter_sources=no
  • Changed the algorithm associating events to SESs and made the event based
    hazard calculator faster in the case of many SESs
  • Reduced substantially the memory consumption in event based risk
  • Made it possible to read multiple site model files in the same calculation
  • Implemented a smart single job.ini file mode for event based risk
  • Now warnings for invalid parameters are logged in the database too
  • Fixed oq export avg_losses-stats for the case of one realization
  • Added oq export losses_by_tag and oq export curves_by_tag
  • Extended oq export to work in a multi-user situation
  • Forbidden event based calculations with more than max_potential_paths
    in the case of full enumeration
  • Saved a large amount of memory in event_based_risk calculations
  • Added a command oq export losses_by_tag/<tagname> <calc_id>
  • Extended oq zip to zip the risk files together with the hazard files
  • Changed the building convention for the event IDs and made them unique
    in the event loss table, even in the case of full enumeration
  • Optimized the splitting of complex fault sources
  • Fixed the ShakeMap download procedure for uncertainty.zip archives
    with an incorrect structure (for instance for ci3031111)
  • Disabled the spatial correlation in risk-from-ShakeMap by default
  • Optimized the rupture sampling where there is a large number of SESs
  • Extended the reqv feature to multiple tectonic region types and
    removed the spinning/floating for the TRTs using the feature
  • Reduced the GMPE logic tree upfront for TRTs missing in the source model
  • Fixed the ShakeMap downloader to use the USGS GeoJSON feed
  • Improved the error message when there are more than 65536 distinct tags
    in the exposure
  • Turned vs30measured into an optional parameter

[Chris Van Houtte (@cvanhoutte)]

  • Added siteclass as a site parameter, and reference_site_class as
    a site parameter than can be specified by the user in the ini file
  • Added new classes to mcverry_2006.py to take siteclass as a predictor
  • Updated comments in mcverry_2006.py
  • Added new mcverry_2006 test tables to account for difference in site
    parameter
  • Added qa_test_data classical case_32

[Michele Simionato (@micheles)]

  • Fixed the rupture exporter for Canada
  • Extended the oq prepare_site_model to optionally generate the
    fields z1pt0, z2pt5 and vs30measured
  • It is now an error to specify both the sites and the site model in the
    job.ini, to avoid confusion with the precedency
  • Implemented a reader for site models in CSV format
  • Made the export_dir relative to the input directory
  • Better error message for ShakeMaps with zero stddev
  • Added a source_id-filtering feature in the job.ini
  • Added a check on non-homogeneous tectonic region types in a source group
  • Fixed the option oq engine --config-file that broke a few releases ago
  • Replaced nodal_dist_collapsing_distance and
    hypo_dist_collapsing_distance with pointsource_distance and made
    use of them in the classical and event based calculators

[Graeme Weatherill (@g-weatherill)]

  • Fixes to hmtk completeness tables for consistent rates and addition of
    more special methods to catalogue

[Michele Simionato (@micheles)]

  • Restricted ChiouYoungs2008SWISS01 to StdDev.TOTAL to avoid a bug
    when computing the GMFs with inter/intra stddevs
  • Raised an error if assets are discarded because too far from the hazard
    sites (before it was just a warning)
  • Added an attribute .srcidx to every event based rupture and stored it
  • Fixed an issue with the Byte Order Mark (BOM) for CSV exposures prepared
    with Microsoft Excel
  • Reduced the site collection instead of just filtering it; this fixes
    a source filtering bug and changes the numbers in case of GMF-correlation
  • Added a command oq prepare_site_model to prepare a sites.csv file
    containing the vs30 and changed the engine to use it
  • Added a cutoff when storing a PoE=1 from a CSV file, thus avoiding NaNs
    in classical_damage calculations
  • Reduced the data transfer in the risk model by only considering the
    taxonomies relevant for the exposure
  • Extended oq engine --run to accept a list of files
  • Optimized the saving of the risk results in event based in the case of
    many sites and changed the command oq show portfolio_loss to show
    mean and standard deviation of the portfolio loss for each loss type

[Marco Pagani (@mmpagani)]

  • Added a first and preliminary version of the GMM for the Canada model
    represented in an analytical form.
  • Added a modified version of Atkinson and Macias to be used for the
    calculation of hazard in NSHMP2014.
  • Added support for PGA to the Si and Midorikawa (1999).

[Michele Simionato (@micheles)]

  • Made it possible to run the risk over an hazard calculation of another user
  • Worked around the OverflowError: cannot serialize a bytes object larger
    than 4 GiB in event based calculations
  • Started using Python 3.6 features
  • Fixed the check on vulnerability function ID uniqueness for NRML 0.5
  • Ruptures and GMFs are now computed concurrently, thus mitigating the
    issue of slow tasks
  • Changed the name of the files containing the disaggregation outputs:
    instead of longitude and latitude they contain the site ID now
  • If a worker runs close to out of memory, now a warning appears in the
    main log
  • 'lons' and 'lats' are now spelled 'lon' and 'lat' in
    the REQUIRES_SITES_PARAMETERS to be consistent with site_model.xml

[Daniele Viganò (@daniviga)]

  • Fixed a bug about 'The openquake master lost its controlling terminal'
    when running with 'nohup' from command line

[Michele Simionato (@micheles)]

  • The export_dir is now created recursively, i.e. subdirectories are
    automatically created if needed
  • Fixed a bug with the minimum_magnitude feature and extended it to be
    tectonic region type dependent
  • Changed the rupture generation to yield bunches of ruptures, thus avoiding
    the 4GB pickle limit
  • Parallelized the splitting of the sources, thus making the preprocessing
    faster

[Marco Pagani (@mmpagani)]

  • Implemented two additional versions of the Silva et al. 2002 GMPE
  • Added the possibility of setting rake to 'undefined'
  • Added first 'modified GMPE' implementing the site term for Canada 2015 model
  • Fixed a bug in the disaggregation calculation due to wrong binning of magnitudes

[Michele Simionato (@micheles)]

  • Now the combination uniform_hazard_spectra=true and mean_hazard_curves=false
    is accepted again, as requested by Laurentiu Danciu (@danciul)

[Daniele Viganò (@daniviga)]

  • Support for Ubuntu Trusty is removed
  • Replaced supervisord with systemd in Ubuntu packages

[Michele Simionato (@micheles)]

  • Changed the way the rupture geometries are stored to be consistent with
    the source geometries
  • We are now saving information about the source geometries in the datastore
    (experimentally)
  • Fixed a bug in event based with sampling causing incorrect GMFs
  • Unified all distribution mechanisms to returns the outputs via zmq
  • Added a check for inconsistent IMTs between hazard and risk
  • Replaced the forking processpool with a spawning processpool