Changes:
- Diagnostics explorer Shiny app enhancements:
- Improved tool tip
- Various improvements to plots for consistent color, axis labels and labels
- Visit context table addition
- Diagnostic explorer is now a distinct shiny application from phenotype library. PhenotypeExplorer is a stand alone shiny app in package PhenotypeLibrarian.
- Lot of UX changes. Reactivity deferred on drop down menus.
- Changes to improve app stability.
-
Index event breakdown now has subject count
-
Index event breakdown calculates _source_concept_id from source fields in CDM tables.
-
Vocabulary database schema is now supported.
-
Metadata (vocabulary version information from data source) is now collected.
-
OracleTempSchema use deprecated in favor of tempEmulationSchema.
-
Run against external concept count has been removed, as concept counts data is not available. Function 'runCohortDiagnosticsUsingExternalCounts' is removed.
-
Removed code related to referentConceptId = phenotypeId/1000 as it does not always hold true.
-
Create cohort table function is now private. Please use instantiate cohort.
-
checkInputFileEncoding is not exported as a public function (as not the scope of CohortDiagnostics).
-
Updated results data model to include new tables (resolved_concepts).
-
Cohort Diagnostics results data model now compliant with standard characterization output.
-
Support for cohort_censor_stats table in webapi 2.8.1 #387
-
Add time series diagnostics computation. Output is not in Diagnostics explorer in this version.
-
Any improvements to help with usability and stability. Informative messages to help with debugbing as needed.
-
phenotypeDescription is no longer supported as input for cohort diagnostics. Bug fixes:
-
databaseName and databaseDescription should be non NULL
-
Fixed computation of standard deviation and standard difference of mean for binary covariates.
Changes:
-
Many improvements in performance when computing diagnostics. Now allows computation of diagnostics for many (>100) cohorts at once.
-
The Diagnostics Explorer Shiny app can now also run against results data in a database. Added functions for uploading the diagnostics data to a database. This becomes necessary when dealing with very large data (e.g. more than 100 cohort definitions).
-
Added ability to group cohort definitions by phenotypes, and add descriptions of phenotypes. Currently the only consequence of grouping by phenotype is that cohort overlap is only computed within a phenotype. Grouping by phenotypes is done by adding a
phenotypeId
field to thecohortsToCreate
file, and by adding aphenotypeDescription
file. See theexamplePhenotypeLibraryPackage
in the repo for an example. -
The cohort overlap plot now uses stacked bar charts instead of a Venn diagram to allow showing multiple comparisons across multiple databases at once.
-
The cohort characteristics comparison plot now colors by domain, and allows filtering by domain.
-
Switching from 'plotly' to 'ggiraph' for interactive plotting.
-
Added a Visit Context diagnostic.
Bug fixes:
- Fixing numerous bugs introduced in v1.2.x.
Bug fixes:
- Additional bug fixes for characterization/temporal characterization.
Bug fixes:
- Additional bug fixes for characterization/temporal characterization.
Bug fixes:
- Added details log when characterization/temporal characterization does not return results or returns result below threshold value. By default we filter out results in from Characterization and Temporal Characterization where the value is less than 0.001. This was leading to empty results for some cohorts - causing errors.
Bug fixes:
- Fixed error when many concept sets have to be instantiated.
- Removed ohdsi/SqlRender from Remotes OHDSI#189
- Fixed Digit precision for RJSONIO::toJson and fromJSON OHDSI#161 This is an important fix. If digit precision is not explicitly specified in RJSONIO, then scientific notation is used. This issue seems to only happen when an integer id (conceptId, conceptSetId, cohortId etc) >= 10,000,000 (which is rare). Please use this update if you have id's > 10,000,000.
New features:
- Minor UI changes to Diagnostics explorer. Added missing sort.
- Added better labels for plots.
- Download plots.
Bug fixes:
- Changes dependency to ROhdsiWebApi (>= 1.1.0)
- DiagnosticsExplorer display bug fixes
New features:
- All objects in DiagnosticsExplorer are sorted by default #173
- Multi select for concepts #199
Bug fixes:
- Ensure concept sets across cohort definitions are unique #174 (changes dependency to ROhdsiWebApi (>= 1.1.0))
Changes:
- New function to retrieve concept set json from cohort json \code{extractConceptSetsJsonFromCohortJson}
- New function to retrieve concept set sql from cohort sql \code{extractConceptSetsSqlFromCohortSql}
- DiagnosticsExplorer shiny app - DataTable now rendered using server side processing. Bug fixes and UI improvements.
- DiagnosticsExplorer shiny app - Phenotype library mode (released)
- DiagnosticsExplorer shiny app - Combine included source concepts and orphan concepts into one submenu OHDSI#129
Bug fixes:
Changes:
- Shiny app UI improvements
- Link out to Atlas and Athena from cohortId. Supports baseUrl.
- (beta - unreleased) support for Phenotype library. Shiny app will look for two additional csv files phenotypeDescription and cohortDescription that put the DiagnosticExplorer in Phenotype Library Mode. Plan to release in future version >= 1.2
- Changed default selections for temporal characterization
- Added minimum threshold value to covariate_value and temporal_covariate_value with default value = 0 (future release, we plan to make this 0.005 i.e. 0.5%)
Bug fixes:
- Minor bug fixes.
Changes:
- Added temporal characterization
- UI changes to Shiny app diagnostic explorer
Bug fixes:
- Circe-be update introduced bug in parsing concept sets in cohort definition.
- Handling of empty cohorts
Changes:
- Error handling: Use checkmate R-package to provide more informative error messages.
- Refactor runCohortDiagnostics: added new function by refactoring existing private functions. This new function get the JSON and parameterized OHDSI SQL for the cohorts for which diagnostics has been requested \code{getCohortsJsonAndSql}
Note: The code has been partially refactored to depend on tidyverse.
Changes:
-
Adapting to new ROhdsiWebApi (>= 1.0.0) interface.
-
Added log info that provides addition run time details #72
Bugfixes:
-
Fixing broken getTimeDistributions function.
-
Fixing broken instantiateCohort function.
Changes:
-
Added database information tab to Diagnostics Explorer Shiny app.
-
Using Andromeda instead of ff to store large data objects (used for characterization).
Bugfixes:
-
Fixed error when cohort definition has no concept sets.
-
Fixed error in index event breakdown when entry event contained multiple criteria for the same domain.
-
Fixed error related to tempEmulationSchema argument (needed on Oracle and BigQuery).
-
Fixed use of deprecated function, causing warnings and causing older versions of ParallelLogger to error.
Changes
- Adding option to run cohort instantiation and diagnostics incrementally, so only running those tasks that have changed since the last ru.
Changes
- Orphan and included concepts tables now show concept ID.
Bugfixes:
-
Fixed error in orphan code SQL (hard-coded database schema).
-
Fixed bug when concept counts become too big for a regular INT.
-
Fixed counts of standard concepts shown when using external concept count table.
Changes
-
Orphan code check now resolves concept sets instead of using verbatim concepts. Should include specificity.
-
Added option to use the same y-axis for all databases in incidence rate plot.
-
Added runCohortDiagnosticsUsingExternalCounts function.
-
Added option to use cohort definitions in WebAPI instead of those stored in study package.
Bugfixes:
-
Fixed bug causing weird false positives in orphan codes (caused by transforming concept IDs to scientific notation).
-
Better handling in viewer when some analyses are not executed.
-
Now also showing cohorts that had zero entries.
-
Fixed error when there was only 1 cohort.
Initial version