Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(FINALLY) respond to Rose's manuscript feedback #55

Open
wants to merge 15 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions R/confidence_score_plots.R
Original file line number Diff line number Diff line change
Expand Up @@ -251,15 +251,15 @@ method_types <- function(conf_scores){
BAYES = c("BayTriVar", "BayPRIORsAgg")

conf_scores <- conf_scores %>%
dplyr::mutate(type = dplyr::case_when(method %in% NWL ~ "Non-weighted Linear Combintation",
dplyr::mutate(type = dplyr::case_when(method %in% NWL ~ "Non-weighted Linear Combination",
method %in% WLCI ~ "Weighted Linear Combinations",
#method %in% WLCE ~ "Weighted Linear Combinations (Supplementary Data)",
method %in% BAYES ~ "Bayesian Methods"))


# Levels for the plot output
conf_scores$type <- factor(conf_scores$type,
levels = c("Non-weighted Linear Combintation",
levels = c("Non-weighted Linear Combination",
"Weighted Linear Combinations",
#"Weighted Linear Combinations (Supplementary Data)",
"Bayesian Methods"))
Expand Down
57 changes: 22 additions & 35 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
README
================
# README


[![DOI](https://zenodo.org/badge/531484296.svg)](https://zenodo.org/badge/latestdoi/531484296)
[![R-CMD-check](https://github.com/metamelb-repliCATS/aggreCAT/actions/workflows/R-CMD-check.yaml/badge.svg)](https://github.com/metamelb-repliCATS/aggreCAT/actions/workflows/R-CMD-check.yaml)
Expand Down Expand Up @@ -90,6 +90,12 @@ Then load the package:
library(aggreCAT)
```

Note, if you wish to use any of the Bayesian aggregation methods,you
will need to have
[JAGS](https://sourceforge.net/projects/mcmc-jags/files/) installed.
Note that some mac users may need to install jags dependencies from
source: `install.packages("rjags",type = "source")`.

# Getting Started with `aggreCAT`

Below we provide a brief summary of the package, for a detailed
Expand Down Expand Up @@ -145,29 +151,12 @@ IDEA protocol, best estimates, and upper and lower bounds are elicited
from each participant, over two rounds. The judgement data is contained
in the object `data_ratings`, described at `?data_ratings`.

<figure>
<img src="inst/ms/images/img_IDEA_repliCATS.png" id="fig-IDEA"
style="width:100.0%" data-fig-pos="hold"
alt="Figure 1: the repliCATS IDEA protocol was used to elicit judgements about the likely replicability of research claims, a pilot version of this dataset is included in the aggreCAT package" />
<figcaption aria-hidden="true">Figure 1: the repliCATS IDEA protocol was
used to elicit judgements about the likely replicability of research
claims, a pilot version of this dataset is included in the
<code>aggreCAT</code> package</figcaption>
</figure>
<img src="inst/ms/images/img_IDEA_repliCATS.png" style="width:100.0%"
data-fig-pos="hold" />

## A minimal working example with `AverageWAgg()`

<figure>
<img src="inst/ms/images/ArMean.png" id="fig-1" style="width:100.0%"
alt="Figure 2: Mathematically aggregating a small subset of expert judgements for the claim 28, using the unweighted arithmetic mean. The aggreCAT wrapper function AverageWAgg() is used on this dataset, with the type argument set to the default ArMean." />
<figcaption aria-hidden="true">Figure 2: Mathematically aggregating a
small subset of expert judgements for the claim <code>28</code>, using
the unweighted arithmetic mean. The <code>aggreCAT</code> wrapper
function <code>AverageWAgg()</code> is used on this dataset, with the
<code>type</code> argument set to the default
<code>ArMean</code>.</figcaption>
</figure>

<img src="inst/ms/images/ArMean.png" style="width:100.0%" />
Below we demonstrate how to use the most simple commonly implemented
aggregation method `ArMean`, which takes the arithmetic mean of
participant Best Estimates. We first use a small subset of 5
Expand Down Expand Up @@ -232,7 +221,7 @@ data_ratings %>% AverageWAgg()
#> 8 ArMean 116 62.6 25
#> 9 ArMean 118 54.8 25
#> 10 ArMean 133 59.9 25
#> # … with 15 more rows
#> # 15 more rows
```

And other times, we might want to trial different aggregation methods
Expand All @@ -257,27 +246,25 @@ appropriately attributed and cited accordingly:

``` r
citation("aggreCAT")
#> To cite aggreCAT in publications use:
#>
#> To cite package 'aggreCAT' in publications use:
#>
#> Willcox A, Gray C, Gould E, Wilkinson D, Hanea A, Wintle B, E. O'Dea
#> R (????). _aggreCAT: Mathematically Aggregating Expert Judgments_. R
#> package version 0.0.0.9002,
#> <https://replicats.research.unimelb.edu.au/>.
#> Gould et al. aggreCAT: An R Package for Mathematically Aggregating
#> Expert Judgments (2023). MetArXiv
#>
#> A BibTeX entry for LaTeX users is
#>
#> @Manual{,
#> title = {aggreCAT: Mathematically Aggregating Expert Judgments},
#> author = {Aaron Willcox and Charles T. Gray and Elliot Gould and David Wilkinson and Anca Hanea and Bonnie Wintle and Rose {E. O'Dea}},
#> note = {R package version 0.0.0.9002},
#> url = {https://replicats.research.unimelb.edu.au/},
#> @Article{,
#> title = {aggreCAT: An R Package for Mathematically Aggregating Expert Judgments},
#> author = {{Gould} and {Elliot} and {Gray} and Charles T. and {Willcox} and {Aaron} and {O'Dea} and {Rose} and {Groenewgen} and {Rebecca} and {Wilkinson} and David P.},
#> journal = {MetArXiv},
#> year = {2023},
#> }
```

## References

<div id="refs" class="references csl-bib-body hanging-indent">
<div id="refs" class="references csl-bib-body hanging-indent"
entry-spacing="0">

<div id="ref-Fraser:2021" class="csl-entry">

Expand Down
2 changes: 2 additions & 0 deletions README.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,8 @@ Then load the package:
library(aggreCAT)
```

Note, if you wish to use any of the Bayesian aggregation methods,you will need to have [JAGS](https://sourceforge.net/projects/mcmc-jags/files/) installed. Note that some mac users may need to install jags dependencies from source: `install.packages("rjags",type = "source")`.

# Getting Started with `aggreCAT`

Below we provide a brief summary of the package, for a detailed overview, please consult the manuscript [@Gould2022].
Expand Down
Loading
Loading