Skip to content

Commit

Permalink
small fixes and rebuild
Browse files Browse the repository at this point in the history
  • Loading branch information
daaronr committed Jul 27, 2023
1 parent 1e9dc96 commit 8a73955
Show file tree
Hide file tree
Showing 14 changed files with 729 additions and 720 deletions.
4 changes: 2 additions & 2 deletions _freeze/chapters/evaluation_data/execute-results/html.json

Large diffs are not rendered by default.

Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified _freeze/chapters/evaluation_data/figure-html/unnamed-chunk-20-1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion _quarto.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ project:

book:
title: "The Unjournal evaluations: data and analysis"
author: "David Reinstein and the TUnjournal team"
author: "David Reinstein and the Unjournal team"
repo-url: https://github.com/daaronr/unjournaldata/
repo-actions: [edit, issue]
chapters:
Expand Down
21 changes: 11 additions & 10 deletions chapters/evaluation_data.qmd
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
# Evaluation data: description, exploration, checks

## Data input, cleaning, feature construction and imputation

```{r, warning=FALSE}
#| label: load-packages
#| code-summary: "load packages"
Expand Down Expand Up @@ -190,7 +192,7 @@ labels <- str_to_title(labels)

### Reconcile uncertainty ratings and CIs {-}

Where people gave only confidence level 'dots', we impute CIs (confidence/credible intervals). We follow the correspondence described [here](https://effective-giving-marketing.gitbook.io/unjournal-x-ea-and-global-priorities-research/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#1-5-dots-explanation-and-relation-to-cis). (Otherwise where they gave actual CIs, we use these.)^[Note this is only a first-pass; a more sophisticated approach may be warranted in future.]
Where people gave only confidence level 'dots', we impute CIs (confidence/credible intervals). We follow the correspondence described [here](https://effective-giving-marketing.gitbook.io/unjournal-x-ea-and-global-priorities-research/policies-projects-evaluation-workflow/evaluation/guidelines-for-evaluators#1-5-dots-explanation-and-relation-to-cis). (Otherwise, where they gave actual CIs, we use these.)^[Note this is only a first-pass; a more sophisticated approach may be warranted in future.]

::: {.callout-note collapse="true"}
## Dots to interval choices
Expand Down Expand Up @@ -288,17 +290,18 @@ evals_pub %>% write_csv(file = here("data", "evals.csv"))
```


# Basic presentation
## Basic presentation

## What sorts of papers/projects are we considering and evaluating?
### What sorts of papers/projects are we considering and evaluating?

In this section, we give some simple data summaries and visualizations, for a broad description of The Unjournal's coverage.

In the interactive tables below we give some key attributes of the papers and the evaluators, and a preview of the evaluations.
In the interactive table below we give some key attributes of the papers and the evaluators.


::: column-body-outset

<!-- Todo: make this smaller, get it to fit on the page better, more user-friendly -->

```{r }
#| label: datatable0
Expand All @@ -323,7 +326,7 @@ In the interactive tables below we give some key attributes of the papers and th

\

Next, the 'middle ratings and predictions'.
Next, a preview of the evaluations, focusing on the 'middle ratings and predictions':

```{r }
#| label: datatable
Expand Down Expand Up @@ -377,7 +380,7 @@ Next, the 'middle ratings and predictions'.

:::

The funnel plot below starts with the paper we prioritized for likely Unjournal evaluation, marking these as 'considering'.
The funnel plot below starts with the papers we prioritized for likely *Unjournal* evaluation:^(Those marked as 'considering' in the Airtable).

```{r}
Expand Down Expand Up @@ -408,7 +411,7 @@ fig <- plot_ly(
orientation = "h",
node = list(
label = c("Prioritized", "Evaluating(ed)", "Complete", "In progress", "Still in consideration", "De-prioritized"),
label = c("Prioritized", "Evaluating", "Complete", "In progress", "Still in consideration", "De-prioritized"),
color = c("orange", "green", "green", "orange", "orange", "red"),
#Todo: adjust 'location' to group these left to right
pad = 15,
Expand Down Expand Up @@ -442,7 +445,7 @@ fig
```


(In future, will make interactive/dashboards of the elements below)
Todo: ^[Make interactive/dashboards of the elements below]

```{r}
Expand Down Expand Up @@ -471,8 +474,6 @@ ggplot(summary_df, aes(x = cat_1, y = count)) +
```{r}
# Bar plot
ggplot(evals_pub, aes(x = source_main_wrapped)) +
geom_bar(position = "stack", stat = "count") +
Expand Down
Binary file modified data/evals.Rdata
Binary file not shown.
2 changes: 1 addition & 1 deletion data/evals.csv
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ policy-database-
recf9O8DFGO98TPWk,"Mental Health Therapy as a Core Strategy for Increasing Human Capital: Evidence from Ghana (renamed ""Cognitive Behavioral Therapy among Ghana's Rural Poor Is Effective Regardless of Baseline Mental Distress"")","CBT Human K, Ghana",Anonymous_11,NA,NA,NA,internal-NBER,Emailed,75,70,84,NA,60,55,65,NA,90,82,94,NA,70,62,82,NA,50,48,52,NA,50,40,60,NA,4,NA,NA,4,90,NA,80,95,4,NA,NA,4,"internal-NBER-
",70,84,55,65,82,94,62,82,48,52,40,60,80,95,3,5,3,5
recifgZ3CxEQaz3m4,"""The Environmental Effects of Economic Production: Evidence from Ecological Observations
(previous title: Economic Production and Biodiversity in the United States)""",Env. fx of prod.: ecological obs,Anonymous_12,NA,NA,NA,internal-NBER,Agreed,70,NA,NA,3,70,NA,NA,3,70,NA,NA,3,75,NA,NA,4,60,NA,NA,3,80,NA,NA,4,4,NA,NA,3,65,2,NA,NA,4,NA,NA,5,"internal-NBER-
(previous title: Economic Production and Biodiversity in the United States)""`",Env. fx of prod.: ecological obs,Anonymous_12,NA,NA,NA,internal-NBER,Agreed,70,NA,NA,3,70,NA,NA,3,70,NA,NA,3,75,NA,NA,4,60,NA,NA,3,80,NA,NA,4,4,NA,NA,3,65,2,NA,NA,4,NA,NA,5,"internal-NBER-
",59.5,80.5,59.5,80.5,59.5,80.5,56.25,93.75,51,69,60,100,59.8,70.2,3.4,4.6,2.5,5.5
reck0WYhoffiyWRGH,The Comparative Impact of Cash Transfers and a Psychotherapy Program on Psychological and Economic Well-being,Well-being: Cash vs. psychotherapy,Anonymous_13,GH&D,NA,NA,internal-NBER,Acknowledged,90,NA,NA,3,90,NA,NA,2,90,NA,NA,3,80,NA,NA,4,100,NA,NA,5,100,NA,NA,5,4,NA,NA,3,70,5,NA,NA,5,NA,NA,5,"internal-NBER-
",76.5,100,82.8,97.2,76.5,100,60,100,62.5,100,62.5,100,43.75,96.25,3.4,4.6,3.125,6.875
Expand Down
Loading

0 comments on commit 8a73955

Please sign in to comment.