Skip to content

Commit

Permalink
Release 1.1.0
Browse files Browse the repository at this point in the history
Release 1.1.0
  • Loading branch information
PrinsINT authored Jun 12, 2024
2 parents c3a4dea + f7f15f7 commit 058ead6
Show file tree
Hide file tree
Showing 125 changed files with 2,302 additions and 6,558 deletions.
1 change: 1 addition & 0 deletions client/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@
<meta name="viewport" content="width=device-width,initial-scale=0.8">
<link rel="icon" href="/favicon.ico">
<link rel="stylesheet" href="/font-awesome/css/font-awesome.min.css">
<script defer="" data-domain="https://portal.clarin.ivdnt.org/galahad" src="https://statistiek.ivdnt.org/js/plausible.js"></script>
<title>GaLAHaD</title>
</head>

Expand Down
2 changes: 1 addition & 1 deletion client/src/App.vue
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@
<a href="/galahad/help" target="_blank">Help</a>
<a href="/galahad/application" target="_blank">About</a>
<a href="/galahad/contribute" target="_blank">Contribute</a>
<a href="http://lancelot.ivdnt.org" target="_blank">Lancelot</a>
<a href="https://portal.clarin.ivdnt.org/lancelot" target="_blank">LAnCeLoT</a>
</template>

</GTabs>
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added client/src/assets/help/basic-global-metrics.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added client/src/assets/help/benchmarks.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added client/src/assets/help/distribution.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added client/src/assets/help/grouped-metrics.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added client/src/assets/help/metrics-sample-lemma.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added client/src/assets/help/metrics-sample-pos.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added client/src/assets/help/pos-confusion-samples.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added client/src/assets/help/pos-confusion.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion client/src/components/help/BenchmarkSetsHelp.vue
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
<template>
Here you can see an overview of the test sets that can be used to benchmark taggers. <br />
The complete benchmark sets, including train and dev sets can be found on GitHub:
The complete benchmark sets, including training and development sets can be found on GitHub:
<ExternalLink href="https://github.com/INL/galahad-corpus-data">
galahad-corpus-data
</ExternalLink>.
Expand Down
6 changes: 3 additions & 3 deletions client/src/components/help/DifferentTagsetsHelp.vue
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
<template>
<p>
<i>
<b>*</b> When the taggers use different tagsets, the information on the accuracy of the PoS tagging below is
meaningless. Please use the PoS confusion table to get more insight into the performance of the evaluated
tagger.
<b>*</b> When the tagset used in the reference layer differs from the tagset of the hypothesis layer, the
information on the accuracy of the PoS tagging below is meaningless. If so, please use the PoS confusion
table to get more insight into the performance of the evaluated tagger.
</i>
</p>
</template>
23 changes: 12 additions & 11 deletions client/src/components/help/EvaluateHelp.vue
Original file line number Diff line number Diff line change
Expand Up @@ -2,23 +2,24 @@
<div>
<h2>Step 4: Evaluate</h2>
<p>
Inspect the tagged layers and evaluate the performance of the taggers by selecting a <GlossaryLink
gloss="hypothesis_layer">
hypothesis layer</GlossaryLink> and a <GlossaryLink gloss="reference_layer">reference layer
</GlossaryLink>.
As a reference layer, one can choose the source layer (uploaded annotations) or a version of your corpus
tagged
with a different tagger. Several aspects can be inspected: the distribution of the linguistic annotation,
accuracy metrics* and further information on the PoS confusion. You can also download these evaluations as
CSV
files.
Inspect the tagged layers and evaluate the performance of the taggers by selecting a
<ExternalLink href="/galahad/help/general#evaluation">
hypothesis layer
</ExternalLink>
and a
<ExternalLink href="/galahad/help/general#evaluation">
reference layer
</ExternalLink>.
As a reference layer, you can choose the source layer (uploaded annotations) or a version of your corpus
tagged with a different tagger. Several aspects can be inspected: the distribution of the linguistic
annotation, accuracy metrics* and further information on the Pos Confusion. You can also download these
evaluations as CSV files.
</p>
<DifferentTagsetsHelp />
</div>
</template>

<script setup lang="ts">
// Components
import { GlossaryLink } from '@/components'
import DifferentTagsetsHelp from '@/components/help/DifferentTagsetsHelp.vue'
</script>
15 changes: 5 additions & 10 deletions client/src/components/help/ExportHelp.vue
Original file line number Diff line number Diff line change
Expand Up @@ -2,22 +2,17 @@
<div>
<h2>Step 5: Export</h2>
<p>
You can export your annotated corpus in various formats. The export contains the metadata of the selected
tagger. If the chosen export format is the same as the original file format, you can choose to merge the
linguistic annotation with the uploaded source files. If you do not choose to merge, your export will not
take the original encoding into account.
First select the annotation layer you wish to export. You can export your annotated corpus in various
formats. The export contains the metadata of the selected tagger. If the chosen export format is the same as
the original file format, you can choose to merge the linguistic annotation with the uploaded source files.
If you do not choose to merge, your export will not take the original encoding into account.
</p>
<p>
You can choose not to export the PoS features, for instance <i>NOU-C</i> instead of <i>NOU-C(number=sg)</i>.
</p>
<p>
When choosing TEI P5 as export format, the LAnCeLoT annotation tool is available to manually correct the
PoS-tagging and lemmatization of your corpus.
PoS-tagging and lemmatisation of your corpus.
</p>
</div>
</template>

<script setup lang="ts">
// Components
import { GNav, ExternalLink } from '@/components'
</script>
2 changes: 1 addition & 1 deletion client/src/components/modals/ComparisonModal.vue
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ defineEmits(['hide', 'download'])
// Fields
const title = computed(() => {
if (props.samples.title) return props.samples.title
return props.samples.agreement ? 'PoS agree samples' : 'PoS confusion samples'
return props.samples.agreement ? 'PoS agree samples' : 'Pos Confusion samples'
})
const columns = computed(() => {
return [
Expand Down
2 changes: 1 addition & 1 deletion client/src/components/tables/CorpusTable.vue
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<template>
<GTable title="Corpora" helpSubject="corpora" :columns :items="displayCorpora" :loading="corporaStore.loading"
<GTable title="Corpora" :columns :items="displayCorpora" :loading="corporaStore.loading"
sortedByField="name" :sortDesc="false" :selectable="selectable" v-model="selectedCorpus"
v-if="displayCorpora.length > 0 || (type == TableCorporaType.User && !sharedWithYou)">

Expand Down
2 changes: 1 addition & 1 deletion client/src/components/tables/DocumentsTable.vue
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
<template>
<div>

<GTable helpSubject="documents" :columns :items="documentsStore.available" :loading="documentsStore.loading"
<GTable :columns :items="documentsStore.available" :loading="documentsStore.loading"
:displayOnEmpty="false" sortedByField="name" :sortDesc="false" hoverRow>
<template #title>
<span v-if="!corpus || (type == TableDocumentsType.Dataset && !corpus.dataset)">
Expand Down
2 changes: 1 addition & 1 deletion client/src/components/tables/MetricsTable.vue
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<template>
<GTable :title :columns :items :loading helpSubject="evaluate" class="metricsTable" :sortedByField :noHelp>
<GTable :title :columns :items :loading helpSubject="evaluation" class="metricsTable" :sortedByField :noHelp>

<template #help>
<slot name="help">
Expand Down
4 changes: 2 additions & 2 deletions client/src/views/annotate/subviews/evaluate/EvaluateView.vue
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
<template>
<AnnotateTab>
<!-- title-only card -->
<GCard :title="`Evaluate corpus ${corporaStore.activeCorpus?.name}`" helpSubject="evaluate">
<GCard :title="`Evaluate corpus ${corporaStore.activeCorpus?.name}`" helpSubject="evaluation">
<template #help>
<component :is="help.evaluate"></component>
</template>
Expand All @@ -26,7 +26,7 @@
{ id: 'distribution', title: 'Distribution' },
{ id: 'global_metrics', title: 'Global Metrics' },
{ id: 'grouped_metrics', title: 'Grouped Metrics' },
{ id: 'confusion', title: 'PoS confusion' }
{ id: 'confusion', title: 'Pos Confusion' }
]">
</GTabs>

Expand Down
Original file line number Diff line number Diff line change
@@ -1,11 +1,12 @@
<template>
<div>

<GTable title="Part-of-speech confusion" helpSubject="evaluate" :columns :items="rows" id="confusionTable"
<GTable title="Part-of-speech confusion" helpSubject="evaluation" :columns :items="rows" id="confusionTable"
:loading="loading" sortedByField="referenceJob" :sortDesc="false" hoverRow>
<template #help>
<p>
The table below presents an overview of the matches (in green) and mismatches per PoS when comparing
In part-of-speech confusion, an overview is given of the matches (in green) and mismatches per PoS
when comparing
the tagging of the hypothesis layer with the reference layer. Click on any frequency below to show a
data sample.
</p>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
<div class="left">
</div>
<GTable class="right" :title="'Distribution of ' + (jobSelection.hypothesisJobId || 'the hypothesis layer')"
helpSubject="evaluate" :columns :items="itemsToDisplay" :loading="distributionStore.loading"
helpSubject="evaluation" :columns :items="itemsToDisplay" :loading="distributionStore.loading"
sortedByField="count">
<template #table-empty-instruction>
<p v-if="distribution.generated">No results for current filter settings.</p>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,9 +3,10 @@
<MetricsTable title="Basic Global Metrics" :loading :columns :items="basicItems"
@download="(data) => download(data)" :downloading>
<template #help>
<p>In Global Metrics an overview is given of the (dis)agreement between the two layers that have been
selected for lemma and PoS comparison. Click on the (dis)agreement value to show a data sample.</p>

<p>
In Global Metrics an overview is given of the (dis)agreement between the two layers that have been
selected for lemma and PoS comparison. By clicking on the percentage, a data sample is shown.
</p>
</template>
</MetricsTable>

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,9 +3,11 @@
<MetricsTable title="Grouped Metrics" :loading :columns :items @download="(data) => download(data)"
:downloading>
<template #help>
<p>In PoS Metrics an overview is given of the (dis)agreement for lemma and PoS per part-of-speech. Click
on
the (dis)agreement value to show a data sample.</p>
<p>
In Grouped Metrics an overview is given of the (dis)agreement for lemma and PoS per part-of-speech.
For each PoS, different metrics are given by choosing the annotation and the grouping. By clicking
on a percentage, a data sample is shown.
</p>
</template>
<template #prepend v-if="metrics.metrics != null">
<p style="text-align: center;">
Expand Down
16 changes: 10 additions & 6 deletions client/src/views/contribute/subviews/ContributeDatasetsView.vue
Original file line number Diff line number Diff line change
@@ -1,12 +1,16 @@
<template>
<div><GCard>
<template #title>Contribute a dataset</template>
<template #help>Creating linguistic infrastructure is a lot of work. Why not do it together?</template>
<i>This is a placeholder for a written instrcution on how to provide a dataset, which should include an e-mail
adress</i>
</GCard></div>
<div>
<GCard noHelp>
<template #title>Contribute a dataset</template>
<p>
Apart from contributing new taggers to the GaLAHaD platform, you can also contribute training and
evaluation gold standard datasets you have produced. Please contact us at <MailAddress />.
</p>
</GCard>
</div>
</template>

<script setup lang='ts'>
import { GCard } from '@/components'
import MailAddress from '@/components/links/MailAddress.vue';
</script>
Loading

0 comments on commit 058ead6

Please sign in to comment.