Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

object output from PAGA plotting #226

Merged
merged 28 commits into from
Apr 12, 2021
Merged
Show file tree
Hide file tree
Changes from 27 commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
538f817
Bump to scanpy-scripts version with support for object output from pl…
pinin4fjords Apr 7, 2021
b657005
Output object from PAGA plotting
pinin4fjords Apr 7, 2021
3bed8f6
Reset builds to 0 due to new scanpy-scripts version
pinin4fjords Apr 7, 2021
da1092f
Add missing object params
pinin4fjords Apr 8, 2021
6f290ff
Update paga plotting tests
pinin4fjords Apr 8, 2021
64a28cc
Add citation
pinin4fjords Apr 8, 2021
772bec1
Add test file for paga plotting
pinin4fjords Apr 8, 2021
0a74fbc
Invalidate cache
pinin4fjords Apr 8, 2021
d273a7f
Invalidate cache
pinin4fjords Apr 8, 2021
014e88b
Use secrets to clear cache
pinin4fjords Apr 8, 2021
ce7382c
Revert "Use secrets to clear cache"
pinin4fjords Apr 8, 2021
daa554e
Revert "Invalidate cache"
pinin4fjords Apr 8, 2021
5faa62d
Revert "Invalidate cache"
pinin4fjords Apr 8, 2021
7fe96b8
Replace combine_outputs action step with galaxy one
pinin4fjords Apr 8, 2021
992236c
Move test step to IUC one too
pinin4fjords Apr 8, 2021
2cd3db2
Revert "Move test step to IUC one too"
pinin4fjords Apr 8, 2021
89789fc
Revert "Replace combine_outputs action step with galaxy one"
pinin4fjords Apr 8, 2021
736cc93
Switch all steps to as IUC
pinin4fjords Apr 8, 2021
71a12c4
3.7 -> 3.8
pinin4fjords Apr 8, 2021
66b3edd
setup-python
pinin4fjords Apr 8, 2021
1cbe5cf
Fix jq issue
pinin4fjords Apr 8, 2021
6114eab
jq again
pinin4fjords Apr 8, 2021
fe44fb8
Reinstate secrets-driven cache invalidation
pinin4fjords Apr 9, 2021
2cb3ad1
jq again
pinin4fjords Apr 9, 2021
d928ca5
No container testing for MNN
pinin4fjords Apr 9, 2021
510b158
Completely skip MNN test with illegal instruction error
pinin4fjords Apr 9, 2021
7ac3cf9
Comment MNN tests due to illegal instruction error
pinin4fjords Apr 12, 2021
04a4aac
Update version to reflect likely 1.7.x Scanpy install
pinin4fjords Apr 12, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
271 changes: 82 additions & 189 deletions .github/workflows/pr.yaml

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions .tt_skip
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
tools/tertiary-analysis/scanpy/scanpy-integrate-mnn.xml
2 changes: 1 addition & 1 deletion tools/tertiary-analysis/scanpy/anndata_operations.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="anndata_ops" name="AnnData Operations" version="@TOOL_VERSION@+galaxy1" profile="@PROFILE@">
<tool id="anndata_ops" name="AnnData Operations" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>modifies metadata and flags genes</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
2 changes: 1 addition & 1 deletion tools/tertiary-analysis/scanpy/scanpy-find-cluster.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_find_cluster" name="Scanpy FindCluster" version="@TOOL_VERSION@+galaxy4" profile="@PROFILE@">
<tool id="scanpy_find_cluster" name="Scanpy FindCluster" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>based on community detection on KNN graph</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
2 changes: 1 addition & 1 deletion tools/tertiary-analysis/scanpy/scanpy-find-markers.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_find_markers" name="Scanpy FindMarkers" version="@TOOL_VERSION@+galaxy4" profile="@PROFILE@">
<tool id="scanpy_find_markers" name="Scanpy FindMarkers" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>to find differentially expressed genes between groups</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
2 changes: 1 addition & 1 deletion tools/tertiary-analysis/scanpy/scanpy-integrate-bbknn.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_integrate_bbknn" name="Scanpy BBKNN" version="@TOOL_VERSION@+galaxy1" profile="@PROFILE@">
<tool id="scanpy_integrate_bbknn" name="Scanpy BBKNN" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>batch-balanced K-nearest neighbours</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
2 changes: 1 addition & 1 deletion tools/tertiary-analysis/scanpy/scanpy-integrate-combat.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_integrate_combat" name="Scanpy ComBat" version="@TOOL_VERSION@+galaxy1" profile="@PROFILE@">
<tool id="scanpy_integrate_combat" name="Scanpy ComBat" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>adjust expression for variables that might introduce batch effect</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_integrate_harmony" name="Scanpy Harmony" version="@TOOL_VERSION@+galaxy1" profile="@PROFILE@">
<tool id="scanpy_integrate_harmony" name="Scanpy Harmony" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>adjust principal components for variables that might introduce batch effect</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
6 changes: 3 additions & 3 deletions tools/tertiary-analysis/scanpy/scanpy-integrate-mnn.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_integrate_mnn" name="Scanpy MNN" version="@TOOL_VERSION@+galaxy1" profile="@PROFILE@">
<tool id="scanpy_integrate_mnn" name="Scanpy MNN" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>correct batch effects by matching mutual nearest neighbors</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down Expand Up @@ -94,7 +94,7 @@
<expand macro="output_data_obj" description="Batch-corrected for ${batch_key}"/>
</outputs>

<tests>
<!--<tests>
<test>
<param name="input_obj_file" value="find_cluster.h5"/>
<param name="input_format" value="anndata"/>
Expand All @@ -108,7 +108,7 @@
<param name="output_format" value="anndata"/>
<output name="output_h5" file="mnn_copy.h5" ftype="h5" compare="sim_size"/>
</test>
</tests>
</tests>-->

<help><![CDATA[
.. class:: infomark
Expand Down
2 changes: 1 addition & 1 deletion tools/tertiary-analysis/scanpy/scanpy-neighbours.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_compute_graph" name="Scanpy ComputeGraph" version="@TOOL_VERSION@+galaxy4" profile="@PROFILE@">
<tool id="scanpy_compute_graph" name="Scanpy ComputeGraph" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>to derive kNN graph</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<tool id="scanpy_parameter_iterator" name="Scanpy ParameterIterator" version="0.0.1+galaxy3">
<tool id="scanpy_parameter_iterator" name="Scanpy ParameterIterator" version="0.0.1+galaxy0">
<description>produce an iteration over a defined parameter</description>
<macros>
<import>scanpy_macros.xml</import>
Expand Down
11 changes: 10 additions & 1 deletion tools/tertiary-analysis/scanpy/scanpy-plot-trajectory.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_plot_trajectory" name="Scanpy PlotTrajectory" version="@TOOL_VERSION@+galaxy1" profile="@PROFILE@">
<tool id="scanpy_plot_trajectory" name="Scanpy PlotTrajectory" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>visualise cell trajectories</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down Expand Up @@ -38,12 +38,18 @@ PYTHONIOENCODING=utf-8 scanpy-cli plot paga
--edge-width-scale ${settings.edge_width}
#end if
#end if
#if str($output_format).startswith('anndata')
--show-obj stdout --output-format anndata --output-obj output.h5
#else
--show-obj stdout --output-format loom --output-obj output.h5
#end if
@INPUT_OPTS@
@PLOT_OPTS@
]]></command>

<inputs>
<expand macro="input_object_params"/>
<expand macro="output_object_params"/>
<param name="use_key" argument="--use-key" type="text" value="paga"
label="The key in `.uns` that contains trajectory information"/>
<param name="layout" argument="--layout" type="select" label="Layout functions">
Expand Down Expand Up @@ -85,14 +91,17 @@ PYTHONIOENCODING=utf-8 scanpy-cli plot paga
</inputs>

<outputs>
<expand macro="output_data_obj" description="Plotted PAGA"/>
<data name="output_png" format="png" from_work_dir="output.png" label="${tool.name} on ${on_string}: trajectory plot"/>
</outputs>

<tests>
<test>
<param name="input_obj_file" value="paga.h5"/>
<param name="input_format" value="anndata"/>
<param name="output_format" value="anndata"/>
<param name="type" value="paga_compare"/>
<output name="output_h5" file="plotted_paga.h5" ftype="h5" compare="sim_size"/>
<output name="output_png" file="paga_compare.png" ftype="png" compare="sim_size"/>
</test>
</tests>
Expand Down
2 changes: 1 addition & 1 deletion tools/tertiary-analysis/scanpy/scanpy-run-fdg.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_run_fdg" name="Scanpy RunFDG" version="@TOOL_VERSION@+galaxy1" profile="@PROFILE@">
<tool id="scanpy_run_fdg" name="Scanpy RunFDG" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>visualise cell clusters using force-directed graph</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
2 changes: 1 addition & 1 deletion tools/tertiary-analysis/scanpy/scanpy-run-pca.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_run_pca" name="Scanpy RunPCA" version="@TOOL_VERSION@+galaxy1" profile="@PROFILE@">
<tool id="scanpy_run_pca" name="Scanpy RunPCA" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>for dimensionality reduction</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
2 changes: 1 addition & 1 deletion tools/tertiary-analysis/scanpy/scanpy-run-tsne.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_run_tsne" name="Scanpy RunTSNE" version="@TOOL_VERSION@+galaxy2" profile="@PROFILE@">
<tool id="scanpy_run_tsne" name="Scanpy RunTSNE" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>visualise cell clusters using tSNE</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
2 changes: 1 addition & 1 deletion tools/tertiary-analysis/scanpy/scanpy-run-umap.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<?xml version="1.0" encoding="utf-8"?>
<tool id="scanpy_run_umap" name="Scanpy RunUMAP" version="@TOOL_VERSION@+galaxy1" profile="@PROFILE@">
<tool id="scanpy_run_umap" name="Scanpy RunUMAP" version="@TOOL_VERSION@+galaxy0" profile="@PROFILE@">
<description>visualise cell clusters using UMAP</description>
<macros>
<import>scanpy_macros2.xml</import>
Expand Down
5 changes: 3 additions & 2 deletions tools/tertiary-analysis/scanpy/scanpy_macros2.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<macros>
<token name="@TOOL_VERSION@">1.6.0</token>
<token name="@TOOL_VERSION@">1.6.1</token>
pinin4fjords marked this conversation as resolved.
Show resolved Hide resolved
<token name="@HELP@">More information can be found at https://scanpy.readthedocs.io</token>
<token name="@PROFILE@">18.01</token>
<token name="@VERSION_HISTORY@"><![CDATA[
pinin4fjords marked this conversation as resolved.
Show resolved Hide resolved
Expand Down Expand Up @@ -49,7 +49,7 @@ EMBL-EBI https://www.ebi.ac.uk/ and Teichmann Lab at Wellcome Sanger Institute.

<xml name="requirements">
<requirements>
<requirement type="package" version="0.3.2">scanpy-scripts</requirement>
<requirement type="package" version="0.3.3">scanpy-scripts</requirement>
<yield/>
</requirements>
</xml>
Expand All @@ -68,6 +68,7 @@ EMBL-EBI https://www.ebi.ac.uk/ and Teichmann Lab at Wellcome Sanger Institute.
url = {https://github.com/ebi-gene-expression-group/scanpy-scripts},
}</citation>
<citation type="doi">10.1101/2020.04.08.032698</citation>
<citation type="doi">10.1038/s41592-021-01102-w</citation>
</citations>
</xml>

Expand Down
Binary file not shown.