Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure quality checking is run by make test #1970

Closed
matentzn opened this issue Jul 22, 2021 · 7 comments
Closed

Ensure quality checking is run by make test #1970

matentzn opened this issue Jul 22, 2021 · 7 comments
Assignees

Comments

@matentzn
Copy link
Contributor

Too many quality checks are not being run by GitHub actions..
See #1968

Need to re-instate.

@matentzn
Copy link
Contributor Author

Right now very few checks are being run compared to the original Uberon QC pipeline (which can run because of resource limitations). We need to identify a minimum number of critical tests to be run.

  • We just re-introduced cycle checking on basic, for example

These make goals are being run for now:

  • `odkversion'.
  • `sparql_test'.
  • `reports/uberon-edit.obo-obo-report.tsv'. (no fail setting!)
  • `tmp/GO.xrf_abbs'.
  • `reports/uberon-edit.obo-gocheck'.
  • `reports/uberon-edit.obo-iconv'.
  • `bridge/uberon-bridge-to-bfo.owl'.
  • `tmp/unreasoned.owl'.
  • `tmp/materialized.owl'.
  • `ext.owl'.
  • `basic.owl'.
  • `reports/basic-allcycles'.

@github-actions
Copy link

This issue has not seen any activity in the past 6 months; it will be closed automatically in one year from now if no action is taken.

@github-actions github-actions bot added the Stale label Jan 20, 2022
@matentzn
Copy link
Contributor Author

Needs to be done by the next master of Uberon pipeline.. Still important.

@matentzn matentzn removed the Stale label Jan 20, 2022
@github-actions
Copy link

This issue has not seen any activity in the past 6 months; it will be closed automatically one year from now if no action is taken.

@github-actions github-actions bot added the Stale label Feb 12, 2023
@uberon
Copy link

uberon commented Feb 13, 2023 via email

@matentzn matentzn removed the Stale label Feb 13, 2023
@matentzn matentzn assigned anitacaron and unassigned cmungall, dosumis and matentzn Feb 13, 2023
@github-actions
Copy link

This issue has not seen any activity in the past 6 months; it will be closed automatically one year from now if no action is taken.

@github-actions github-actions bot added the Stale label Sep 16, 2023
@gouttegd
Copy link
Collaborator

FYI, since the overhaul of the custom Makefile (#3028), it’s very easy to see and change the list of tests that are being run by each command.

All test suites are defined near the top of the custom Makefile, in the “TESTS/QC” section:

# ----------------------------------------
# TESTS/QC
# ----------------------------------------
# This section defines the composition of the test suites (i.e., which
# checks are performed). The checks themselves are defined elsewhere in
# this Makefile (mostly in the REPORTS section further below).

# This target is invoked as part of the automated CI workflow.
# To include a specific check/report in the CI workflow, add it
# to the pre-requisites here.
test: $(REPORTDIR)/uberon-basic-allcycles \
	$(REPORTDIR)/bfo-check.txt \
	$(REPORTDIR)/taxon-constraint-check.txt \
	$(REPORTDIR)/uberon-edit-xp-check \
	obocheck \
	test_obo_serialisation \
	test_obsolete \
	test_owlaxioms

# The other targets are manually triggered.
# 'checks' is a subset of 'uberon-qc'.
checks: $(REPORTDIR)/bfo-check.txt \
	$(REPORTDIR)/uberon-edit-obscheck.txt \
	$(REPORTDIR)/uberon-edit-xp-check \
	$(REPORTDIR)/uberon-obscheck.txt \
	$(REPORTDIR)/uberon-orphans \
	$(REPORTDIR)/uberon.obo-OWL-check

uberon-qc: checks \
	quick-bridge-checks \
	bridge-checks \
	extra-full-bridge-checks \
	$(REPORTDIR)/uberon-basic-allcycles \
	$(REPORTDIR)/basic-orphans \
	$(REPORTDIR)/composite-metazoan-dv.txt \
	$(REPORTDIR)/taxon-constraint-check.txt \
	$(REPORTDIR)/uberon-dv.txt \
	$(REPORTDIR)/uberon-orphans \
	$(REPORTDIR)/stages
	cat $(REPORTDIR)/uberon-orphans \
		$(REPORTDIR)/uberon-edit-obscheck.txt \
		$(REPORTDIR)/uberon-edit-xp-check \
		$(REPORTDIR)/uberon-orphans \
		$(REPORTDIR)/uberon-dv.txt \
		$(REPORTDIR)/composite-metazoan-dv.txt

quick-qc: $(REPORTDIR)/uberon-edit-obscheck.txt
	cat $(REPORTDIR)/uberon-edit-obscheck.txt

As explained in the comments, the test target is the one invoked by the Github Action-based CI. If more tests should always be run automatically as part of the GA-based CI, one simply needs to add them to that target.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

6 participants