Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Set up compatibility test workflow #35

Merged
merged 10 commits into from
Apr 11, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
48 changes: 48 additions & 0 deletions .github/workflows/compatibility-test.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
name: compatibility tests

on:
workflow_dispatch:

jobs:
Compatibility-test:
runs-on: ubuntu-latest

steps:
- name: Checkout
uses: actions/checkout@v4

- name: Rename files
working-directory: ./dev
run: |
cp template.env .env
cp local_nb_nodes.template.json local_nb_nodes.json
sed -i 's/latest/nightly/g' .env

- name: Run docker compose
working-directory: ./dev
run: |
docker compose --profile full_stack up -d

- name: Set up node env
uses: actions/setup-node@v4
with:
node-version: 20

- name: Install cypress
run: npm install

- name: wait for graph set up
working-directory: ./dev
run: |
while ! tail -n 0 -f ./DEPLOY.log | grep -q "Finished setting up the Neurobagel graph backend."; do
:
done
echo "Finished setting up the Neurobagel graph backend."
rmanaem marked this conversation as resolved.
Show resolved Hide resolved

- name: Run end to end tests
uses: cypress-io/github-action@v6
with:
wait-on: http://localhost:3000
component: false


149 changes: 148 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -158,4 +158,151 @@ local_nb_nodes.json
cython_debug/

# Keep jetbrains config files out of the repo
.idea/
.idea/


### Cypress ###
cypress/results/*
cypress/reports/*
cypress/screenshots/*
cypress/videos/*

### Node ###
# Logs
logs
*.log
npm-debug.log*
yarn-debug.log*
yarn-error.log*
lerna-debug.log*
.pnpm-debug.log*

# Diagnostic reports (https://nodejs.org/api/report.html)
report.[0-9]*.[0-9]*.[0-9]*.[0-9]*.json

# Runtime data
pids
*.pid
*.seed
*.pid.lock

# Directory for instrumented libs generated by jscoverage/JSCover
lib-cov

# Coverage directory used by tools like istanbul
coverage
*.lcov

# nyc test coverage
.nyc_output

# Grunt intermediate storage (https://gruntjs.com/creating-plugins#storing-task-files)
.grunt

# Bower dependency directory (https://bower.io/)
bower_components

# node-waf configuration
.lock-wscript

# Compiled binary addons (https://nodejs.org/api/addons.html)
build/Release

# Dependency directories
node_modules/
jspm_packages/

# Snowpack dependency directory (https://snowpack.dev/)
web_modules/

# TypeScript cache
*.tsbuildinfo

# Optional npm cache directory
.npm

# Optional eslint cache
.eslintcache

# Optional stylelint cache
.stylelintcache

# Microbundle cache
.rpt2_cache/
.rts2_cache_cjs/
.rts2_cache_es/
.rts2_cache_umd/

# Optional REPL history
.node_repl_history

# Output of 'npm pack'
*.tgz

# Yarn Integrity file
.yarn-integrity

# dotenv environment variable files
.env
.env.development.local
.env.test.local
.env.production.local
.env.local

# parcel-bundler cache (https://parceljs.org/)
.cache
.parcel-cache

# Next.js build output
.next
out

# Nuxt.js build / generate output
.nuxt
dist

# Gatsby files
.cache/
# Comment in the public line in if your project uses Gatsby and not Next.js
# https://nextjs.org/blog/next-9-1#public-directory-support
# public

# vuepress build output
.vuepress/dist

# vuepress v2.x temp and cache directory
.temp

# Docusaurus cache and generated files
.docusaurus

# Serverless directories
.serverless/

# FuseBox cache
.fusebox/

# DynamoDB Local files
.dynamodb/

# TernJS port file
.tern-port

# Stores VSCode versions used for testing VSCode extensions
.vscode-test

# yarn v2
.yarn/cache
.yarn/unplugged
.yarn/build-state.yml
.yarn/install-state.gz
.pnp.*

### Node Patch ###
# Serverless Webpack directories
.webpack/

# Optional stylelint cache

# SvelteKit build / generate output
.svelte-kit
10 changes: 10 additions & 0 deletions cypress.config.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
const { defineConfig } = require("cypress");

module.exports = defineConfig({
e2e: {
experimentalStudio: true,
setupNodeEvents(on, config) {
// implement node event listeners here
},
},
});
25 changes: 25 additions & 0 deletions cypress/e2e/simple-test.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
describe('Full stack e2e', () => {
it('Query tool', () => {
cy.visit('http://localhost:3000/')
cy.get('[data-cy="Neurobagel graph-categorical-field"]').type(
'local graph 1{downarrow}{enter}'
);
cy.get('[data-cy="submit-query-button"]').click();
cy.get('[data-cy="result-container"]').contains("from Local graph 1",{matchCase: false});
})
it('API', () => {
cy.request("localhost:8000/query/").as("query");
cy.get("@query").should((response) => {
expect(response.status).to.eq(200);
});
});
it("Federation API", () => {
cy.request("localhost:8000/query/?node=local graph 1").as("query");
cy.get("@query").should((response) => {
expect(response.status).to.eq(200);
});
})
it("CLI", () => {
cy.exec("docker run --rm neurobagel/bagelcli --help").its("stdout").should("contain", "Usage: bagel");
});
})
25 changes: 25 additions & 0 deletions cypress/support/commands.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
// ***********************************************
// This example commands.js shows you how to
// create various custom commands and overwrite
// existing commands.
//
// For more comprehensive examples of custom
// commands please read more here:
// https://on.cypress.io/custom-commands
// ***********************************************
//
//
// -- This is a parent command --
// Cypress.Commands.add('login', (email, password) => { ... })
//
//
// -- This is a child command --
// Cypress.Commands.add('drag', { prevSubject: 'element'}, (subject, options) => { ... })
//
//
// -- This is a dual command --
// Cypress.Commands.add('dismiss', { prevSubject: 'optional'}, (subject, options) => { ... })
//
//
// -- This will overwrite an existing command --
// Cypress.Commands.overwrite('visit', (originalFn, url, options) => { ... })
20 changes: 20 additions & 0 deletions cypress/support/e2e.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
// ***********************************************************
// This example support/e2e.js is processed and
// loaded automatically before your test files.
//
// This is a great place to put global configuration and
// behavior that modifies Cypress.
//
// You can change the location of this file or turn off
// automatically serving support files with the
// 'supportFile' configuration option.
//
// You can read more here:
// https://on.cypress.io/configuration
// ***********************************************************

// Import commands.js using ES2015 syntax:
import './commands'

// Alternatively you can use CommonJS syntax:
// require('./commands')
Loading