Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

O3-2592: OCL file version bumps + update exports to match OCL standard #763

Merged
merged 14 commits into from
Nov 23, 2023

Conversation

gracepotma
Copy link
Contributor

@gracepotma gracepotma commented Nov 22, 2023

This PR accomplishes 2 things:

  1. Updates 2 dictionaries with trivial changes (a non-semantic change to Immunization Content to resolve error messages, and a simple update to Basic Lab Tests to add Missing Mappings for Serum Albumin)

  2. Fix for issue https://issues.openmrs.org/browse/O3-2592:

  • Problem Background: Multiple O3 devs like @ibacher and @samuelmale have been reporting various metadata challenges in the last ~2 months. Concepts keep appearing to be missing, when they should in fact be in the ocl config directory. I believe this ticket should fix that issue - here is what I believe the cause is:

  • Suspected Cause: OCL changed their export file naming conventions a few weeks ago discussed here

  • Testing Process: We thought maybe the issue is that some subscriptions have silent errors not being noticed since we are not using the Subscription Module UI for the usual O3 RefApp builds. So I tried manually subscribing test3 to collections we already have in the RefApp. To my surprise I noticed that all the dictionaries that have the OLD naming convention in our OCL JSON exports (in the iniz config directory) are NOT uploading upon build time. But they DO work when I use the subscription workflow. I assume this is due to the name no longer matching what is available in OCL online and causing issues with the import / parsing by the OCL Module at some point.

  • Plan: I hope that by re-downloading and updating all the old-named /ocl JSON files, this will fix the issues folks are seeing.

METADATA CHANGES SUMMARY TABLE (original is here)
<style type="text/css"></style>

Pre-existing Collection Version Version # change? Current Collection Version in PR for O3-2593 Notes
BasicDrugs_2.20230127173123.zip No openmrs_BasicDrugs_v2_autoexpand-2.2023-01-27_173123.zip  
BasicLabTests_4.20230326222632.zip Yes: 4 --> 4.1 openmrs_BasicLabTests_v4.1_autoexpand-4.1.2023-10-28_212403.zip Version 4.1 Adds Missing Mappings for Serum Albumin
CCD_7.20230228121317.zip No openmrs_CCD_v7_autoexpand-7.2023-11-18_173349.zip  
CDU_3.0.20220817051630.zip No openmrs_CDU_v3.0_autoexpand-3.0.2023-11-18_172024.zip  
CIELImmunizationContent_6.20221017140334.zip Yes: 6 --> 8 openmrs_CIELImmunizationContent_v8_autoexpand-8.2023-11-06_204059 (1).zip Version 8 has no semantic changes from Version 6; a problematic reference was removed and this has resolved the error messages
CIEL_severities.zip     Will tackle as a separate ticket. Was originally introduced by Hadijah here: #655
CLF_4.20221222133544.zip No openmrs_CLF_v4_autoexpand-4.2023-10-29_215108.zip  
DemoPrograms_2.20220817052726.zip No openmrs_DemoPrograms_v2_autoexpand-2.2023-11-18_173351.zip  
DemoQueueConcepts_2.20220301052308.zip No openmrs_DemoQueueConcepts_v2_autoexpand-2.2022-03-01_052308.zip  
GenericDemoForm_3.20220225043204.zip No openmrs_GenericDemoForm_v3_autoexpand-3.2022-02-25_043204.zip  
PD_2.20230413171729.zip No openmrs_PD_v2_autoexpand-2.2023-04-13_171729.zip  
SOAPTemplate_1.20230331074221.zip No openmrs_SOAPTemplate_v1_autoexpand-1.2023-03-31_074221.zip  
VitalSignCodes_1.20230228084421.zip No openmrs_VitalSignCodes_v1_autoexpand-1.2023-02-28_084421.zip  
procedures_5.20230405090039.zip No openmrs_procedures_v5_autoexpand-5.2023-04-05_090039.zip  
openmrs_CIELAllergySet_v4_autoexpand-4.2023-11-08_052809.zip   ZIP file name did not need to be updated  
openmrs_DrugDispense_v2_autoexpand-2.2023-07-13_181219.zip   ZIP file name did not need to be updated  

Details from issue https://issues.openmrs.org/browse/O3-2592:
* Problem Background: Multiple O3 devs like [~ibacher] and [~samuel34] have been reporting various metadata challenges in the last ~2 months. Concepts keep appearing to be missing, when they should in fact be in the ocl config directory. I believe this ticket should fix that issue - here is what I believe the cause is: 

* Suspected Cause: OCL changed their export file naming conventions a few weeks ago ([discussed here|OpenConceptLab/ocl_issues#1595])

* Testing Process: We thought maybe the issue is that some subscriptions have silent errors not being noticed since we are not using the Subscription Module UI for the usual O3 RefApp builds. So I tried manually subscribing test3 to collections that we already have in the RefApp. To my surprise I noticed that all the dictionaries that have the OLD naming convention in our OCL JSON exports (in the iniz config directory) are NOT uploading upon build time. But they DO work when I use the subscription workflow. I assume this is due to the name no longer matching what is available in OCL online and causing issues with the import / parsing by the OCL Module at some point. 

* Plan: I hope that by re-downloading and updating all the old-named /ocl JSON files, this will fix the issues folks are seeing.

*Which need updating:* 
* BasicDrugs_2.20230127173123.zip
* BasicLabTests_4.20230326222632.zip
* CCD_7.20230228121317.zip
* CDU_3.0.20220817051630.zip
* CIELImmunizationContent_6.20221017140334.zip
* CIEL_severities.zip
* CLF_4.20221222133544.zip
* DemoPrograms_2.20220817052726.zip
* DemoQueueConcepts_2.20220301052308.zip
* GenericDemoForm_3.20220225043204.zip
* PD_2.20230413171729.zip
* SOAPTemplate_1.20230331074221.zip
* VitalSignCodes_1.20230228084421.zip
* procedures_5.20230405090039.zip

Which are Okay / Have the latest Name:
* openmrs_CIELAllergySet_v4_autoexpand-4.2023-11-08_052809.zip
* openmrs_DrugDispense_v2_autoexpand-2.2023-07-13_181219.zip
@gracepotma gracepotma changed the title O3-2592: Update all OCL file names to match OCL standard O3-2592: OCL file version bumps + update exports to match OCL standard Nov 22, 2023
@gracepotma
Copy link
Contributor Author

FYI @Ruhanga and @suruchee I think this is relevant for Ozone. No action required from you, just want to make you aware. This will HOPEFULLY fix any novel metadata issues you've been seeing since ~ Aug 2023.

@gracepotma
Copy link
Contributor Author

OK so, Dennis and I weren't 100% sure how best to test this on a local, so we are going to merge it and see what happens in the dev3 dev environment. If unexpected problems arise we can roll back.

@gracepotma gracepotma merged commit 8d533a0 into main Nov 23, 2023
7 checks passed
@pirupius pirupius deleted the gracepotma-20231121-oclfilenamesupdateandversionbumps branch April 29, 2024 06:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants