Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

58 refactor re id tools ingest records to not use deprecated v1workflowsactivities endpoint #59

Conversation

mbthornton-lbl
Copy link
Contributor

This PR provides validate_record and submit_record methods on the NmdcRuntimeUserApi client, and updates the ingest-records command to use them

This PR can also close #56

The delete-old-records code already does this:

    for record in old_db_records:
        for set_name, object_record in record.items():
            if set_name == "omics_processing_set":
                continue

Copy link
Contributor

@aclum aclum left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We discussed during 1x1 but the json:submit endpoint is not working on napa. For testing we'll use Eric's wrapper to validate with json:validate and submit w/pymongo directly.

…nsert_many

Successfully tested on my local system - still need MongoDB uri/credentials for Napa DB instance
Copy link

@Michal-Babins Michal-Babins left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added validate record against json:validate endpoint. Added submit record against json:submit endpoint. Use pymongo directly for ingest.

@mbthornton-lbl mbthornton-lbl merged commit 5758c6c into main Feb 15, 2024
1 check passed
@mbthornton-lbl mbthornton-lbl deleted the 58-refactor-re_id_tools-ingest-records-to-not-use-deprecated-v1workflowsactivities-endpoint branch February 15, 2024 21:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants