You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
See #FIXME tag in generate_metap_agg.py script. We should enable some pagination (once feasible) on the initial gathering of previously-aggregated workflow IDs.
Current:
"""Function to return all ids of workflow execution ids that have already been aggregated.
Uses the aggregation_filter attribute to filter the results for subclasses.
Returns
-------
list
List of workflow ids that have already been aggregated
"""
agg_col = self.get_results(
collection="functional_annotation_agg",
filter=self.aggregation_filter,
#FIXME: Using max_page_size of 0 may not work as we scale up the functional_annotation_agg collection - see issue:
# https://github.com/microbiomedata/nmdc-runtime/issues/797
max_page_size=0,
fields="was_generated_by",
)
ids = list(set([x["was_generated_by"] for x in agg_col]))
return ids
Desired:
"""Function to return all ids of workflow execution ids that have already been aggregated.
Uses the aggregation_filter attribute to filter the results for subclasses.
Returns
-------
list
List of workflow ids that have already been aggregated
"""
agg_col = self.get_results(
collection="functional_annotation_agg",
filter=self.aggregation_filter,
max_page_size=1000,
fields="was_generated_by",
)
ids = list(set([x["was_generated_by"] for x in agg_col]))
return ids
The text was updated successfully, but these errors were encountered:
Dependent on addressing microbiomedata/nmdc-runtime#797 .
See #FIXME tag in generate_metap_agg.py script. We should enable some pagination (once feasible) on the initial gathering of previously-aggregated workflow IDs.
Current:
Desired:
The text was updated successfully, but these errors were encountered: