Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bigquery - 400 No matching signature for operator BETWEEN #6809

Closed
FelipeArruda opened this issue Dec 19, 2022 · 1 comment
Closed

Bigquery - 400 No matching signature for operator BETWEEN #6809

FelipeArruda opened this issue Dec 19, 2022 · 1 comment
Assignees
Labels
bug Bug report ingestion PR or Issue related to the ingestion of metadata

Comments

@FelipeArruda
Copy link

FelipeArruda commented Dec 19, 2022

Describe the bug
When I set the parameter partition_profiling_enabled: true to true (profilling), I'm facing the following error.

To Reproduce
Set profiling.partition_profiling_enabled to true, when is false no error occur.

profiling:
            enabled: true
            profile_table_level_only: false
            include_field_sample_values: true
            profile_if_updated_since_days: null
            profile_table_size_limit: null
            profile_table_row_limit: 50000
            partition_profiling_enabled: true

Expected behavior
None

Screenshots
Log error:

          " 'gms_version': 'v0.9.3',\n"
           " 'pending_requests': '0'}\n"
           '[2022-12-19 18:48:01,253] ERROR    {datahub.entrypoints:207} - Command failed: 400 No matching signature for operator BETWEEN for '
           'argument types: TIMESTAMP, DATE, DATE. Supported signature: (ANY) BETWEEN (ANY) AND (ANY) at [7:17]\n'
           '\n'
           'Location: US\n'
           'Job ID: 6c8bb3fe-91b0-479c-8aff-eea4da00cdc3\n'
           'Traceback (most recent call last):\n'
           '  File "/tmp/datahub/ingest/venv-bigquery-0.9.3.2/lib/python3.10/site-packages/google/cloud/bigquery/dbapi/cursor.py", line 203, in '
           '_execute\n'
           '    self._query_job.result()\n'
           '  File "/tmp/datahub/ingest/venv-bigquery-0.9.3.2/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py", line 1499, in '
           'result\n'
           '    do_get_result()\n'
           '  File "/tmp/datahub/ingest/venv-bigquery-0.9.3.2/lib/python3.10/site-packages/google/api_core/retry.py", line 349, in '
           'retry_wrapped_func\n'
           '    return retry_target(\n'
           '  File "/tmp/datahub/ingest/venv-bigquery-0.9.3.2/lib/python3.10/site-packages/google/api_core/retry.py", line 191, in retry_target\n'
           '    return target()\n'
           '  File "/tmp/datahub/ingest/venv-bigquery-0.9.3.2/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py", line 1489, in '
           'do_get_result\n'
           '    super(QueryJob, self).result(retry=retry, timeout=timeout)\n'
           '  File "/tmp/datahub/ingest/venv-bigquery-0.9.3.2/lib/python3.10/site-packages/google/cloud/bigquery/job/base.py", line 728, in result\n'
           '    return super(_AsyncJob, self).result(timeout=timeout, **kwargs)\n'
           '  File "/tmp/datahub/ingest/venv-bigquery-0.9.3.2/lib/python3.10/site-packages/google/api_core/future/polling.py", line 261, in result\n'
           '    raise self._exception\n'
           'google.api_core.exceptions.BadRequest: 400 No matching signature for operator BETWEEN for argument types: TIMESTAMP, DATE, DATE. '
           'Supported signature: (ANY) BETWEEN (ANY) AND (ANY) at [7:17]\n'
           '\n'

Desktop (please complete the following information):

  • OS: GCP
  • Browser [e.g. chrome, safari]
  • Datahub version: 0.9.3

Additional context
I tried with 0.9.3.2 but still getting error when running bigquery ingestion

@FelipeArruda FelipeArruda added the bug Bug report label Dec 19, 2022
@aditya-radhakrishnan aditya-radhakrishnan added the ingestion PR or Issue related to the ingestion of metadata label Dec 19, 2022
@jjoyce0510
Copy link
Collaborator

This should have been addressed and merged 4 days ago as part of this: #6874

It will be available in the next minor release. (v0.9.5.1)

Cheers
John

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug report ingestion PR or Issue related to the ingestion of metadata
Projects
None yet
Development

No branches or pull requests

4 participants