Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Moving yandex provider to new provider structure #46525

Merged
merged 2 commits into from
Feb 6, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 1 addition & 4 deletions .github/boring-cyborg.yml
Original file line number Diff line number Diff line change
Expand Up @@ -306,10 +306,7 @@ labelPRBasedOnFilePath:
- providers/weaviate/**

provider:yandex:
- providers/src/airflow/providers/yandex/**/*
- docs/apache-airflow-providers-yandex/**/*
- providers/tests/yandex/**/*
- providers/tests/system/yandex/**/*
- providers/yandex/**

provider:ydb:
- providers/ydb/**
Expand Down
11 changes: 3 additions & 8 deletions Dockerfile.ci
Original file line number Diff line number Diff line change
Expand Up @@ -930,17 +930,12 @@ function check_boto_upgrade() {
echo
echo "${COLOR_BLUE}Upgrading boto3, botocore to latest version to run Amazon tests with them${COLOR_RESET}"
echo
# shellcheck disable=SC2086
${PACKAGING_TOOL_CMD} uninstall ${EXTRA_UNINSTALL_FLAGS} aiobotocore s3fs yandexcloud opensearch-py || true
# We need to include few dependencies to pass pip check with other dependencies:
# * oss2 as dependency as otherwise jmespath will be bumped (sync with alibaba provider)
# * cryptography is kept for snowflake-connector-python limitation (sync with snowflake provider)
set -x
# shellcheck disable=SC2086
${PACKAGING_TOOL_CMD} install ${EXTRA_INSTALL_FLAGS} --upgrade boto3 botocore \
"oss2>=2.14.0" "cryptography<43.0.0" "opensearch-py"
${PACKAGING_TOOL_CMD} uninstall ${EXTRA_UNINSTALL_FLAGS} aiobotocore s3fs || true
# shellcheck disable=SC2086
${PACKAGING_TOOL_CMD} install ${EXTRA_INSTALL_FLAGS} --upgrade boto3 botocore
set +x
pip check
}

function check_downgrade_sqlalchemy() {
Expand Down
6 changes: 5 additions & 1 deletion dev/moving_providers/move_providers.py
Original file line number Diff line number Diff line change
Expand Up @@ -134,7 +134,11 @@ def _do_stuff(
if from_path.exists():
shutil.move(from_path, to_path)
console.print(f"\n[yellow]Moved {from_path} -> {to_path}\n")
if remove_empty_parent_dir and len([path for path in from_path.parent.iterdir()]) == 0:
if (
remove_empty_parent_dir
and from_path.exists()
and len([path for path in from_path.parent.iterdir()]) == 0
):
console.print(f"\n[yellow]Removed also empty parent dir {from_path.parent}\n")
from_path.parent.rmdir()
return
Expand Down
25 changes: 0 additions & 25 deletions docs/apache-airflow-providers-yandex/changelog.rst

This file was deleted.

492 changes: 0 additions & 492 deletions docs/apache-airflow-providers-yandex/commits.rst

This file was deleted.

18 changes: 0 additions & 18 deletions docs/apache-airflow-providers-yandex/configurations-ref.rst

This file was deleted.

95 changes: 0 additions & 95 deletions docs/apache-airflow-providers-yandex/connections/yandexcloud.rst

This file was deleted.

110 changes: 0 additions & 110 deletions docs/apache-airflow-providers-yandex/index.rst

This file was deleted.

This file was deleted.

37 changes: 0 additions & 37 deletions docs/apache-airflow-providers-yandex/operators/dataproc.rst

This file was deleted.

28 changes: 0 additions & 28 deletions docs/apache-airflow-providers-yandex/operators/index.rst

This file was deleted.

Loading