Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Storage account crd #10

Closed
wants to merge 78 commits into from
Closed

Storage account crd #10

wants to merge 78 commits into from

Conversation

shlomitk1
Copy link
Owner

No description provided.

rohithdv and others added 30 commits August 25, 2022 15:23
@rohithdv
changed the git command to return latest stable tag (fybrik#1707)
0648cc1 
Signed-off-by: Rohith D Vallam <[email protected]>

Signed-off-by: Rohith D Vallam <[email protected]>
Co-authored-by: Rohith D Vallam <[email protected]>
@cdoron
Explanations on how to run openmetadata on kind (fybrik#1700)
fd50f43 
* Explanations on how to run openmetadata on kind

Signed-off-by: Doron Chen <[email protected]>
@roytman
increase livenessProbe.initialDelaySeconds for localstack installation (
69983ec 
fybrik#1709)

Signed-off-by: Alexey Roytman <[email protected]>
@cdoron
fix typo in 'reproducible' (fybrik#1714)
6f48b21 
Signed-off-by: Doron Chen <[email protected]>
@roytman
remove spaces after '\' (fybrik#1715)
d97245e 
Signed-off-by: Alexey Roytman <[email protected]>
@cdoron
upgrade OpenMetadata to version 0.12.0 (fybrik#1719)
dc87716 
* upgrade OpenMetadata to version 0.12.0

* add openmetadata helm repo

Signed-off-by: Doron Chen <[email protected]>
@cdoron @shlomitk1
Openmetadata connector templates (fybrik#1696)
b27d3b2 
* templates for openmetadata-connector

Signed-off-by: Doron Chen <[email protected]>
Co-authored-by: Shlomit Koyfman <[email protected]>
@revit13
Use a new cache in build.yml workflow. (fybrik#1713)
4bd8f8f 
Signed-off-by: Revital Sur <[email protected]>

Signed-off-by: Revital Sur <[email protected]>
@roytman
remove spaces after '\' 2 (fybrik#1716)
124af5d 
Signed-off-by: Alexey Roytman <[email protected]>

Signed-off-by: Alexey Roytman <[email protected]>
@cdoron
set AIRFLOW__SCHEDULER__DAG_DIR_LIST_INTERVAL to 5 seconds (fybrik#1727)
0bebecc 
for quicker deployment of OM ingestion pipelines on Airflow

Signed-off-by: Doron Chen <[email protected]>
@revit13
Add "Input to policies" section to using-opa.md (fybrik#1720)
196916d 
* Add "Input to policies" section to using-opa.md

Signed-off-by: Revital Sur <[email protected]>
@cdoron
allow future script to set OPENMETADATA_AIRFLOW_VERSION (fybrik#1729)
1c6e691 
* allow future script to set OPENMETADATA_AIRFLOW_VERSION
* add ?= to all env variables

Signed-off-by: Doron Chen <[email protected]>
@shlomitk1
fix crash (fybrik#1725)
d430774 
Signed-off-by: Shlomit Koyfman <[email protected]>
@shlomitk1
Set Deny when the connector returns 404,403 (fybrik#1733)
9d6a270 
* handle denied responses

Signed-off-by: Shlomit Koyfman <[email protected]>
@roytman
Remove obsolete kubeflow samples (fybrik#1735)
af4de20 
* Remove obsolete kubeflow samples

Signed-off-by: Alexey Roytman <[email protected]>
@roytman
add configurable discoveryBurst and discoveryQPS (fybrik#1741)
549f906 
* add configurable discoveryBurst and discoveryQPS
* add values check

Signed-off-by: Alexey Roytman <[email protected]>
@roytman
Add links to Google docs (fybrik#1754)
b19f114 
* Add links to Google docs

Signed-off-by: Alexey Roytman <[email protected]>
@revit13
Document k8s versions supported (fybrik#1730)
6f78f0d 
* Document k8s versions supported (fybrik#1724)
* Change to 1.22.9 image.

Signed-off-by: Revital Sur <[email protected]>
@revit13
Add yq as dependency for kubebuilder in hack/make-rules/tools.mk (fyb…
c13d67f 
…rik#1742)

Signed-off-by: Revital Sur <[email protected]>
@cdoron
add support for deploying vault with the openmetadata plugin (fybrik#…
46e3887 
…1757)

* add support for deploying vault with the openmetadata
plugin instead of the k8s-secrets plugin

Signed-off-by: Doron Chen <[email protected]>
@ityuhui
Bump github.com/docker/docker to v20.10.18 (fybrik#1760)
d2324ec 
Signed-off-by: Hui Yu <[email protected]>

Signed-off-by: Hui Yu <[email protected]>
@cdoron
Rename plugin-secrets-kubernetes-reader-values.yaml as plugin-secrets…
5f6ea7a 
…-values.yaml (fybrik#1768)

* rename plugin-secrets-kubernetes-reader-values.yaml
as plugin-secrets-values.yaml

Signed-off-by: Doron Chen <[email protected]>
@revit13
Add readiness and liveness probs to other pods (fybrik#1732)
710127e 
* Add readiness and liveness probs to other pods (fybrik#1723)

Signed-off-by: Revital Sur <[email protected]>
@cdoron
change OM installation for version 0.12.1 (fybrik#1759)
3cf2bc4 
* change OM installation for version 0.12.1

* set user/password for OM

* define OM user and PASSWORD in Makefile.env

Signed-off-by: Doron Chen <[email protected]>
@cdoron
simplify OM installation. (fybrik#1771)
cee85d6 
A separate openmetadata-connector docker image is not needed

Signed-off-by: Doron Chen <[email protected]>
@dependabot @roytman
Bump actions/setup-python from 4.2.0 to 4.3.0 (fybrik#1767)
0162273 
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4.2.0 to 4.3.0.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](actions/setup-python@v4.2.0...v4.3.0)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Alexey Roytman <[email protected]>
@cdoron
OpenMetadata install script (fybrik#1731)
0378a91 
* install OM script 

Signed-off-by: Doron Chen <[email protected]>
@revit13
Add details to site/docs/samples/notebook-write.md regarding location… (
2600d0e 
fybrik#1710)

* Add details to site/docs/samples/notebook-write.md regarding location of sample data (fybrik#1705)

* Add explanations.

Signed-off-by: Revital Sur <[email protected]>
@revit13
Aggregate continuously repeated commands in Fybrik Make files (fybrik…
90a41a9 
…#1598)

* Aggregate continuously repeated commands in Fybrik Make files (fybrik#1596)

* Remove manager target from manager/Makefile

* Fix run-notebook-readflow-tls-tests target in Makefile

Signed-off-by: Revital Sur <[email protected]>
@revit13
Fix run-notebook-readflow-tls-system-cacerts-tests target in Makefile. (
85d7b38 
fybrik#1774)

Fix run-notebook-readflow-tls-system-cacerts-tests target in Makefile. 

Signed-off-by: Revital Sur <[email protected]>
rohithdv and others added 28 commits November 9, 2022 21:28
@rohithdv
Adding documentation for creation of REST API in fybrik (fybrik#1766)
a043573 
* adding documentation for creation of REST API in fybrik

Signed-off-by: Rohith D Vallam <[email protected]>
@cdoron
add OpenMetadata Cleanup documentation (fybrik#1802)
8d2c40e 
* add OpenMetadata Cleanup documentation

Signed-off-by: Doron Chen <[email protected]>
@simanadler
Minor changes to OpenMetadata docs (fybrik#1803)
e06c979 
Signed-off-by: simanadler <[email protected]>
@cdoron
update openmetadata-connector version to 0.2.0 (fybrik#1807)
cb7e42a 
to support generic assets for the module chaining sample

Signed-off-by: Doron Chen <[email protected]>
@revit13
Fix deploy target in setup cluster scripts. (fybrik#1804)
155aa81 
Signed-off-by: Revital Sur <[email protected]>
@cdoron
Module chaining documentation (fybrik#1806)
15270ad 
* update module-chaining sample for OpenMetadata

Signed-off-by: Doron Chen <[email protected]>
@revit13
Vault plugins documentation needs updating (fybrik#1778)
72a8b0c 
* Vault plugins documentation needs updating (fybrik#1776)

Signed-off-by: Revital Sur <[email protected]>
@roytman
Precise OMD deployment options (fybrik#1808)
e3e03a6 
* Precise OMD deployment options

Signed-off-by: Alexey Roytman <[email protected]>
@revit13
Fix handling of CATALOGED_ASSET env var in notebook sample test runs. (…
b662593 
…fybrik#1812)

Signed-off-by: Revital Sur <[email protected]>

Signed-off-by: Revital Sur <[email protected]>
Co-authored-by: [email protected] <[email protected]>
@roytman
Resolves security alerts (fybrik#1813)
53d777f 
* Resolves security alerts
* add //go:build exclude

Signed-off-by: Alexey Roytman <[email protected]>
@dependabot
Bump github.com/open-policy-agent/opa from 0.42.2 to 0.43.1 (fybrik#1814
60e3a3f 
)

Bumps [github.com/open-policy-agent/opa](https://github.com/open-policy-agent/opa) from 0.42.2 to 0.43.1.
- [Release notes](https://github.com/open-policy-agent/opa/releases)
- [Changelog](https://github.com/open-policy-agent/opa/blob/main/CHANGELOG.md)
- [Commits](open-policy-agent/opa@v0.42.2...v0.43.1)

---
updated-dependencies:
- dependency-name: github.com/open-policy-agent/opa
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@roytman
Add instructions to config existing OpenMetadata catalog (fybrik#1811)
3483e5c 
* Add instructions to config existing OpenMetadata catalog

Signed-off-by: Alexey Roytman <[email protected]>

* fix cluster preparation for testing

* Remove redundant line

Signed-off-by: Alexey Roytman <[email protected]>
@cdoron
change openmetadata connector version to-0.3.0 (fybrik#1815)
8f0b7fc 
Signed-off-by: Doron Chen <[email protected]>

Signed-off-by: Doron Chen <[email protected]>
@revit13
Add mapping Fybrik v1.2 -> ArrowFlow module v0.9 and fix previous map…
fc76c27 
…ping (fybrik#1816) (fybrik#1817)

Signed-off-by: Revital Sur <[email protected]>
@revit13
Fix Fybrik image tag in chaining sample. (fybrik#1819)
68b9c4f 
* Fix Fybrik image tag in chaining sample.
* Fix arrow flight release version.

Signed-off-by: Revital Sur <[email protected]>
@cdoron
Update update-omd-discover-s3-asset.md to reflect (fybrik#1818)
13a60bd 
* Update update-omd-discover-s3-asset.md to reflect
that some of the Custom Properties have been
removed.
Also, the default tag category is now GenericTags
(replacing Fybrik)
* in read and delete sample, separate:
1. Register an asset through the OpenMetadata UI
2. Registering Dataset via Connector

Signed-off-by: Doron Chen <[email protected]>
@cdoron
replace PII with PII.Sensitive, finance with Purpose.finance, and sen…
fa642cf 
…sitive with PersonalData.Personal (fybrik#1821)

* replace PII with PII.Sensitive,
finance with Purpose.finance,
and sensitive with PersonalData.Personal

Signed-off-by: Doron Chen <[email protected]>
@cdoron
minor documentation suggestions (fybrik#1824)
2cea226 
Signed-off-by: Doron Chen <[email protected]>
@cdoron
add explanation about the importance of the (fybrik#1825)
27e41b0 
custom properties

Signed-off-by: Doron Chen <[email protected]>
@revit13
Make openmetadata the default catalog (fybrik#1823)
e432a3c 
* Make OpenMetadata default catalog.

Signed-off-by: Revital Sur <[email protected]>
@cdoron
run test when PR is pushed to master (fybrik#1827)
5af2334 
Signed-off-by: Doron Chen <[email protected]>
@revit13
Use python modules to set variables in mkdocs. (fybrik#1820)
2fe6fdc 
Signed-off-by: Revital Sur <[email protected]>
@revit13
Disable tests for draft mode. (fybrik#1826)
8609f41 
* Disable tests for draft mode.

Signed-off-by: Revital Sur <[email protected]>
@revit13
Avoid deploying Open-metadata catalog in integration tests (fybrik#1835)
eceaa95 
* Avoid deploying Open-metadata catalog in integration tests (fybrik#1834)

Signed-off-by: Revital Sur <[email protected]>
@shlomitk1
storage account CRD
e308a54 
Signed-off-by: Shlomit Koyfman <[email protected]>
@shlomitk1
add CRD types
62b2584 
Signed-off-by: Shlomit Koyfman <[email protected]>
@shlomitk1
set env variable for tests
7e049bb 
Signed-off-by: Shlomit Koyfman <[email protected]>
@shlomitk1
Merge remote-tracking branch 'upstream/master' into storage-account-crd
b41e65a
@shlomitk1 shlomitk1 closed this Jan 3, 2023
@shlomitk1 shlomitk1 deleted the storage-account-crd branch January 3, 2023 13:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
8 participants
@shlomitk1 @rohithdv @cdoron @roytman @revit13 @ityuhui @aradhalevy @simanadler