Skip to content
This repository has been archived by the owner on Oct 9, 2023. It is now read-only.

Remove legacy fetch for workflow execution inputs #173

Merged
merged 2 commits into from
Mar 31, 2021

Conversation

katrogan
Copy link
Contributor

TL;DR

Formerly we directly passed workflow exec inputs in the response to GetWorkflowExecution. This has long since moved to a separate api call, GetExecutionData and fetching inputs from a cloud blobstore is slow and now unnecessary.

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

How did you fix the bug, make the feature etc. Link to any design docs etc

Tracking Issue

flyteorg/flyte#879

Follow-up issue

NA

Signed-off-by: Katrina Rogan <[email protected]>
Signed-off-by: Katrina Rogan <[email protected]>
@codecov
Copy link

codecov bot commented Mar 31, 2021

Codecov Report

Merging #173 (2bfd09a) into master (55c3291) will increase coverage by 0.00%.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #173   +/-   ##
=======================================
  Coverage   63.04%   63.04%           
=======================================
  Files         100      100           
  Lines        7295     7285   -10     
=======================================
- Hits         4599     4593    -6     
+ Misses       2114     2112    -2     
+ Partials      582      580    -2     
Flag Coverage Δ
unittests 63.04% <ø> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
pkg/manager/impl/execution_manager.go 68.98% <ø> (+0.10%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 55c3291...2bfd09a. Read the comment docs.

@katrogan katrogan merged commit e35e4f2 into master Mar 31, 2021
EngHabu pushed a commit that referenced this pull request Apr 26, 2021
EngHabu pushed a commit that referenced this pull request Apr 26, 2021
EngHabu added a commit that referenced this pull request Apr 30, 2021
…D and OAuth2 configs, OAuth2 Metadata over gRPC #minor (#168)

* wip: OAuth2 Support

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* tighten security of generated tokens

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Support storing form post values in auth code JWT

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* save secrets to k8s secrets

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Expose metadata endpoints over gRPC

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* trim OpenID Connect config further

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Selectively authenticate gRPC endpoints

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Support external oauth2 server and Okta Config

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* update config

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fix nil secrets data map

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fixed the pointer overwrite issue in oauthServer metadata (#183)

Signed-off-by: Prafulla Mahindrakar <[email protected]>

Co-authored-by: Prafulla Mahindrakar <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Unit tests

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Unit tests

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Simplify config further and move auth package up

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fix clusterresource Project and domain(#167)

* Fix clusterresource Project

Signed-off-by: Anand Swaminathan <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Bump flyteidl version to pick up auth role field number fix (#169)

Signed-off-by: Katrina Rogan <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Add option to use project name as namespace for the task pods (#166)

* Add option to use project name as namespace for the task pods

Signed-off-by: Jeev B <[email protected]>

* rename

Signed-off-by: Jeev B <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* GetExecution performance improvements (#171)

Signed-off-by: Katrina Rogan <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Add exists check for workflow & node executions (#172)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Remove legacy fetch for workflow execution inputs (#173)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Added release workflow (#170)

Signed-off-by: yuvraj <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update Flyteidl version (#175)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Added version in flyteadmin (#154)

* wip: added version pkg

Signed-off-by: yuvraj <[email protected]>

* wip: resolve conflict

Signed-off-by: yuvraj <[email protected]>

* wip: added version in rpc

Signed-off-by: yuvraj <[email protected]>

* wip: small fixes

Signed-off-by: yuvraj <[email protected]>

* wip: Added panic cache in get version service

Signed-off-by: yuvraj <[email protected]>

* Added flytestdlib for version package

Signed-off-by: yuvraj <[email protected]>

* Added version service test

Signed-off-by: yuvraj <[email protected]>

* wip: added ldflags in goreleaser

Signed-off-by: yuvraj <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Propagate nesting and principal for child executions (#177)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Write workflow and node execution events asynchronously (#174)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Add sensible flyteadmin config defaults (#179)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Lint

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* further cleanup

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Only register authserver when auth is enabled

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update to latest flyteidl and separate auth interfaces

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* dead code

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* merge master

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Move to authorizedUris

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update to released flyteidl

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fix response expiry and add unit tests

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update go mod

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* fix unit tests that broke because of identity changes

Signed-off-by: Haytham Abuelfutuh <[email protected]>

Co-authored-by: pmahindrakar-oss <[email protected]>
Co-authored-by: Prafulla Mahindrakar <[email protected]>
Co-authored-by: Anand Swaminathan <[email protected]>
Co-authored-by: Katrina Rogan <[email protected]>
Co-authored-by: Jeev B <[email protected]>
Co-authored-by: Yuvraj <[email protected]>
Co-authored-by: Flyte Bot <[email protected]>
eapolinario pushed a commit that referenced this pull request Sep 6, 2023
…D and OAuth2 configs, OAuth2 Metadata over gRPC #minor (#168)

* wip: OAuth2 Support

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* tighten security of generated tokens

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Support storing form post values in auth code JWT

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* save secrets to k8s secrets

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Expose metadata endpoints over gRPC

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* trim OpenID Connect config further

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Selectively authenticate gRPC endpoints

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Support external oauth2 server and Okta Config

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* update config

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fix nil secrets data map

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fixed the pointer overwrite issue in oauthServer metadata (#183)

Signed-off-by: Prafulla Mahindrakar <[email protected]>

Co-authored-by: Prafulla Mahindrakar <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Unit tests

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Unit tests

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Simplify config further and move auth package up

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fix clusterresource Project and domain(#167)

* Fix clusterresource Project

Signed-off-by: Anand Swaminathan <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Bump flyteidl version to pick up auth role field number fix (#169)

Signed-off-by: Katrina Rogan <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Add option to use project name as namespace for the task pods (#166)

* Add option to use project name as namespace for the task pods

Signed-off-by: Jeev B <[email protected]>

* rename

Signed-off-by: Jeev B <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* GetExecution performance improvements (#171)

Signed-off-by: Katrina Rogan <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Add exists check for workflow & node executions (#172)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Remove legacy fetch for workflow execution inputs (#173)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Added release workflow (#170)

Signed-off-by: yuvraj <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update Flyteidl version (#175)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Added version in flyteadmin (#154)

* wip: added version pkg

Signed-off-by: yuvraj <[email protected]>

* wip: resolve conflict

Signed-off-by: yuvraj <[email protected]>

* wip: added version in rpc

Signed-off-by: yuvraj <[email protected]>

* wip: small fixes

Signed-off-by: yuvraj <[email protected]>

* wip: Added panic cache in get version service

Signed-off-by: yuvraj <[email protected]>

* Added flytestdlib for version package

Signed-off-by: yuvraj <[email protected]>

* Added version service test

Signed-off-by: yuvraj <[email protected]>

* wip: added ldflags in goreleaser

Signed-off-by: yuvraj <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Propagate nesting and principal for child executions (#177)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Write workflow and node execution events asynchronously (#174)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Add sensible flyteadmin config defaults (#179)

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Lint

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* further cleanup

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Only register authserver when auth is enabled

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update to latest flyteidl and separate auth interfaces

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* dead code

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* merge master

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Move to authorizedUris

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update to released flyteidl

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fix response expiry and add unit tests

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update go mod

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* fix unit tests that broke because of identity changes

Signed-off-by: Haytham Abuelfutuh <[email protected]>

Co-authored-by: pmahindrakar-oss <[email protected]>
Co-authored-by: Prafulla Mahindrakar <[email protected]>
Co-authored-by: Anand Swaminathan <[email protected]>
Co-authored-by: Katrina Rogan <[email protected]>
Co-authored-by: Jeev B <[email protected]>
Co-authored-by: Yuvraj <[email protected]>
Co-authored-by: Flyte Bot <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants