Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix: Resolve source file location and format issue in the New York Taxi Trips dataset #441

Merged
merged 15 commits into from
Aug 10, 2022

Conversation

nlarge-google
Copy link
Collaborator

@nlarge-google nlarge-google commented Aug 10, 2022

Description

New location of source files. Also, new format is parquet.

Checklist

  • (Required) This pull request is appropriately labeled
  • Please merge this pull request after it's approved

Use the sections below based on what's applicable to your PR and delete the rest:

Data Onboarding

  • I'm adding or editing a dataset
  • The Google Cloud Datasets team is aware of the proposed dataset
  • I put all my code inside datasets/new_york_taxi_trips and nothing outside of that directory

@happyhuman happyhuman merged commit 13a829f into GoogleCloudPlatform:main Aug 10, 2022
vijay-google pushed a commit to vijay-google/public-datasets-pipelines that referenced this pull request Aug 17, 2022
…xi Trips dataset (GoogleCloudPlatform#441)

* fix: reference to container registry

* feat: Onboard New York Taxi Trips Dataset

* Update datasets/new_york_taxi_trips/pipelines/new_york_taxi_trips/pipeline.yaml

* Update datasets/new_york_taxi_trips/pipelines/new_york_taxi_trips/pipeline.yaml

* Update datasets/new_york_taxi_trips/pipelines/new_york_taxi_trips/pipeline.yaml

* Update new_york_taxi_trips_dag.py

* Update tlc_green_trips_pipeline.tf

* Delete new_york_dag.py

* Delete pipeline.yaml

* added back main branch files from NY pipeline

* revisions to TF files and added dataset.yaml

* fix: Resolve that files are no longer available from their initial source and are now in parquet format.

* fix: Resolve flake hooks.

Co-authored-by: Adler Santos <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants