Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add insertInto and saveAsTable to Python API. #447

Closed
wants to merge 2 commits into from

Conversation

marmbrus
Copy link
Contributor

No description provided.

@rxin
Copy link
Contributor

rxin commented Apr 18, 2014

lgtm

@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@@ -305,6 +305,19 @@ def registerAsTable(self, name):
"""
self._jschema_rdd.registerAsTable(name)

def insertInto(self, tableName, overwrite = False):
"""
Inserts the contents of this SchemaRDD into the specified table, optionally overwriting any
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make it 72 chars wide max for docstring:

Note that this does not apply for docstrings: docstrings should be at most 72 characters wide to display properly in most Python consoles.

@AmplabJenkins
Copy link

Merged build finished. All automated tests passed.

@AmplabJenkins
Copy link

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14247/

@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@AmplabJenkins
Copy link

Merged build finished. All automated tests passed.

@AmplabJenkins
Copy link

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14249/

@mateiz
Copy link
Contributor

mateiz commented Apr 19, 2014

Merged, thanks.

asfgit pushed a commit that referenced this pull request Apr 19, 2014
Author: Michael Armbrust <[email protected]>

Closes #447 from marmbrus/pythonInsert and squashes the following commits:

c7ab692 [Michael Armbrust] Keep docstrings < 72 chars.
ff62870 [Michael Armbrust] Add insertInto and saveAsTable to Python API.

(cherry picked from commit 10d0421)
Signed-off-by: Matei Zaharia <[email protected]>
@asfgit asfgit closed this in 10d0421 Apr 19, 2014
@marmbrus marmbrus deleted the pythonInsert branch April 23, 2014 22:00
pwendell added a commit to pwendell/spark that referenced this pull request May 12, 2014
fix for SPARK-1027

fix for SPARK-1027  (https://spark-project.atlassian.net/browse/SPARK-1027)

FIXES

1. change sparkhome from String to Option(String) in ApplicationDesc

2. remove sparkhome parameter in LaunchExecutor message

3. adjust involved files
pdeyhim pushed a commit to pdeyhim/spark-1 that referenced this pull request Jun 25, 2014
Author: Michael Armbrust <[email protected]>

Closes apache#447 from marmbrus/pythonInsert and squashes the following commits:

c7ab692 [Michael Armbrust] Keep docstrings < 72 chars.
ff62870 [Michael Armbrust] Add insertInto and saveAsTable to Python API.
mccheah referenced this pull request in palantir/spark Sep 26, 2017
#447)

* Fail submission if submitter-local files are provided without resource staging server URI

* Modified logic to validate only submitted jars; added orchestrator tests

* Incorporated feedback

* Fix failing test case
markhamstra pushed a commit to markhamstra/spark that referenced this pull request Nov 7, 2017
apache#447)

* Fail submission if submitter-local files are provided without resource staging server URI

* Modified logic to validate only submitted jars; added orchestrator tests

* Incorporated feedback

* Fix failing test case
j-esse pushed a commit to j-esse/spark that referenced this pull request Jan 24, 2019
bzhaoopenstack pushed a commit to bzhaoopenstack/spark that referenced this pull request Sep 11, 2019
Update the pipeline and jobs to add 1.13 K8s
arjunshroff pushed a commit to arjunshroff/spark that referenced this pull request Nov 24, 2020
RolatZhang pushed a commit to RolatZhang/spark that referenced this pull request Aug 15, 2022
* Spark Release

* delete  LocalFileAppender

Co-authored-by: Enwei Jiao <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants