Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Retarget Hadoop #9

Closed
lintool opened this issue Jul 6, 2017 · 6 comments · Fixed by #44
Closed

Retarget Hadoop #9

lintool opened this issue Jul 6, 2017 · 6 comments · Fixed by #44

Comments

@lintool
Copy link
Member

lintool commented Jul 6, 2017

Maven currently targets CDH 5.7.1 for Hadoop/Spark related artifacts. This should probably be modified since it was pegged against the Hadoop version running at the Maryland cluster.

My suggestion is to peg to whatever version Altiscale is running, since that will likely become our canonical processing cluster moving forward.
@ruebot
Copy link
Member

ruebot commented Jul 6, 2017

Looks like they're on 5.11.1 according to this.

@lintool
Copy link
Member Author

lintool commented Jul 6, 2017

I don't think Altiscale actually runs CDH. They run vanilla Hadoop that has custom patches.

@lintool
Copy link
Member Author

lintool commented Jul 27, 2017

As part of this issue, we should get @ruebot onto the Altiscale cluster to kick the tires. How's this going?

@ruebot
Copy link
Member

ruebot commented Jul 27, 2017

Asked you about this in Slack a couple weeks ago; I had some questions about getting data in and usage. 😄

...still need your review/merge on #19 too.

@ruebot
Copy link
Member

ruebot commented Aug 28, 2017

@lintool we want this for the 1.0 release, right?

@lintool
Copy link
Member Author

lintool commented Aug 28, 2017

Yes, I believe so.

ruebot added a commit that referenced this issue Aug 29, 2017
@ruebot
Resolve #9; Update Hadoop and Spark versions.
92fe25e 
* Set Hadoop and Spark versions to Altiscale versions
* Set Hadoop to 2.7.3
* Set Spark to 1.6.2
ruebot added a commit that referenced this issue Aug 29, 2017
@ruebot
Resolve #9; Update Hadoop and Spark versions.
272901c 
* Set Hadoop and Spark versions to Altiscale versions
* Set Hadoop to 2.7.3
* Set Spark to 1.6.2
lintool added a commit that referenced this issue Oct 2, 2017
@lintool
Removed inaccurate information from README.md
54a6362 
We've already resolved #9
@lintool lintool mentioned this issue Oct 2, 2017
Merged
ruebot pushed a commit that referenced this issue Oct 2, 2017
@lintool @ruebot
Removed inaccurate information from README.md (#44)
8052503 
We've already resolved #9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Removed inaccurate information from README.md archivesunleashed/aut
2 participants
@ruebot @lintool