Skip to content

Commit

Permalink
[vpj] Bump hadoop to 2.7.2 (linkedin#706)
Browse files Browse the repository at this point in the history
As a pre-requisite for adding S3 support to VPJ, this commit bumps hadoop to 2.7.2.

Hadoop 2.6 introduces "hadoop-aws" which can become a runtime dependancy.
2.6 has a known compatibility issue with guava thus, the update to 2.7.2.
  • Loading branch information
modithah authored Oct 19, 2023
1 parent 6a49c21 commit d238500
Showing 1 changed file with 4 additions and 3 deletions.
7 changes: 4 additions & 3 deletions build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@ def jacksonVersion = '2.13.3'
def pulsarGroup = 'org.apache.pulsar'
def pulsarVersion = '2.10.3'
def alpnAgentVersion = '2.0.10'
def hadoopVersion = '2.7.2'

ext.libraries = [
alpnAgent: "org.mortbay.jetty.alpn:jetty-alpn-agent:${alpnAgentVersion}",
Expand All @@ -71,7 +72,7 @@ ext.libraries = [
d2: "com.linkedin.pegasus:d2:${pegasusVersion}",
failsafe: 'net.jodah:failsafe:2.4.0',
fastUtil: 'it.unimi.dsi:fastutil:8.3.0',
hadoopCommon: 'org.apache.hadoop:hadoop-common:2.3.0',
hadoopCommon: "org.apache.hadoop:hadoop-common:${hadoopVersion}",
helix: 'org.apache.helix:helix-core:1.1.0',
httpAsyncClient: 'org.apache.httpcomponents:httpasyncclient:4.1.2',
httpClient5: 'org.apache.httpcomponents.client5:httpclient5:5.2.1',
Expand All @@ -94,8 +95,8 @@ ext.libraries = [
log4j2api: "org.apache.logging.log4j:log4j-api:${log4j2Version}",
log4j2core: "org.apache.logging.log4j:log4j-core:${log4j2Version}",
mail: 'javax.mail:mail:1.4.4',
mapreduceClientCore: 'org.apache.hadoop:hadoop-mapreduce-client-core:2.3.0',
mapreduceClientJobClient: 'org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.3.0',
mapreduceClientCore: "org.apache.hadoop:hadoop-mapreduce-client-core:${hadoopVersion}",
mapreduceClientJobClient: "org.apache.hadoop:hadoop-mapreduce-client-jobclient:${hadoopVersion}",
mockito: 'org.mockito:mockito-core:4.11.0',
netty: 'io.netty:netty-all:4.1.52.Final',
oss: 'org.sonatype.oss:oss-parent:7',
Expand Down

0 comments on commit d238500

Please sign in to comment.