如何避免Maven Shade插件包含来自'test-jar'类型的传递依赖项?

我正在研究一个具有模块间依赖性的多模块Maven项目。例如:项目的一个模块,例如spark-module依赖于同一项目的另一个模块(例如core-module)。

core-module依赖于jackson-datatype-jsr310:2.8.11,在spark-module中,我从Apache Spark项目添加了测试罐-spark-sql_2.11:2.4.0,{{1} },spark-core_2.11:2.4.0用于单元测试。如您所见,这些Spark模块都是2.4.0版,它们内部使用spark-catalyst_2.11:2.4.0。请参考下面提供的POM:

父母

jackson-databind:2.6.7.1

核心模块

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>

    <groupId>com.sample</groupId>
    <artifactId>spark-test</artifactId>
    <packaging>pom</packaging>
    <version>1.0-snAPSHOT</version>
    <modules>
        <module>core-module</module>
        <module>spark-module</module>
    </modules>

</project>

火花模块

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <parent>
        <artifactId>spark-test</artifactId>
        <groupId>com.sample</groupId>
        <version>1.0-snAPSHOT</version>
    </parent>
    <modelVersion>4.0.0</modelVersion>

    <artifactId>core-module</artifactId>

    <dependencies>
        <dependency>
            <groupId>com.fasterxml.jackson.datatype</groupId>
            <artifactId>jackson-datatype-jsr310</artifactId>
            <version>2.8.11</version>
        </dependency>
    </dependencies>

    <build>
        <resources>
            <resource>
                <directory>src/main/resources</directory>
            </resource>
        </resources>
        <testResources>
            <testResource>
                <directory>src/test/resources</directory>
                <filtering>true</filtering>
            </testResource>
        </testResources>
    </build>

</project>

现在,当我构建<?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <parent> <artifactId>spark-test</artifactId> <groupId>com.sample</groupId> <version>1.0-snAPSHOT</version> </parent> <modelVersion>4.0.0</modelVersion> <artifactId>spark-module</artifactId> <dependencies> <dependency> <groupId>com.sample</groupId> <artifactId>core-module</artifactId> <version>1.0-snAPSHOT</version> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-sql_2.11</artifactId> <version>2.4.0</version> <scope>provided</scope> <exclusions> <exclusion> <groupId>com.fasterxml.jackson.core</groupId> <artifactId>*</artifactId> </exclusion> <exclusion> <groupId>com.fasterxml.jackson.module</groupId> <artifactId>*</artifactId> </exclusion> <exclusion> <groupId>org.javassist</groupId> <artifactId>*</artifactId> </exclusion> </exclusions> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.11</artifactId> <version>2.4.0</version> <scope>provided</scope> <exclusions> <exclusion> <groupId>com.fasterxml.jackson.core</groupId> <artifactId>*</artifactId> </exclusion> <exclusion> <groupId>com.fasterxml.jackson.module</groupId> <artifactId>*</artifactId> </exclusion> <exclusion> <groupId>org.javassist</groupId> <artifactId>*</artifactId> </exclusion> </exclusions> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-hive_2.11</artifactId> <version>2.4.0</version> <scope>provided</scope> </dependency> <!-- Test dependencies --> <dependency> <groupId>org.scalatest</groupId> <artifactId>scalatest_2.11</artifactId> <version>3.0.6</version> <scope>test</scope> </dependency> <dependency> <groupId>com.holdenkarau</groupId> <artifactId>spark-testing-base_2.11</artifactId> <version>2.4.0_0.12.0</version> <scope>test</scope> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-sql_2.11</artifactId> <version>2.4.0</version> <type>test-jar</type> <scope>test</scope> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.11</artifactId> <version>2.4.0</version> <type>test-jar</type> <scope>test</scope> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-catalyst_2.11</artifactId> <version>2.4.0</version> <type>test-jar</type> <scope>test</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupId>net.alchim31.maven</groupId> <artifactId>scala-maven-plugin</artifactId> <version>3.2.2</version> <executions> <execution> <goals> <goal>compile</goal> <goal>testCompile</goal> </goals> </execution> </executions> </plugin> <plugin> <groupId>org.scalatest</groupId> <artifactId>scalatest-maven-plugin</artifactId> <version>2.0.0</version> <configuration> <reportsDirectory>${project.build.directory}/surefire-reports</reportsDirectory> <junitxml>.</junitxml> <filereports>WDF TestSuite.txt</filereports> </configuration> <executions> <execution> <id>test</id> <goals> <goal>test</goal> </goals> </execution> </executions> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <version>3.1</version> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-shade-plugin</artifactId> <version>3.0.0</version> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <artifactSet> <excludes> <exclude>org.apache.spark:*</exclude> </excludes> </artifactSet> </configuration> </execution> </executions> </plugin> </plugins> </build> </project> 时,当maven shade插件启动时,它包含spark-module而不是2.8.11(我认为它来自jackson-databind:2.6.7.1)。当我将以下排除项添加到core-module依赖项时,它会正确捆绑2.8.11版本的JAR,但这会使我的测试失败,因为排除了依赖项:

test-jar

也许我在处理依赖项的方式上做错了。所以,请您帮我了解在这里应该做什么?

z442820293 回答:如何避免Maven Shade插件包含来自'test-jar'类型的传递依赖项?

要控制jackson-databind的版本,请在<dependencyManagement>部分中添加一个条目,您可以在其中指定所需的版本。这将覆盖所有传递定义,并且比各种排除方法更容易处理。

因此,在第一步中,您可以尝试将其设置为<version>2.8.11</version>并尝试测试是否可行。如果不是,那么您需要找出一个既适用于core-module中的应用程序又适用于您的测试的“中间版本”。

本文链接:https://www.f2er.com/3125977.html

大家都在问