JDBC Sink Connector failing to find PostgreSQL driver in Kafka Connect

[Sanskarzz]

We're experiencing an issue with a JDBC Sink Connector in our Strimzi-based Kafka Connect setup. The connector is failing to find the PostgreSQL JDBC driver, despite our attempts to include it in the Kafka Connect image.

When we deploy our KafkaConnector resource, we get the following error:

Caused by: org.apache.kafka.connect.errors.ConnectException: java.sql.SQLException: No suitable driver found for jdbc:postgresql://retail-products-db-rw.test:5432/retail_products_db
  at io.confluent.connect.jdbc.util.CachedConnectionProvider.getConnection(CachedConnectionProvider.java:62)
  at io.confluent.connect.jdbc.sink.JdbcDbWriter.write(JdbcDbWriter.java:64)
  at io.confluent.connect.jdbc.sink.JdbcSinkTask.put(JdbcSinkTask.java:90)
  at org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:605)
  ... 11 more
Caused by: java.sql.SQLException: No suitable driver found for jdbc:postgresql://retail-products-db-rw.test:5432/retail_products_db
  at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:706)
  at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:190)
  at io.confluent.connect.jdbc.dialect.GenericDatabaseDialect.getConnection(GenericDatabaseDialect.java:250)
  at io.confluent.connect.jdbc.dialect.PostgreSqlDatabaseDialect.getConnection(PostgreSqlDatabaseDialect.java:104)
  at io.confluent.connect.jdbc.util.CachedConnectionProvider.newConnection(CachedConnectionProvider.java:84)
  at io.confluent.connect.jdbc.util.CachedConnectionProvider.getConnection(CachedConnectionProvider.java:54)
  ... 14 more

Our KafkaConnect resource includes the following configuration to download the necessary JARs:

build:
    output:
      type: docker
      image: registry.gitlab.com/retail310009/retail-sync-service/debezium-postgres-connect-jdbc:latest
      pushSecret: gitlab-registry-secret
    plugins:
      - name: jdbc-sink-connector
        artifacts:
          - type: jar
            url: https://packages.confluent.io/maven/io/confluent/kafka-connect-jdbc/10.7.4/kafka-connect-jdbc-10.7.4.jar
      - name: postgres-jdbc-driver
        artifacts:
          - type: jar
            url: https://jdbc.postgresql.org/download/postgresql-42.7.3.jar
      - name: debezium
        artifacts:
          - type: tgz
            url: https://repo1.maven.org/maven2/io/debezium/debezium-connector-postgres/2.7.3.Final/debezium-connector-postgres-2.7.3.Final-plugin.tar.gz

[scholzj]

The artifacts that should work together, they should be part of a single plugin. The way you have it now, is that they each form a different connector plugin and will be loaded into its own separate classpath.