How to run kafka with minikube on Apple m1?

[fabulias]

Hi, I'm using an Apple M1 laptop and I'm trying to start a Minikube cluster with Kafka but I can't do it.

I'm following these steps to start Kafka

kubectl apply -f 'https://strimzi.io/install/latest?namespace=default' -n default
kubectl apply -f https://strimzi.io/examples/latest/kafka/kafka-persistent-single.yaml -n default
kubectl wait kafka/my-cluster --for=condition=Ready --timeout=300s -n default

But all the time I'm receiving this error (I've tried around 10 times, at the beginning I thought it was a network problem but never works fine)

kubectl wait kafka/my-cluster --for=condition=Ready --timeout=300s -n default
error: timed out waiting for the condition on kafkas/my-cluster
make: *** [minikube-escencials] Error 1

A screenshot from my terminal

And their respective logs

Auto-detected KUBERNETES_SERVICE_DNS_DOMAIN: cluster.local                                                                                                                                            │
+ export MALLOC_ARENA_MAX=2                                                                                                                                                                           │
+ MALLOC_ARENA_MAX=2                                                                                                                                                                                  │
+ JAVA_OPTS=' -Dlog4j2.configurationFile=file:/opt/strimzi/custom-config/log4j2.properties -Dvertx.cacheDirBase=/tmp/vertx-cache -Djava.security.egd=file:/dev/./urandom'                             │
++ get_gc_opts                                                                                                                                                                                        │
++ '[' '' == true ']'                                                                                                                                                                                 │
++ echo ''                                                                                                                                                                                            │
+ JAVA_OPTS=' -Dlog4j2.configurationFile=file:/opt/strimzi/custom-config/log4j2.properties -Dvertx.cacheDirBase=/tmp/vertx-cache -Djava.security.egd=file:/dev/./urandom '                            │
+ JAVA_OPTS=' -Dlog4j2.configurationFile=file:/opt/strimzi/custom-config/log4j2.properties -Dvertx.cacheDirBase=/tmp/vertx-cache -Djava.security.egd=file:/dev/./urandom  --illegal-access=deny'      │
+ exec /usr/bin/tini -w -e 143 -- java -Dlog4j2.configurationFile=file:/opt/strimzi/custom-config/log4j2.properties -Dvertx.cacheDirBase=/tmp/vertx-cache -Djava.security.egd=file:/dev/./urandom --i │
2021-12-06 22:22:51 INFO  Main:60 - ClusterOperator 0.26.0 is starting                                                                                                                                │
2021-12-06 22:22:53 INFO  Main:62 - Cluster Operator configuration is ClusterOperatorConfig(namespaces=[default],reconciliationIntervalMs=120000,operationTimeoutMs=300000,connectBuildTimeoutMs=3000 │
2021-12-06 22:23:04 INFO  Main:81 - Environment facts gathered: PlatformFeaturesAvailability(KubernetesVersion=1.22,OpenShiftRoutes=false,OpenShiftBuilds=false,OpenShiftImageStreams=false,OpenShift │

At last comment, two of my teammates are using the same Kafka configuration in their notebooks, they have MacBooks but with Intel and, they don't have problems.

Does someone have the solution for this?

[scholzj]

The log you shared does not seem to be complete (if nothing else, the last line is not complete). Maybe sharing the fill log would help. also keep in mind, that 0.26.0 supports only amd64 platform -> so you probably need to make sure your Minikube runs in the amd64 mode (now idea how exactly it works since I do not have M1 Macbook). Support for AArch64 was added only today to the main branch - but that would normally give different error, so I don't think this is a platform issue.

[fabulias]

@scholzj I tried with the repo and I got this error :(

    container: oci
    STRIMZI_DEFAULT_TOPIC_OPERATOR_IMAGE: quay.io/strimzi/operator:latest
    JAVA_OPTS:  -Dlog4j2.configurationFile=file:/opt/strimzi/custom-config/log4j2.properties -Dvertx.cacheDirBase=/tmp/vertx-cache -Djava.security.egd=file:/dev/./urandom  --illegal-access=deny
    STRIMZI_HOME: /opt/strimzi
    PWD: /opt/strimzi
    KUBERNETES_PORT_443_TCP: tcp://10.96.0.1:443
    JAVA_MAIN: io.strimzi.operator.cluster.Main
    POSTGRES_PORT_5432_TCP: tcp://10.111.159.162:5432
    STRIMZI_VERSION: 0.27.0-SNAPSHOT
    STRIMZI_DEFAULT_JMXTRANS_IMAGE: quay.io/strimzi/jmxtrans:latest
    STRIMZI_NAMESPACE: default
    STRIMZI_DEFAULT_KANIKO_EXECUTOR_IMAGE: quay.io/strimzi/kaniko-executor:latest
    TINI_SHA256_S390X: 931b70a182af879ca249ae9de87ef68423121b38d235c78997fafc680ceab32d
    POSTGRES_PORT: tcp://10.111.159.162:5432
    STRIMZI_DEFAULT_MAVEN_BUILDER: quay.io/strimzi/maven-builder:latest
    STRIMZI_FEATURE_GATES: 
    TINI_SHA256_AMD64: 93dcc18adc78c65a028a84799ecf8ad40c936fdfc5f2a57b1acda5a8117fa82c
    KUBERNETES_SERVICE_DNS_DOMAIN: cluster.local
    POSTGRES_SERVICE_HOST: 10.111.159.162
    POSTGRES_PORT_5432_TCP_PROTO: tcp
    KUBERNETES_SERVICE_PORT_HTTPS: 443
    SHLVL: 0
    POSTGRES_PORT_5432_TCP_PORT: 5432
    POSTGRES_SERVICE_PORT: 5432
    STRIMZI_DEFAULT_KAFKA_BRIDGE_IMAGE: quay.io/strimzi/kafka-bridge:0.20.3
    KUBERNETES_PORT: tcp://10.96.0.1:443
    STRIMZI_KAFKA_MIRROR_MAKER_IMAGES: 2.8.0=quay.io/strimzi/kafka:latest-kafka-2.8.0
2.8.1=quay.io/strimzi/kafka:latest-kafka-2.8.1
3.0.0=quay.io/strimzi/kafka:latest-kafka-3.0.0
    JAVA_HOME: /usr/lib/jvm/jre-11
    STRIMZI_FULL_RECONCILIATION_INTERVAL_MS: 120000
    KUBERNETES_SERVICE_HOST: 10.96.0.1
    JAVA_CLASSPATH: lib/io.strimzi.cluster-operator-0.27.0-SNAPSHOT.jar:lib/io.netty.netty-common-4.1.71.Final.jar:lib/io.fabric8.openshift-model-operatorhub-5.10.1.jar:lib/io.fabric8.kubernetes-model-scheduling-5.10.1.jar:lib/io.fabric8.kubernetes-model-extensions-5.10.1.jar:lib/io.fabric8.kubernetes-model-discovery-5.10.1.jar:lib/io.netty.netty-codec-http2-4.1.71.Final.jar:lib/org.apache.kafka.kafka-clients-3.0.0.jar:lib/org.hdrhistogram.HdrHistogram-2.1.11.jar:lib/com.fasterxml.jackson.core.jackson-databind-2.11.3.jar:lib/io.fabric8.openshift-model-5.10.1.jar:lib/com.squareup.okhttp3.logging-interceptor-3.12.12.jar:lib/io.fabric8.kubernetes-model-node-5.10.1.jar:lib/io.fabric8.kubernetes-model-common-5.10.1.jar:lib/org.apache.zookeeper.zookeeper-jute-3.6.3.jar:lib/io.netty.netty-handler-4.1.71.Final.jar:lib/io.strimzi.api-0.27.0-SNAPSHOT.jar:lib/org.apache.zookeeper.zookeeper-3.6.3.jar:lib/io.fabric8.openshift-model-machineconfig-5.10.1.jar:lib/net.minidev.accessors-smart-2.4.7.jar:lib/com.fasterxml.jackson.dataformat.jackson-dataformat-yaml-2.10.5.jar:lib/io.fabric8.kubernetes-model-metrics-5.10.1.jar:lib/com.github.mifmif.generex-1.0.2.jar:lib/org.xerial.snappy.snappy-java-1.1.8.1.jar:lib/io.fabric8.kubernetes-model-apps-5.10.1.jar:lib/org.yaml.snakeyaml-1.26.jar:lib/io.fabric8.kubernetes-model-admissionregistration-5.10.1.jar:lib/io.netty.netty-resolver-dns-4.1.71.Final.jar:lib/io.strimzi.crd-annotations-0.27.0-SNAPSHOT.jar:lib/org.lz4.lz4-java-1.7.1.jar:lib/io.fabric8.openshift-model-operator-5.10.1.jar:lib/io.strimzi.operator-common-0.27.0-SNAPSHOT.jar:lib/io.strimzi.kafka-oauth-client-0.8.1.jar:lib/io.netty.netty-codec-socks-4.1.71.Final.jar:lib/io.netty.netty-handler-proxy-4.1.71.Final.jar:lib/io.netty.netty-resolver-4.1.71.Final.jar:lib/io.fabric8.openshift-model-clusterautoscaling-5.10.1.jar:lib/com.jayway.jsonpath.json-path-2.6.0.jar:lib/net.minidev.json-smart-2.4.7.jar:lib/io.fabric8.kubernetes-model-flowcontrol-5.10.1.jar:lib/io.fabric8.zjsonpatch-0.3.0.jar:lib/io.fabric8.kubernetes-model-coordination-5.10.1.jar:lib/io.strimzi.kafka-oauth-server-0.8.1.jar:lib/io.vertx.vertx-micrometer-metrics-4.2.1.jar:lib/com.squareup.okhttp3.okhttp-3.12.6.jar:lib/io.fabric8.kubernetes-model-batch-5.10.1.jar:lib/io.netty.netty-codec-dns-4.1.71.Final.jar:lib/org.apache.logging.log4j.log4j-api-2.14.1.jar:lib/io.netty.netty-transport-native-unix-common-4.1.71.Final.jar:lib/io.netty.netty-transport-native-epoll-4.1.71.Final.jar:lib/com.github.luben.zstd-jni-1.5.0-2.jar:lib/io.vertx.vertx-core-4.2.1.jar:lib/org.quartz-scheduler.quartz-2.3.2.jar:lib/io.prometheus.simpleclient_common-0.7.0.jar:lib/io.strimzi.certificate-manager-0.27.0-SNAPSHOT.jar:lib/io.netty.netty-buffer-4.1.71.Final.jar:lib/com.squareup.okio.okio-1.15.0.jar:lib/io.fabric8.kubernetes-model-events-5.10.1.jar:lib/io.fabric8.kubernetes-model-core-5.10.1.jar:lib/org.apache.logging.log4j.log4j-core-2.14.1.jar:lib/io.prometheus.simpleclient-0.7.0.jar:lib/io.fabric8.kubernetes-model-networking-5.10.1.jar:lib/io.netty.netty-transport-native-epoll-4.1.71.Final-linux-x86_64.jar:lib/org.apache.yetus.audience-annotations-0.5.0.jar:lib/io.fabric8.kubernetes-model-certificates-5.10.1.jar:lib/com.fasterxml.jackson.core.jackson-annotations-2.11.3.jar:lib/io.fabric8.openshift-model-miscellaneous-5.10.1.jar:lib/io.micrometer.micrometer-core-1.3.1.jar:lib/io.strimzi.config-model-0.27.0-SNAPSHOT.jar:lib/io.fabric8.kubernetes-model-apiextensions-5.10.1.jar:lib/io.fabric8.openshift-model-whereabouts-5.10.1.jar:lib/io.fabric8.kubernetes-client-5.10.1.jar:lib/io.netty.netty-codec-4.1.71.Final.jar:lib/com.nimbusds.nimbus-jose-jwt-9.10.jar:lib/io.netty.netty-codec-http-4.1.71.Final.jar:lib/io.fabric8.openshift-model-storageversionmigrator-5.10.1.jar:lib/com.fasterxml.jackson.core.jackson-core-2.11.3.jar:lib/com.github.stephenc.jcip.jcip-annotations-1.0-1.jar:lib/io.strimzi.kafka-oauth-server-plain-0.8.1.jar:lib/io.fabric8.openshift-model-monitoring-5.10.1.jar:lib/io.fabric8.kubernetes-model-storageclass-5.10.1.jar:lib/dk.brics.automaton.automaton-1.11-8.jar:lib/io.strimzi.kafka-oauth-common-0.8.1.jar:lib/io.netty.netty-transport-classes-epoll-4.1.71.Final.jar:lib/io.fabric8.openshift-model-tuned-5.10.1.jar:lib/io.fabric8.kubernetes-model-autoscaling-5.10.1.jar:lib/org.apache.logging.log4j.log4j-slf4j-impl-2.14.1.jar:lib/io.fabric8.openshift-client-5.10.1.jar:lib/io.fabric8.openshift-model-console-5.10.1.jar:lib/io.fabric8.openshift-model-machine-5.10.1.jar:lib/org.slf4j.slf4j-api-1.7.25.jar:lib/org.latencyutils.LatencyUtils-2.0.3.jar:lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.13.0.jar:lib/io.netty.netty-tcnative-classes-2.0.46.Final.jar:lib/io.netty.netty-transport-4.1.71.Final.jar:lib/io.micrometer.micrometer-registry-prometheus-1.3.1.jar:lib/io.fabric8.kubernetes-model-policy-5.10.1.jar:lib/io.fabric8.kubernetes-model-rbac-5.10.1.jar
    STRIMZI_DEFAULT_TLS_SIDECAR_CRUISE_CONTROL_IMAGE: quay.io/strimzi/kafka:latest-kafka-3.0.0
    STRIMZI_DEFAULT_CRUISE_CONTROL_IMAGE: quay.io/strimzi/kafka:latest-kafka-3.0.0
    TINI_VERSION: v0.19.0
    STRIMZI_OPERATION_TIMEOUT_MS: 300000
    KUBERNETES_PORT_443_TCP_ADDR: 10.96.0.1
    STRIMZI_KAFKA_MIRROR_MAKER_2_IMAGES: 2.8.0=quay.io/strimzi/kafka:latest-kafka-2.8.0
2.8.1=quay.io/strimzi/kafka:latest-kafka-2.8.1
3.0.0=quay.io/strimzi/kafka:latest-kafka-3.0.0
    KUBERNETES_PORT_443_TCP_PROTO: tcp
    STRIMZI_DEFAULT_USER_OPERATOR_IMAGE: quay.io/strimzi/operator:latest
    KUBERNETES_SERVICE_PORT: 443
    STRIMZI_DEFAULT_KAFKA_EXPORTER_IMAGE: quay.io/strimzi/kafka:latest-kafka-3.0.0
    TINI_SHA256_ARM64: 07952557df20bfd2a95f9bef198b445e006171969499a1d361bd9e6f8e5e0e81
    STRIMZI_DEFAULT_KAFKA_INIT_IMAGE: quay.io/strimzi/operator:latest
    TINI_SHA256_PPC64LE: 3f658420974768e40810001a038c29d003728c5fe86da211cff5059e48cfdfde
    HOSTNAME: strimzi-cluster-operator-5ffb58cf4c-5b7bt
    STRIMZI_KAFKA_CONNECT_IMAGES: 2.8.0=quay.io/strimzi/kafka:latest-kafka-2.8.0
2.8.1=quay.io/strimzi/kafka:latest-kafka-2.8.1
3.0.0=quay.io/strimzi/kafka:latest-kafka-3.0.0
    STRIMZI_KAFKA_IMAGES: 2.8.0=quay.io/strimzi/kafka:latest-kafka-2.8.0
2.8.1=quay.io/strimzi/kafka:latest-kafka-2.8.1
3.0.0=quay.io/strimzi/kafka:latest-kafka-3.0.0
    POSTGRES_PORT_5432_TCP_ADDR: 10.111.159.162
    KUBERNETES_PORT_443_TCP_PORT: 443
    STRIMZI_DEFAULT_TLS_SIDECAR_ENTITY_OPERATOR_IMAGE: quay.io/strimzi/kafka:latest-kafka-3.0.0
    HOME: /home/strimzi
    MALLOC_ARENA_MAX: 2
    STRIMZI_OPERATOR_NAMESPACE: default
2021-12-10 19:17:57 INFO  ClusterOperator:79 - Creating ClusterOperator for namespace default
2021-12-10 19:17:57 INFO  ClusterOperator:94 - Starting ClusterOperator for namespace default
2021-12-10 19:17:57 WARN  VersionUsageUtils:60 - The client is using resource type 'kafkas' with unstable version 'v1beta2'
2021-12-10 19:17:57 ERROR Main:154 - Cluster Operator verticle in namespace default failed to start
io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: GET at: https://10.96.0.1/apis/kafka.strimzi.io/v1beta2/namespaces/default/kafkas. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. kafkas.kafka.strimzi.io is forbidden: User "system:serviceaccount:default:strimzi-cluster-operator" cannot list resource "kafkas" in API group "kafka.strimzi.io" in the namespace "default".
    at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:697) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:676) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.base.OperationSupport.assertResponseCode(OperationSupport.java:627) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:566) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:527) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:510) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.base.BaseOperation.listRequestHelper(BaseOperation.java:140) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:422) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:411) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:91) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.informers.cache.Reflector.getList(Reflector.java:53) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.informers.cache.Reflector.listSyncAndWatch(Reflector.java:77) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.informers.impl.DefaultSharedIndexInformer.run(DefaultSharedIndexInformer.java:146) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.base.BaseOperation.inform(BaseOperation.java:954) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.fabric8.kubernetes.client.dsl.Informable.inform(Informable.java:52) ~[io.fabric8.kubernetes-client-5.10.1.jar:?]
    at io.strimzi.operator.common.operator.resource.AbstractResourceOperator.informer(AbstractResourceOperator.java:475) ~[io.strimzi.operator-common-0.27.0-SNAPSHOT.jar:0.27.0-SNAPSHOT[]
    at io.strimzi.operator.cluster.operator.assembly.StrimziPodSetController.<init>(StrimziPodSetController.java:90) ~[io.strimzi.cluster-operator-0.27.0-SNAPSHOT.jar:0.27.0-SNAPSHOT[]
    at io.strimzi.operator.cluster.ClusterOperator.start(ClusterOperator.java:99) ~[io.strimzi.cluster-operator-0.27.0-SNAPSHOT.jar:0.27.0-SNAPSHOT[]
    at io.vertx.core.impl.DeploymentManager.lambda$doDeploy$5(DeploymentManager.java:196) ~[io.vertx.vertx-core-4.2.1.jar:4.2.1[]
    at io.vertx.core.impl.AbstractContext.dispatch(AbstractContext.java:100) ~[io.vertx.vertx-core-4.2.1.jar:4.2.1[]
    at io.vertx.core.impl.AbstractContext.dispatch(AbstractContext.java:63) ~[io.vertx.vertx-core-4.2.1.jar:4.2.1[]
    at io.vertx.core.impl.EventLoopContext.lambda$runOnContext$0(EventLoopContext.java:38) ~[io.vertx.vertx-core-4.2.1.jar:4.2.1[]
    at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) [io.netty.netty-common-4.1.71.Final.jar:4.1.71.Final[]
    at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:469) [io.netty.netty-common-4.1.71.Final.jar:4.1.71.Final[]
    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:503) [io.netty.netty-transport-4.1.71.Final.jar:4.1.71.Final[]
    at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) [io.netty.netty-common-4.1.71.Final.jar:4.1.71.Final[]
    at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [io.netty.netty-common-4.1.71.Final.jar:4.1.71.Final[]
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty.netty-common-4.1.71.Final.jar:4.1.71.Final[]
    at java.lang.Thread.run(Thread.java:829) [?:?]

[scholzj]

You need to adjust the installation files for the namespace you are using -> specifically the RoleBindings and ClusterRoleBindings. There are some more details in the docs about how to do it. Sorry, I could have mentioned it before.

[fabulias]

Hi, I was able to run Kafka following the documentation, I just changed the namespace and all works fine, my question is... is this an issue that needs to be reported and fixed for M1?

many thanks @scholzj

[scholzj]

You mean the namespace change? No, that is expected and is covered by the documentation (https://strimzi.io/docs/operators/latest/deploying.html#cluster-operator-str). That is not special for M1. When you installed it originally using the https://strimzi.io/install/latest?namespace=default URL, the namespace changes are done already on the webserver, so you didn't had to do it. But for using the files directly from the main branch you always have to do it. So that is what made the difference I guess.

[fabulias]

yep, I've changed the namespace like in the doc. But if I change the namespace and run from kubectl on minikube it works. It's strange @scholzj because I've tried with the URLs and it didn't work properly. Because of that, I asked you if it's necessary to create an issue.

many thanks!