Support integration/e2e tests on local machines

[hklai]

Context: https://goo.gl/2DPP5o

Figure out and document the steps to run integration/e2e tests using a local cluster (e.g. using Docker on mac/windows, and possibly minikube on linux similar to circleci), instead of having to set up GCP and GKE.

[louiscryan]

/cc @louiscryan

[ozevren]

/cc @ozevren

[hklai]

Discussed a few options today and @louiscryan suggested starting with https://github.com/flix-tech/vagrant-kubernetes, which is an easier solution to templatise.

Current plan:
@kimikowang will try it out on mac, and @JimmyCYJ will try it out on linux.
In the mean time @gargnupur is going to figure out setting up local docker registry.

We will regroup next Monday to share findings.

[kimikowang]

I am testing the vagrant vm on Mac, but got stuck at the kube-dns brought-up loop in vg-01-repartioton.sh. @JimmyCYJ How is your test on Linux? Does everything work well?

[kimikowang]

/cc @linsun

[JimmyCYJ]

I have the same issue, and I tried several fixes but could not solve it.

…

On Mon, Apr 2, 2018 at 10:38 AM, Zijun Wang ***@***.***> wrote: I am testing the vagrant vm on Mac, but got stuck at the kube-dns brought-up loop in vg-01-repartioton.sh. @JimmyCYJ <https://github.com/JimmyCYJ> How is your test on Linux? Does everything work well? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#4536 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AbOdjBAFBzRzmVWM-EkiRZfOh1yiKdzWks5tkmIzgaJpZM4S8CEz> .

[JimmyCYJ]

@kimikowang could you try this example?
https://github.com/pires/kubernetes-vagrant-coreos-cluster

It works on my personal desktop (Ubuntu 16.04). I simply run sudo USE_KUBE_UI=true vagrant up.
I get some issues when I run this example in my office workstation, and I am trying to fix.
I am not sure if it works on Mac.

[kimikowang]

Thanks @JimmyCYJ , let me try to give it a shot.

[JimmyCYJ]

@kimikowang for https://github.com/flix-tech/vagrant-kubernetes, I tried 1.10.0 and 1.9.0 on Ubuntu 16.04, and they failed at different steps.

[kimikowang]

@JimmyCYJ I have no luck in bring up the coreos vm on Mac. It stops at booting stage.

[JimmyCYJ]

@kimikowang There is a trouble shooting section in https://github.com/pires/kubernetes-vagrant-coreos-cluster#troubleshooting. Does it help?

[kimikowang]

@JimmyCYJ Unfortunately no, the problem is at the ssh process to the vm. This seems to be a well-known issue for vagrant, and it seems to be problems with VirtualBox or MacOS. Most of people solved the problem simply by upgrading VB or Mac to latest version. I did that already, but no help.

[JimmyCYJ]

@kimikowang Could you copy and paste parts of the output from your terminal?

[kimikowang]

Just created an issue under the flux-tech repo: flix-tech/vagrant-kubernetes#12

[JimmyCYJ]

Filed an issue under pires/kubernetes-vagrant-coreos-cluster: pires/kubernetes-vagrant-coreos-cluster#293

[JimmyCYJ]

Filed an issue on missing .kube/config file.
flix-tech/vagrant-kubernetes#13

[ldemailly]

see #593 (comment) for issues with the previous incantation of the process (though then at least there was a way, albeit undocumented, to run 1 e2e tests multiple times; I'm looking forward to getting back to oct17 state and better)

[gargnupur]

@ldemailly : our current test setup looks like should not suffer from issues mentioned in https://github.com/istio/istio/blob/vagrant-kubernetes-istio/vagrant-kubernetes-istio/RunTestOnHost/README.md
You should be able to run 1 e2e test multiple times..

[ldemailly]

it wasn't k8s fault but mostly ours

[stale]

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 2 weeks unless it is tagged "help wanted" or other activity occurs. Thank you for your contributions.

[gargnupur]

This is completed, so closing...

[hklai]

To summarize, we have provided two options to run E2E tests on dev machines. The instructions are included in the revamped E2E testing guide at https://github.com/istio/istio/tree/master/tests/e2e.

If you encounter any problem, feel free to ping this issue or contact @gargnupur and me directly.