Add a Pip-based CI testing for inference code, with Colab dependencies.

Add a Pip-based CI testing for inference code, with Colab dependencies. #2818