ELK stack VM with Vagrant and Puppet including the Movies100k rating dataset by Movielens.
You need the following tools:
- Ruby 2.x
- Vagrant 1.8.6
- VirtualBox 5.1.6
- bundler
The VM is set up to install the following tools / frameworks.
- Elasticsearch 2.3.0 with plugin kopf
- Logstash 2.3
- Kibana 4.5.0
Set up the box from inside the vagrant folder, this requires a recent Ruby. First all gems are installed, then all puppet modules and finally the box is provisioned.
The Vagrant setup also requires a few plugins, landrush and vbguest (only when using VirtualBox provider).
$ vagrant plugin install landrush
$ vagrant plugin install vagrant-vbguest # only with Virtualbox
To install all gems and set up Puppet run:
$ cd vagrant
$ bundle install
$ librarian-puppet install
$ vagrant up --provider virtualbox
After provisioning succeeds log into the box
$ vagrant ssh
The kopf plugin offers a web interface to the Elasticsearch cluster and is available at http://elastic.dev:9200/_plugin/kopf/ and via the IP of the VM, http://172.17.1.22:9200/_plugin/kopf/. The former URL is available via the landrush vagrant plugin.
Kibana is installed into the folder /usr/share/kibana/kibana-4.5.0-linux-x64/.
It should run already and is available at url http://localhost:5601 inside the VM. To
access Kibana from the host access http://172.17.1.22:5601.
To install Marvel follow the steps in the Get Started Guide.
There is a gem that can be used to install a data set, the Movielens data set by Grouplens that offers data from their movie recommendation service. For more information on how to install and use this data set check this Readme!.