Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Validate recommendations with actual deployments #170

Open
inz opened this issue Oct 27, 2016 · 0 comments
Open

Validate recommendations with actual deployments #170

inz opened this issue Oct 27, 2016 · 0 comments
Assignees

Comments

@inz
Copy link
Collaborator

inz commented Oct 27, 2016

To somewhat validate the recommendations we currently generate, we should actually deploy an application to (recommended) cloud infrastructure and compare the results with the generated predictions.

I suggest we deploy the Cloud Stove Rails app (without frontend to make it simpler), seed the db with some data (maybe test fixtures) and load test it. The load test requests can probably be derived from current integration tests.

For the actual load test, we can:

A guide for load testing Ruby apps with Ruby-JMeter is available from flood at https://blog.flood.io/load-testing-a-restful-api-with-ruby-jmeter/

Naturally, we will use CWB to deploy these load tests. Deploying the benchmark driver using CWB with JMeter should already be implemented (since this was part of Christian Davatz's master's thesis).

In addition to the Cloud Stove Rails app, we would ideally also deploy a microservices app like the Socks Shop, but this can probably wait until we have archetypes for microservices.

@inz inz changed the title Validate Recommendations with actual deployments Validate recommendations with actual deployments Oct 27, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants