Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

track inner vs outer latencies #345

Open
brayniac opened this issue Oct 8, 2021 · 0 comments
Open

track inner vs outer latencies #345

brayniac opened this issue Oct 8, 2021 · 0 comments
Assignees

Comments

@brayniac
Copy link
Contributor

brayniac commented Oct 8, 2021

In #342 we introduce server side latency measurements that capture the end-to-end latency within the server. Per comment on that PR, it would be interesting to track latency within the storage thread. This would provide better insight into the cause of latency.

Copying comment from @thinkingfish in that PR:

If we start breaking down the processing time at different stages and/or on different threads, we should also consider the "outer" duration vs. "inner" duration. The "outer" duration could be the time it takes from writing a request to the (storage) queue to finishing reading the corresponding response; the "inner" duration is what you are measuring here. This will give us a sense of processing latency versus queuing latency. The former indicates a slow step on the storage thread, the latter indicates when we need to consider scale out the storage thread (through partitioning, etc).

This will probably require a change in the type of content passed through the queue, instead of a simple Request object, we will need a (Request, timestamp) tuple.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant