[Question] How to get runtime stats in serve mode?

[rankaiyx]

❓ General Questions

How to know the generation speed in serve mode?
Can it display relevant information in the console like chat mode?

[rankaiyx]

I noticed this endpoint in the following script, but it seems to report "Runtime stats: {'detail':'Not Found'}".

https://raw.githubusercontent.com/mlc-ai/mlc-llm/refs/heads/main/examples/rest/python/sample_client.py

# Get the latest runtime stats
r = requests.get("http://127.0.0.1:8000/stats")
print(f"{color.BOLD}Runtime stats:{color.END} {r.json()}\n")

Has it been abandoned?
Is there an enabling method or alternative method?