Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

k6 v1: implement new end-of-test summary proposal #4052

Open
oleiade opened this issue Nov 13, 2024 · 0 comments
Open

k6 v1: implement new end-of-test summary proposal #4052

oleiade opened this issue Nov 13, 2024 · 0 comments
Assignees
Labels

Comments

@oleiade
Copy link
Member

oleiade commented Nov 13, 2024

Summary

We are revamping the end-of-test summary to enhance usability and ensure users receive relevant, structured results more easily.

This update aims to provide clearer insights by rationalising the metrics displayed, improving visual clarity, and adding commonly requested features. By focusing on structure and prioritisation, we aim to make interpreting k6’s end-of-test summary more intuitive and meaningful for users of all levels.

While we’re striving to make these changes as seamless as possible, we acknowledge that automations relying on the current summary format may need adjustment.

Objectives & Key Changes

1. Compact and Extended View Options
• Default (Compact) Mode: A streamlined view to support quick interpretation of essential metrics.
• Extended Mode: An in-depth view providing additional detail, accessible on demand.
2. Rationalise Metric Results Displayed (compact + extended)
• Selective Metrics Display: Reduce default metrics to include only those relevant to the majority of users, minimizing noise and improving focus.
• Prioritised Ordering: Arrange metrics to highlight data defined by users or generated by specific user-scripted code.
3. Enhance Visual Structure (compact + extended)
• Dedicated Visual Blocks: Segment results by feature/protocol (e.g., HTTP block, Browser block, Execution block) to aid quick interpretation.
• Explicit Check Handling: Refine check display to provide clearer, more explicit outputs, addressing previous feedback about implicit or unclear check results.
4. Support for Groups and Scenarios (extended only)
• Nested Subsections: Introduce nested subsections for groups and scenarios, addressing one of the most common user requests.
• Indentation for Clarity: Nested groups will display with clear indentation to visually distinguish hierarchy and grouping.

Impact on Users

While this update will bring significant benefits, automations and workflows that depend on the current summary format may require updates. We recognize this change may break some existing setups but believe the improvements will provide greater long-term usability.

Scripts that override the handleSummary function are expected to remain functional and will see no change to their existing behaviour.

Overview

For illustration purposes only: might differ from the end result

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants