Comment by mikeshi42

6 months ago

This is really helpful feedback, a few notes:

- Reorder columns: You should be able to do so by modifying the order of the SELECT statement at the top.

- Wrapping: totally agree - this is something we're adding in, it's on the near term todos.

- Pin fields: you're totally right, you can pin values but that doesn't prioritize the filter in general. I'm getting this one in the queue.

- Time picker: I hear you with Google Cloud's time picker, they did indeed make a really nice one. Though I'm curious to hear more about the breakdown, is it wanting to customize how that chart is grouped beyond log level?

- Autocomplete: We had a regression if you're on v2.0.0 which is what I suspect you're hitting. If you're on v2.0.1 lucene should have field value autocomplete. We don't have it yet for SQL.

- Live View: Can you clarify what is scrolling? Or is this about disabling live?

- Chart View: I just tried really quick and it seems okay to me, do you mind sharing more details?

- Sidebar: Is this related to field popularity to pin fields or something else?

This feedback is all super helpful - you can probably tell we're still early in building out the perfect experience. I'd love it if we could dive in deeper either on our discord (https://hyperdx.io/discord) or email: michael.shi@clickhouse.com. Either way this has been exceptionally helpful :)

Thanks for the reply. I'll probably show up on Discord eventually!

- Reordering is something that should be possible in the UI, not just by rewriting the query. Typically when I look at logs, I rapidly iterate on my view, adding columns, removing columns, rearranging them so I can see certain things side by side. This process should be zippy and friction-free.

- Breakdown: Here is an example from Kibana: https://imgur.com/Dkz6j9K. You can make the timeline display a stacked bar chart by any dimension.

- Autocomplete:

- Live view: Maybe I ran into a bug when I ran it locally; if I enabled the live tail mode and then scrolled down, then after about 2 seconds the whole page would scroll to the top even though nothing new had come in. When I try your live demo now, I see that it disables the live view when I scroll. I would argue that this is also bad UX, as it requires me to click "Resume" again. It should at least resume the mode if I scroll back up.

- Chart view: Maybe I was running into another bug that got fixed. I started latest HyperDX in Docker Compose and can't reproduce it now.

I did run into more chart bugs: Drag-to-zoom causes text to be selected, and when I zoom, the X axis range doesn't exactly match what I zoomed into, I.e. if I select from the start to the end of a curve, I expect the zoomed-in view to start and end at the same place, unless something funky is being done to the rounding of each X point. I have a video here: https://imgur.com/p6XOZ6U. [Edit: It is about granularity. I see the zoom is correct, it's just that your auto-granularity is very aggressive: https://imgur.com/C3TarFo. I've never seen this with Grafana, which bases its calculated time interval on the number of horizontally viewable data points, i.e. how many pixels wide the chart view is. Maybe an idea you should steal?]

For some reason the chart is working better for me now, but I would still argue that you're miles and miles behind Kibana. Kibana has a number of visualizations (line, bar, stacked bar, area, table, etc.; line smoothing of the kind you do is often not desirable, and a staircase is often better), and supports different aggregations such as group by top values: One thing I do constantly is to break a chart down by top K values. For example, a stacked bar chart of sum(duration) grouped by customer ID can be a very nice visualization.

I do like how HyperDX has a filter for every data series, which Kibana hides behind a convoluted UI.

- Sidebar: Yes, I suppose so!

Another thing I thought of was the filters in the sidebar. Seeing "ResourceAttributes['foo']" isn't so nice UX, when most of the fields are resource attributes, and they typically get truncated horizontally. From your demo: https://imgur.com/a/69lD3t5.