← Himanshu Kalra

UX Research Case Study

The most important column wasn't on the list

A security console framed a design choice as which of 27 fields to show by default. The field analysts reached for most was not among the 27. What they said and what they did pointed to the same answer.

OutcomeCut 27 candidate columns to 8 evidence-backed defaults, surfaced a missing priority-zero field before build, and reset the hash and timeline decisions.

Enterprise EDR + SIEM alerting console 5 SOC analysts 4 organizations Card sort + interviews + 1,880 telemetry events Mixed methods, qual + quant Lead researcher

The console surfaced endpoint detection data directly, which meant it could show far more per alert than an analyst could read at a glance. Engineering had 27 fields available and one question: which belong in the default view, and which stay one click away.

Framed that way it reads as a preference call. In practice it was a question about what analysts reach for in the middle of an investigation, and a preference stated in a planning meeting is a poor guide to that. So the study was built to answer it with behaviour, not opinion.

Three sources ran in parallel so no single one had to carry the answer. A card sort put all 27 fields in front of each analyst to rank. Workflow interviews traced the order analysts actually move through during an investigation, with a first-mention pass to catch the fields that came up unprompted. And 30 days of product telemetry showed what analysts clicked into on the live console. Interviews say what people believe they need; telemetry shows what they do. Where the two agree, a default is safe to set.

The panel was five SOC analysts across four organizations: an internal SOC, a financial-services team, a retail team, and one more enterprise SOC. Five is light for interviews, so the telemetry was not a bonus. It was the backstop that let five voices stand on 1,880 real events.

Scale was handled with tooling. Transcript coding and the telemetry cross-reference were run through an AI-assisted synthesis pass and then validated by hand, which compressed the coding phase enough to land the recommendations inside the sprint that needed them rather than after it.

Consensus cut 27 fields to 8

Analysts did not want all 27, and they did not want a minimal five either. The card sort and the scan-order interviews converged on the same eight fields, and those eight lined up with the triage sequence analysts described out loud: severity to decide what matters, a timestamp for context, hostname to place it, user for attribution, then process name, process path, command line, and activity to see what actually ran.

I go host name, then process path, process name, command line, and then into the parent.a financial-services analyst, describing a real investigation

The eight fields were not the interesting part on their own. The order was. Arranging the defaults to match the scan path meant an analyst could triage top to bottom without reaching for a menu, and that ordering is what the recommendation encoded.

The decisive field was never offered

One field kept surfacing in the interviews that was nowhere in the 27. Parent process. Four of five analysts named it unprompted while walking through real investigations, because a process without its parent has no context. The same command line is routine under one parent and an attack under another.

The field analysts needed most was one the list never offered.

Then the telemetry settled it. Of 1,880 detail-view events, parent process fields drew 597, or 31.8%, the largest single investigation category, ahead of users and threats combined. A field missing from the design's own list of options was the most-clicked thing in the live product. A 57.9% remainder was spread across mixed metadata, which said something too: analysts pull a lot of context during an investigation, so the answer was not to hide more.

You can't understand context without knowing what the parent process is.a financial-services analyst

Two methods, run separately, agreed. What analysts said they needed matched what they actually did. That convergence turned a missing field from one analyst's opinion into a priority-zero requirement the team could act on with confidence.

The same data demoted what no one touched

The evidence that promoted parent process pushed other fields down. Six of the 27 - process integrity, artifact, hash ID, version, rank, and score - drew no recognition in interviews and near-zero telemetry. Analysts either could not say what they held or had never used them. One pulled up an integrity field live and found every value set to zero.

I can see the integrity level, but the values are all zero. I've never used it in a case.an internal SOC analyst

Two smaller decisions fell out of the same data. Analysts used SHA-256 for external reputation lookups and treated MD5 as legacy clutter, so the default kept SHA-256 and dropped MD5. And for the incident timeline, all five preferred a filterable list over a node-graph, and four of five preferred a horizontal layout, because a graph forced one node open at a time when the job is comparing several at once.

The study moved five decisions

  • The default view was set to the eight consensus columns, ordered to the triage scan path rather than the data model.
  • Parent process name and parent command line were added as priority-zero, having been absent from the original 27.
  • MD5 was dropped from the default in favour of SHA-256, the hash analysts actually pivot on.
  • The timeline defaulted to a horizontal filterable list, with the node-graph demoted to an option.
  • Six unrecognized fields went to a labelling-and-removal audit instead of shipping by default.

P0

Add parent process fields; set the eight-column default.

P1

SHA-256 over MD5; horizontal list timeline.

P2

Audit the six unknown fields for relabel or removal.

Five analysts is a thin interview base, and the telemetry is what made it safe to act on. The next round would recruit a dedicated junior (L1) cohort, whose triage habits differ from the seniors who filled this panel, and A/B the eight-column default against the current view to confirm the scan-order gain in production rather than in stated preference.

When a decision is framed as choosing from a fixed list, the research question hiding inside it is whether the right answer is on the list at all. Asking what people need and watching what they do, together, is how the missing option shows up. Either method alone would have walked past it.