To help assess and evaluate HMIs, I will introduce a new framework in this article.
Neurotechnology is complicated. Like most deep tech, it’s hard to learn, hard to understand, hard to see how the big picture fits together, hard to validate, and hard to apply.
I think one big reason that it is so complicated is because we haven’t created frameworks and language to appropriately group together or simplify some of these big ideas (we explored this further in a previous article). So, I will be introducing a new framework in this article.
Current Discussions Are Often Confusing
The confusion in current discussions is particularly evident when we compare different technologies. There are so many factors to consider that assessing the (already complicated) tech can require a complicated background discussion.
For instance, when I talk to veterans in the field (including academics, investors, and builders), we often first discuss which factors matter to us and what our reference points are, touching on comfort, portability, cost, signal-to-noise ratio, etc. We may avoid this by focusing our discussion on a use case with inherent factor constraints (e.g., diagnostics focus the conversation primarily on medical requirements), however, even these chats require further information and a strong background.
With novices, this becomes even more arduous, as we need to introduce the different factors which *could be* relevant or important. Throughout the discussion, every time I try to bundle the factors or reference back to them, I have to reference “the group of factors we discussed earlier”, list them out individually, or use equally obtuse phrasing.
What Factors Matter?
To demonstrate the relevant factors, I often compare differences in currently available tech through the image below, which intuitively demonstrates the concepts of Quality vs Adoptability.
Often, I use diagnosing Parkinson’s Disease (PD) as a use case of reference to highlight the diverse capabilities and advantages of different devices. Particularly, I discuss the likelihood of each device becoming a go-to diagnostic method. What often surprises people is that both ends of the spectrum, from high-accuracy full-scalp medical devices to mass-market smart watches, can contribute to PD diagnostics (shout out to Rune Labs).
Even though these technologies can both be used in PD diagnostics, there are obviously quite a few differences between the technologies. This example highlights that the higher accuracy from a full medical device may not win against a mass-market device which can flag earlier diagnostics automatically without any of the resources needed for the in-hospital diagnostic. Even in diagnostics, the highest channel and SNR may not be the only (or best) solution. Sometimes, the convenience and early detection capabilities of mass-market devices can be more advantageous.
By now, I hope it starts to seem clearer that for each solution, there is a large array of important factors that we must understand, consider, and balance. We need a systemic way to think about these different factors, and evaluate these technologies.
Therefore, I propose a new framework: the HMI (Human-Machine Interface) Spectrum.
The HMI Spectrum
This spectrum aims to put the different factors important in neurotech on a single spectrum. This primarily focuses on a tech’s validity, ability to commercialise the solution, and impact on the end user.
In determining where a technology stands, I consider these questions:
The usefulness of the data collected: What insights are we gaining? Can this information genuinely improve our health, productivity, or well-being?
The methods of data collection: How do these devices gather information? Is it a seamless integration into our daily routines, or does it require a more invasive approach?
The quality of the data: In the trade-off between convenience and precision, where does each technology stand? How do we balance the need for high-quality, actionable data with the practicalities of everyday life?
The comparison with other data collection methods: When we place these technologies side by side, what do we learn about their strengths, weaknesses, and unique contributions to our understanding of the human condition?
The scalability of the solution: How many people can this solution help? How mass-market appropriate is this solution? What is the total size of the audience that could use this solution?
To help illustrate this a bit better, let’s look at the HMI Spectrum applied to a common question: how clinical vs mass market appropriate is a device? One can intuitively think of some factors which may be important to making a device easily usable by a lot of people, vs a device which would be used e.g., for diagnostics in a hospital. This is a great example of a question where our Spectrum would be useful to score and rank different devices.
Lets Include Some Examples!
Expanding from this, we can look at how different current tech *may* fit into the spectrum (obviously depends on the specific device and a lot of other things). We will dive more into examples in an upcoming post, where we will walk through how we placed some of these systems according to the above questions.
This spectrum is still in its early days, but I think solves a fundamental need of giving us a shorthand to describe these important factors in tech assessment and comparison.
What important factors do you think I am missing? Where do you think the HMI Spectrum could be useful?
My name is Abby Holland. I am a Product Owner at IDUN Technologies, a consumer neurotech company building EEG-augmented headphones. I have been building in the space since 2018, and have a background in BioMechanical Engineering and Neurological Disorders. Follow me on Twitter @holland_neuro for realtime commentary on new neurotech developments.
Great analysis Abby!
In your bullets, I'm not quite sure I can discern the difference between "usefulness" and "quality" but will keep thinking about it. Maybe I'm conflating what you later refer to as 'clinical applicability' and those subpoints with "quality." To your broader point (and your terrific last article too) I 100% agree there is a huge opportunity to smooth out language, terminology, and jargon in neurotech. You're doing important work with all of this thinking.
I think the HMI Spectrum is a great framework to build on. To your closing question: I think there's a strong opportunity to use this framework to educate clinical research organizations and clinical trial sponsors on neurotechnology's potential.
My opinion of CROs is that they have grown too big to fail as an incumbent part of the multi-billion dollar CNS research landscape. They generally embrace their own tech, and have internalized use of paper-based measures that are frictionless to the status quo (easy to report, easy to get clinical consensus) but which lock clinical human/brain health research into a completely outmoded paradigm (subjective, inconsistent, unreliable). I've b*tched about this in various articles before so I'll spare you the soapbox rant...but tldr let's gooo with novel neurotech adoption! :)
This is all changing of course - Alto, Cognito, Beacon, Cumulus, Kernel, Ceretype, many others, but I think the HMI spectrum could evolve to double as a "biomarker platform map" to help life sciences leaders reimagine outcomes measures planning and make smart investments in the next generation of research tools. The big opportunity for this is to bring an objective, vendor-agnostic lens to understand the technology via bird's eye view.
There's a nifty paper about the bigger strategy into which I think your HMI spectrum would layer in perfectly. I can connect you with one of the authors if that's ever helpful. Including that and a quick riff I posted on Linkedin, below.
Thanks for your writing and analysis - Really enjoying your articles. Keep up the great work!
Paper: Methods for Neuroscience Drug Development: Guidance on Standardization of the Process for Defining Clinical Outcome Strategies in Clinical Trials: https://www.sciencedirect.com/science/article/pii/S0924977X24000440?via%3Dihub
Rough Riff for some more context: https://www.linkedin.com/posts/ndrao_neuroscience-neurotech-neuroimaging-activity-7193676872008802304-Mbua?
Interesting read, thank you. As a lateral thinker this brought up the notions of neuro rights, ethical considerations, e-waste considering hardware and associated sustainability, perhaps the interplay between quality and adoptability can also incorporate local and cultural nuances/preference, the adaptability of new solutions or maybe "currently fringe solutions" who have the potential to be viable later(basically future proofing), spectrum's integration into hardware and software stack.
P.s
A visual "cheat sheet" always go a long way for broader outreach.
Have a great rest of the week