How we know what we say
What Hyuge's confidence labels mean, where people make the call, how corrections work, and how results will be measured. Technology status: Production: released and in use today. Alpha: core functionality complete and in internal testing; not yet released. Pre-alpha: in active development; not yet feature-complete.
Confidence labels
What each label means
- High confidence
- The evidence is strong and consistent. It can support a decision, which a person still makes.
- Worth checking
- There is a signal, but it is not settled. A person should look at the data behind it before acting.
- Not enough information
- The system can't answer yet. It says what information is missing instead of guessing.
People make the call
Where human judgment decides
- Choosing the question and the measure of success, before any work starts.
- Accepting, rejecting or changing every result before it is acted on.
- Correcting a result. The correction is recorded with the name of the person who made it.
- Deciding what to publish, and whether anything must be withheld.
The convention
Solid means observed. Dashed means inferred.
In every chart we publish, a solid line is data that was observed and a dashed line is what the system infers from it. A small legend always says so.
Corrections
When we get something wrong
- Who is told
- Everyone who received the result, and anyone who relied on it that we know of.
- How quickly
- Within [X] business days of finding the error.
- How it's reviewed
- A second person reviews the corrected finding before it is reissued. Published corrections stay visible next to the original.
Measuring results
How we'll measure results before results exist
We have no results to publish yet. When we do, each will be stated in three parts, agreed before the work starts.
- Question
- What we're trying to find out, in one sentence.
- Baseline
- How the question is answered today, without Hyuge.
- Measure
- How we'll compare the two, and what counts as better.