Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [validation]

The process of assessing whether the results of an analysis are likely to hold outside of the original research setting. DO NOT use this tag for discussing 'validity' of a measurement or instrument (such as that it measures what it purports to), use [validity] tag instead.

References: Wikipedia and CV Meta's thread

866 questions
11
votes
3 answers

What is a consistency check?

I was asked such a question as "Did you do any consistency check in your daily work?" during a phone interview for a Biostatistician position. I don't know what to answer. Any information is appreciated.
baisong
  • 111
7
votes
4 answers

What is the meaning of orthogonal in validation testing?

I have heard the term "orthogonal * validation" used recently. It was used in the context of experimental platform testing. What does this mean? I cannot find anything on it in literature or Wikipedia.
user1447630
  • 1,059
2
votes
0 answers

Validation of flow cytometer (Facs Canto II)

I was just wondering if 3 biological samples would be statiscally significant for both precision testing and calibration verification. Precision: to check whether instrument is able to give consistent results when a sample is being run…
Anne
  • 21
  • 1
1
vote
1 answer

Validation supervised model

This is my first approact to Machine Learning. I want to know if there are other methods besides train, validation and test. Thanks.
Lila Riccia
  • 13
1
vote
0 answers

Can test results be considered reliable if it is not possible to have true out of sample validation data set?

We are working with an anonymized dataset (similar to commercially available consumer data) to create a binary classification based model. We have data for entire US population that is commercially available. We constructed our model using standard…
Joseph Robertson
  • 11
1
vote
0 answers

How to validate created model

Recently I've created a similarity measure specifically designed for high dimensional time series data that contain a low number of observation (measure) occurances. Within this, the equation is meant to accurately assess the relationship between…
Aaron43
  • 11
1
vote
0 answers

Which analysis should I use to assess convergent validity?

I would need help on which statistical analysis I should use to evaluate convergent validity. We have translated an instrument (Likert type) and did test retest along with other instruments to measure validity of the translated instruments? We are…
Jane Zhu
  • 11
0
votes
0 answers

Options when sample doesn't fit any distribution and doesn't pass normality screening?

I have a sample of 30 data points, that I am unable to find a distribution fit for. The goal of my analysis is to assess process capability and get an accurate Ppk. This is one output of a process I am validating. Unable to fit anything, I observed…
tombyrne412
  • 1
0
votes
1 answer

Hold out validation. Exactly what is left out?

I'm studying validation and I've seen multiple examples of hold out validation. Some will hold the tail of the data, while others will leave out $n$ random points. I assume it has to do with whether you're testing for interpolation or extrapolation,…
George
  • 1
0
votes
1 answer

How much similar should a derivation and validation datasets be?

I've recently developed a risk prediction model to predict risk of coronary heart disease. The model was developed in a cohort of adults (>45 yrs old)followed for a median of 15 years. It was developed using all observations in the cohort. Now, I…
user109294
  • 11