Participant bias.
Drop outs if people are not happy with their assignment.
Dropouts will decrease denominator (C and D if placebo) (A and B if tx)
Back
Is ABABABABAB... assignment random?
Front
No, because the allocation of the next participant is predictable
Back
What are adaptive procedures?
Front
Changing allocation probability as a study progresses
Back
When can accidental bias arise in RCT?
Front
If random procedure does not achieve balance in risk factors or prognostic covariates
Back
What are disadvantages of blocked randomization?
Front
Analysis is more complicated.
Investigator may know assignment.
Standard statistical analysis assumes simple randomization.
Back
What is the aim of RCTs that use double blinding?
Front
To try to establish efficacy of a treatment
Back
Fixed allocation randomization
Front
Assigns participant with pre-specified probability (usually equal). Probability is not altered throughout the study.
Back
When does stratified randomization work best?
Front
In small studies.
With minimal strata.
Back
Allocation concealment
Front
Not disclosing to participant or others the allocation sequence. Always feasible.
Back
When is it okay not to have equal allocation to groups?
Front
Ex. 2 to 1 to gain patient information.
This does reduce sensitivity and may indicate that one treatment is better.
Back
What is an option when it is difficult to blind an investigator?
Front
Sham intervention. May be expensive.
Back
How can simple randomization be accomplished?
Front
Through random digit tables, for example. Algorithms are used for larger studies.
Back
Triple Blinding
Front
participants, data collectors, and data analysts are blinded
Back
Single Blinding
Front
Either the patient or investigator is unaware of the treatment they are receiving. Only one.
Back
What are problems associated with sham interventions.
Front
Sometimes not ethical.
Can be costly.
Can be time consuming.
Back
Sham intervention
Front
Ex. CPAP, sham surgery, sham machines
Back
What study design is the gold standard?
Front
Randomized Control Trial
Back
Fundamental point of chapter 7
Front
A clinical trial should ideally have a double blind design in order to limit potential problems of bias during data collection and assignment. In studies where such a design is impossible, other measures to reduce potential bias are advocated
Back
When might no blinding be used?
Front
During trials that address surgery, lifestyle changes, learning techniques
Back
Is non blinding protective against concomitant treatments?
Front
Nope
Back
What are double blind studies usually restricted to?
Front
Drug and biologic trials
Back
What are the two types of adaptive procedures?
Front
1. Adjusting according to imbalance in numbers of participants or participant characteristics.
2. Adjusting based on responses of participants to previous allocation.
Back
When can selection bias arise in RCT?
Front
If allocation process is predictable
Back
What are the 3 types of fixed allocation randomization?
Front
1. Simple
2. Blocked
3. Stratified
Back
How does blocked randomization work?
Front
For each block of an even number, half are assigned to 1 treatment and the other assigned to the other. This can be based on permutations of blocks or assigned numbers order.
Back
Double Blinding
Front
Investigator/ those collecting or assessing data and patient do not know of treatment assignment.
Back
What are advantages of stratified randomization?
Front
Makes populations comparable.
Increases power.
Reduces variability.
Back
What is the appeal of non blinded studies?
Front
Investigators are more comfortable in knowing who is assigned what.
Simpler to execute.
Less expensive.
More accurately reflects clinical practice.
Back
Ethical issues with debriefing of placebo
Front
1. Patient benefiting from placebo may relapse.
2. Patient may have distrust for MD.
3. Patient may have other negative consequences.
Back
What are the advantages to single blinding?
Front
It is simple, and it may allow for better judgement of outcomes
Back
Double Dummy
Front
The use of matching placebo to ensure blinding, when all patients receive multiple formulations (drug and placebo); i.e., active tablet plus placebo liquid compared to placebo tablet and active liquid.
Back
What are the disadvantages of single blinding?
Front
Investigators may affect the outcome of the study
Back
Unblinded studies
Front
Both patient and investigator know to what a patient is assigned
Back
Inadvertent unblinding
Front
One knows what treatment is based on differences in meds, side effects, etc.
Back
Systematic error
Front
Difference between true value and what was found due to causes other than sample variability
Back
What are two common methods for baseline adaptive randomization?
Front
Coin randomization and Urn randomization
Back
When is it hard to blind an investigator?
Front
When implementation of intervention makes it obvious to which arm a participant is randomized (ex. CT v Xray).
Back
What are disadvantages to simple randomization?
Front
At any point there can be imbalance between groups.
Reduces ability to find differences in groups.
May lead to loss in credibility.
Back
What is another name for simple randomization?
Front
Complete Randomization
Back
How can an investigator bias a study?
Front
Could want good results.
Could want to give concomitant treatment.
May not believe that there was equipoise between the trial arms.
Back
How does stratified randomization work?
Front
Prognostic factors are measured. Strata are created. Randomization is performed within strata- either simple or blocked.
Back
What is the benefit of triple blinding?
Front
Results can be evaluated more objectively
Back
Randomization
Front
The process by which each participant has an equal chance of assignment to treatment or control. Used to create two or more relatively comparable study groups.
Back
What is concomitant treatment?
Front
Any non study treatment administered to participants during a trial. It may induce bias if applied unequally among groups.
Back
What are advantages of simple randomization?
Front
It is easy to implement
Back
Fundamental Point of Chapter 6
Front
Randomization leads to produce study groups with respect to known and unknown risk factors, removes investigator bias in allocation of participants, guarantees statistical tests will have valid false positive error rates
Back
Allocation bias
Front
Systematic difference between participants and how they are allocated to treatment
Back
What study design offers the best method for comparability and statistical inference
Front
RCT
Back
What are the advantages of blocked randomization?
Front
Avoids imbalance in groups.
Increase in power.
More comparable groups are produced.
Study will be okay even if recruitment is terminated early.
Back
Biased coin procedure
Front
Try to balance participants in each group based on previous assignment, without accounting for participant response
Back
Section 2
(50 cards)
What are early phase studies?
Front
Phase 1 and Phase 2 clinical trials
Back
Phase 1 Toxicity
Front
Test tolerance to new agent.
Assess what a toxic dose is.
Estimate MTD.
Back
Effects of gaming the system
Front
Can seem as beneficial intervention even in absence of actual benefit if occurring in a trial with negative outcomes.
Can fail to detect benefit of a truly beneficial intervention.
Back
Selection bias
Front
distortions that result from procedures used to select subjects and from factors that influence participation in the study
Back
Per consort statement
Front
A technique used to prevent selection bias by concealing allocation sequences from those assigning participants to intervention groups until assignment
Back
How may investigators anticipate random assignment?
Front
1. If investigator knows baseline status of participants.
2. Investigator can figure out next allocation arm because a block is too small or doesnt alternate.
Back
Central Randomization
Front
A randomization method used in multicenter trials to obtain the desired overall distribution across treatment arms. An outside 3rd party provides allocation.
Back
Phase 4 studies
Front
Broad population use and uncommon adverse events.
Effect on whole population.
Effectiveness and value in practice.
Studies done after intervention has been marketed. Designed to monitor effectiveness of the approved intervention in the general population and any adverse events with widespread use.
Can be observational or RCT
Back
What happens if those without outcome are moved form intervention to control?
Front
B to D in 2 by 2 table.
Will make denominator smaller, biasing toward the null.
Back
Phase 2 studies
Front
Doses and biomarkers, efficacy of treatment.
To evaluate if there is any biological activity or effect.
Does drug work at MTD?
Compares current control group, historical controls, or pre treated patients.
May use different doses or arms.
Have more exclusion criteria than P3 trials.
Used to decide further development of treatment.
Back
How to avoid gaming the system?
Front
Do not use sealed envelope.
Be wary of run in periods that allow participants to identify medications.
De post facto, check balance in known potential confounders between arms.
Back
Efficacy and Explanatory Trials
Front
What an intervention accomplishes in an ideal setting.
Back
Random selection
Front
Used to draw a representative sample from a target population.
Back
How can patient expectancies influence outcomes?
Front
1. When blinding fails, we do not know if the outcome is due to the treatment or due to patient expectancy.
2. Patient can make placebo have an effect, which makes treatment look ineffective.
3. Lead to different treatment responses.
Back
How can we avoid differential loss to follow up?
Front
Focus on retention and adherence
Back
Optimal randomization methods
Front
Central computer system.
Central call in system.
Back up in case systems go down.
Back
Effectiveness and pragmatic trials
Front
What intervention accomplishes in actual practice. Accounts for participants who are not fully compliant.
Back
Why do we use allocation concealment?
Front
To prevent researchers from influencing which participants are assigned to a given intervention group.
Back
Local randomization
Front
A schedule is sent to each site, the individual sites randomize themselves
Back
Are early phase studies a type of clinical trial?
Front
Yes
Back
What is a case control study?
Front
A type of retrospective observational study in which participants are selected on the basis of presence or absence of disease/event/condition of interest.
Not truly prospective.
Back
R1 calculation
Front
a/a+b
Back
Crossover trial
Front
a modification of parallel design that uses each participant at least twice
Back
Limitation of case control studies
Front
Treatment is not random, so associations are always influenced by confounders
Back
What are necessary components of clinical trials?
Front
Must employ 1 or more intervention techniques.
Should be applied to change an outcome.
Must have a control group that must be similar in relevant aspects to the treatment group at baseline so that outcomes can be attributed to treatment.
Back
What are problems that arise when implementing randomization?
Front
1. Bad method choices.
2. Design or programming error in implementation.
3. Human error in conduct.
Back
RR calculation
Front
R1/R0
Back
What is a control in a clinical trial?
Front
Best current therapies available.
No treatment.
Placebo.
Standard of care.
Back
Anecdotal case reports
Front
the weakest form of study
Back
Compensory Rx
Front
If investigator wants to give those in control arm an intervention.
i.e. prescribing another treatment
This will bias the trial by making the denominator smaller, bias toward the null. Move from C to D.
Back
Fixed randomization
Front
Uses predefined schedules to assign treatment
Back
What is population in phase 1 studies?
Front
Generally health volunteers or people who have tried other therapies.
Back
Fundamental point of chapter 1
Front
A properly planned and executed clinical trial is the best experimental technique for assessing effectiveness of interventions. Contributes to identification of possible harms.
Back
What are late phase studies?
Front
Phase 3 and Phase 4 clinical trials
Back
When are phase 1,2,3,4 studies used?
Front
Usually for pharmaceutical studies. Some studies may blend among phases.
Back
Allocation sequence
Front
The order in which participants are allocated to treatment
Back
Phase 1 studies
Front
Usually to assess drug tolerance, interaction, metabolism, toxicity.
Focus on drug activity and distribution.
Find maximum tolerated dose (MTD) by dose escalation.
Test a small amount of people (20-80ish) to determine efficacy and evaluate safety.
Back
Phase 3 studies
Front
Usefulness and safety.
Usually longer follow up (unless for chronic conditions).
Determine efficacy in large group (hundreds to thousands) by comparing intervention to other standard or experimental treatment.
Monitor adverse effects.
Back
Dynamic randomization
Front
Use baseline information on participants, require knowledge of past assignments to make new assignments
Back
Fundamental point of chapter 5
Front
Sound scientific clinical investigation almost always demands that a control group be used against which the new intervention can be compared. Randomization in the preferred way of assigning participants to control and intervention groups.
Back
Differential loss to follow up
Front
Bias that occurs when you lose follow up long term.
Back
How do blinding and allocation concealment relate?
Front
Allocation concealment involves not disclosing to participants the allocation sequence before it occurs.
Blinding involves not disclosing to participants and outcome assessors the treatment allocations after it occurs.
Back
R0 calculation
Front
c/c+d
Back
What is a clinical trial?
Front
A prospective study comparing the effects and value of interventions against a control in human beings.
Start at time 0.
Back
Can early phase studies be controlled and uncontrolled?
Front
Yes
Back
Why do we use clinical trials?
Front
It is the best method to determine effectiveness and safety.
Determine adverse events
Back
Accidental Bias
Front
When randomization fails to balance groups. Usually an issue with small sample sizes. Not usually a problem with large sample sizes.
Back
What happens if those without outcome are moved from control to intervention?
Front
D to B in 2 by 2 table.
Will make numerator larger, bias away from the null.
Back
How many people are usually in a phase 2 study
Front
A few hundred. Less than in phase 3
Back
How can participants game the system?
Front
If two sites are closely situated.
Participants who arent happy with randomization assignment may travel to other site and reenroll.
Back
Section 3
(50 cards)
Specifying your research question
Front
1.Define question in advance
2. Must be capable of being seen in all participants
3. Unless combined response, participation ends when primary response occurs
4. Response variable should be capable of unbiased assessment
5. Variable should be ascertained as completely as possible
Back
Key assumptions in equivalency/ noninferiority study
Front
1. Proper control arm must be standard treatment, not inferior.
2. Constancy in time and among participants.
3. Availability of data for prior control studies.
4. Assay sensitivity to see true difference, response must be sensitive to effects of control and intervention
Back
Crossover v Case Crossover
Front
Crossover is a clinical trial.
Case crossover is an epi study in which there is no intervention- observe participant behavior before illness and use it as a control.
Back
Strengths of historical controls
Front
All participants can receive intervention.
Participant may be more willing to enroll with treatment.
Recruitment time halved.
Back
Equivalency/ Noninferiority trials
Front
Demonstrate new intervention is not worse than a standard by a predefined margin
Back
Historical controls
Front
New intervention used in participants, results are compared to outcome in previous series of comparable participants.
Non randomized and non concurrent.
Obtained from medical charts and literature.
Back
Large Simple/ Pragmatic Clinical Trials
Front
For common conditions, can uncover benefits and risk in short term intervention in large population
Back
Large simple trial
Front
Provide clinically relevant data because done in a clinical setting.
Common conditions, important outcomes, easily implemented in large.
Back
Advantage of group allocation design
Front
Helpful if concerned about contamination
Back
Assumptions of crossover designs
Front
Must assume effects of first intervention do not carry to the second period
Back
Chapter 3 fundamental point
Front
Each clinical trial must have a primary question. Questions must be carefully selected, clearly defined, and stated in advance.
Back
Disadvantage to non randomized concurrent control studies
Front
Potential non comparability.
Bias to allocation.
Back
Equivalency study
Front
Test whether new intervention is equivalent to an established one
Back
Comparative effectiveness research
Front
Compare 1 agent against another.
Compare 2 or more interventions commonly used.
Commonly non inferiority.
Back
Concerns with factorial design
Front
Possible interaction between intervention and impact on sample size.
Added complexity.
Impact on recruitment and adherence.
Back
Superiority Trial
Front
Assess whether treatment is different from control (usually treatment proven to be effective)
Back
Pharmacodynamics
Front
what the drug does to the body
Back
Noninferiority trial
Front
Whether an intervention is not worse or as good as an established intervention
Back
Intervention
Front
Manipulation of the subject or subject's environment to modify processes or endpoints
Back
Hybrid designs
Front
Used if a lot of data is historical.
Smaller numbers allocated to control and more to the new treatment.
Historical data must be fairly recent
Back
Limitation of withdrawal study
Front
A highly selected sample is evaluated.
Anyone with adverse events would be taken out of study.
Design can overestimate benefit and underestimate toxicity.
Back
Criteria for large simple trial
Front
Unbiased allocation of participant treatment and control.
Unbiased assessment of outcomes.
Large samples
Back
Biomarkers and Surrogate response variables
Front
It is less expensive/ time consuming to get continuous outcomes rather than events.
Acceptable for serious disease , quick dispersion, early phase studies.
Back
Clinical Trials
Front
A research study in which 1 or more human subjects are prospectively assigned to 1 or more interventions (which may include placebo or other control) to evaluate the effects of those intervention on health related biomed and behavioral outcome
Back
Factorial trial design
Front
Employ two or more independent assignments to treatment or control. Possible to have non complete factorial design.
Back
Advantages to non randomized concurrent control studies
Front
do not have researcher pick how patient is treated. Can be easier than convincing patient to randomize
Back
Subgroup analysis
Front
It is likely that the effect of an intervention is the same across subgroups, can have exceptions.
Back
Pragmatic/ Practical Clinical Trials
Front
Conducted in clinical practices rather than in labs.
Ask questions relevant to practices.
Broad applications.
Depend on easy intervention and outcome.
Back
Does stratifying always help?
Front
Nope. can always have unmeasured confounders that we did not adjust for.
Back
Margin of indifference/ non inferiority
Front
Relative risk of new intervention should be close to 1, meaning no difference.
1.2-1.4 is usual. Means 20-40% inferior to standard and still considered equal or noninferior.
1- control < delta
Back
Role of historical controls
Front
Fast
Inexpensive
Broad scope
Back
Group allocation designs
Front
A group is randomized to intervention or control.
Back
Pharmacokinetics
Front
what the body does to the drug
Back
Assay sensitivity
Front
Ability to show difference if one truly exists
Back
Non randomized concurrent control studies
Front
Controls are participants treated without new intervention at the same time intervention group is treated. Participants allocated to a group, but not randomly
Back
Variations of group allocation designs
Front
Crossover
Modified crossover
Stepped wedge
Back
Crossover designs
Front
Special type of RCT in which each participant is own control.
May have wash out period.
Any trend from first period to second can be eliminated in estimate of group difference in response.
Back
Non inferiority/ Equivalence trial
Front
Evaluate if new treatment is no worse than established treatment by margin (delta).
Back
Outcomes
Front
pre specified goal or condition that reflect the effect of 1 or more interventions
Back
Chapter 4 fundamental point
Front
Study population should be derived in advance, stating unambiguous inclusion criteria. Impacts design, generalizability, and participant inclusion.
Back
Withdrawal study
Front
Type of parallel design in which all participants start with treatment, then randomly some continue or stop treatment.
Used to evaluate duration of benefit of intervention that is known to be useful
Back
Two main types of exclusion
Front
1. Patient with contraindications to intervention
2. Assign issues impacting adherence
Back
Limitations of historical controls
Front
Vulnerable to bias
Shift in population
Method of selection may differ
Shift in diagnosis criteria
Accuracy/ completeness of data issues
Back
Main points of supplemental lecture 2 readings
Front
Not all people know about the study design they are going into, think theyre just getting treated.
Need equipoise to run study.
No methods to track if people actually understand informed consent. Should make understandable to all.
Back
Equipoise
Front
State of uncertainty on parts of investigator about therapeutic merits of each arm in trial
Back
Composite outcome
Front
Combination response variable with 2 kinds of events.
Can be used if 1 event is too infrequent.
Back
Advantages of factorial design
Front
Can be informative and efficient
Back
Superiority trial
Front
Goal to show new intervention is better than placebo or control alone
Back
Study population
Front
Subject of population with condition or characteristic of interest defined by eligibility criteria
Back
Advantages of crossover design
Front
Allows assessment of each participant on all treatments.
Variability is reduced because participant is used twice.
Smaller sample sizes
Back
Section 4
(11 cards)
Restricting populations
Front
May be needed to reduce overall sample size (takes away generalizability)
Narrow to homogenous group to give better events of treatment effect.
Back
External validity
Front
Extent to which trial results can be generalized.
Are findings valid for participants other than those meeting the defined study population, but from a comparable clinical setting?
Back
Generalization
Front
People in the study are not like the general population (behavior, health).
Find how the general population differs (can use pragmatic trials in clinical settings)
Back
Considerations in defining study populations
Front
1. potential for benefit
2. high likelihood of showing benefit
3. avoiding adverse events
4. competing risks
5. avoiding poor adherers
Back
Internal Validity
Front
Whether trial results are valid for all participants meeting eligibility criteria of trial protocol
Back
Schema
Front
Used to describe participant flow.
Shows steps involved in study including recruitment, randomizing, screening, collecting data.
Back
Questions regarding study population recruitment
Front
What is the impact of selection criteria on the ability to recruit?
Is the rate of outcome high enough in the study population?
Back
What is the goal of a schema
Front
Look and be able to see how you will capture data to assess all aims
Back
Six issues that impact external validity
Front
1. Trial setting
2. Selection of participant
3. Characteristics of randomized participant
4. Difference between trial protocol and clinical practice. Outcome measures and follow up
6. Adverse effects of treatment
Back
Who should be considered for a study population
Front
Benefit from intervention.
Have high enough risk so impact of intervention is seen in trial.
Exclude those whose risk for adverse events is too high.
Unlikely to die of something else before study begins.
Adhere to protocol.
Back
Pharmacogenetics
Front
Biomarkers; alleles, gene production, metabolism
Used to identify subgroups of participants for whom intervention is good or bad.