# Sample Size for Group-Sequential Tests in PASS

PASS includes procedures for power analysis and sample size calculations for many different one-sample and two-sample group-sequential cases. The group-sequential tools in PASS are easy-to-use and validated for accuracy. For more details about group-sequential tests in PASS, we recommend you download and install the free trial of the software. For more details about group-sequential analysis and sample size re-estimation in NCSS, you can click here. Jump to:## Introduction

The various group-sequential sample size calculation procedures in PASS allow you to study the power and sample size for an expanding list of scenarios:- Tests for One Mean with Known Variance (Simulation)
- T-Tests for One Mean (Simulation)
- Tests for Two Means with Known Variances (Simulation)
- T-Tests for Two Means (Simulation)
- Tests for Two Proportions (Simulation)
- Tests for Two Means (Simulation) Assuming Normality
- Tests for Two Means (Simulation) General Assumptions
- Tests for Two Means (Simulation) General Assumptions – Mann-Whitney Test
- Non-Inferiority Tests for Two Means
- Non-Inferiority Tests for Two Means – Mann-Whitney Test
- Non-Inferiority Tests for Two Means with Known Variances (Simulation)
- Superiority by a Margin Tests for Two Means with Known Variances (Simulation)
- Non-Inferiority T-Tests for Two Means (Simulation)
- Superiority by a Margin T-Tests for Two Means (Simulation)
- Tests for Two Proportions
- Tests for Two Proportions – Unequal n’s
- Tests for Two Proportions (Simulation)
- Tests for Two Proportions using Differences (Simulation)
- Tests for Two Proportions using Ratios (Simulation)
- Tests for Two Proportions using Odds Ratios (Simulation)
- Non-Inferiority Tests for Two Proportions (Simulation)
- Non-Inferiority Tests for Two Proportions using Differences (Simulation)
- Non-Inferiority Tests for Two Proportions using Ratios (Simulation)
- Non-Inferiority Tests for Two Proportions using Odds Ratios (Simulation)
- Superiority by a Margin Tests for Two Proportions (Simulation)
- Superiority by a Margin Tests for Two Proportions using Differences (Simulation)
- Superiority by a Margin Tests for Two Proportions using Ratios (Simulation)
- Superiority by a Margin Tests for Two Proportions using Odds Ratios (Simulation)
- Non-Inferiority Tests for Two Proportions (Simulation)
- Superiority by a Margin Tests for Two Proportions (Simulation)
- Logrank Tests of Two Survival Curves assuming Exponential Survival
- Logrank Tests of Two Survival Curves assuming Proportional Hazards
- Logrank Tests (Simulation)
- Tests for Two Hazard Rates (Simulation)
- Non-Inferiority Tests for Two Hazard Rates (Simulation)
- Superiority by a Margin Tests for Two Hazard Rates (Simulation)
- Tests for One Hazard Rate (Simulation)
- Non-Inferiority Tests for One Hazard Rate (Simulation)
- Superiority by a Margin Tests for One Hazard Rate (Simulation)
- Tests for Two Poisson Rates (Simulation)
- Non-Inferiority Tests for Two Poisson Rates (Simulation)
- Superiority by a Margin Tests for Two Poisson Rates (Simulation)
- Tests for One Poisson Rate (Simulation)
- Non-Inferiority Tests for One Poisson Rate (Simulation)
- Superiority by a Margin Tests for One Poisson Rate (Simulation)

## Outline of a Group-Sequential Study

There are three basic phases of a group-sequential (interim analysis) study:- Design
- Group-Sequential Analysis
- Reporting

### Design Phase – Determine the Number of Subjects

To begin the group-sequential testing process, an initial calculation should be made to determine the sample size and target information if the final stage is reached (maximum information). The sample size calculation requires the specification of the following:- Alpha
- Power
- Test Direction (two-sided or one-sided direction)
- Types of boundaries (efficacy, binding futility, non-binding futility)
- Maximum number of stages
- Proportion of maximum information at each stage
- Spending functions
- Effect Size Parameters

### Group-Sequential Analysis Phase

A group sequential analysis consists of a series of stages where a decision to stop or continue is made at each stage. This analysis can be performed using the companion (analysis) procedure to this sample size procedure, in NCSS.#### First Interim Stage

The design phase gives the target number of subjects for the first stage. The study begins, and response data is collected for subjects, moving toward the first-stage target number of subjects, until a decision to perform an analysis on the existing data is made. The analysis at this point is called the first stage. Unless the number of subjects at the first stage matches the design target for the first stage, the calculated information at the first stage will not exactly match the design information for the first stage. Further, the sample parameter estimates will rarely, if ever, match the parameters used in the calculation of the information at the design stage, and thus the calculated information at the first stage will differ from the design information. Generally, the calculated information will not differ too greatly from the design information, but regardless, spending function group-sequential analysis is well-suited to make appropriate adjustments for any differences. The first stage information is divided by the maximum information to obtain the stage one information proportion (or information fraction). This information proportion is used in conjunction with the spending function(s) to determine the alpha and/or beta spent at that stage. In turn, stage one boundaries, corresponding to the information proportion, are calculated. A z-(or t-)statistic is calculated from the raw data values. The stage one statistic is compared to each of the stage one boundaries. Typically, if one of the boundaries is crossed, the study is stopped (non-binding futility boundaries may be an exception). If none of the boundaries are crossed the study continues to the next stage. If none of the boundaries are crossed it may also be useful to examine the conditional power or stopping probabilities of future stages, using the NCSS procedure. Conditional power and stopping probabilities are based on the user-specified supposed true difference.#### Second and other interim stages (if reached)

Since the first stage information proportion is not equal to the design information proportion, a designation must be made at this point as to the target information of the second stage. Two options are available in the NCSS procedure. One option is to target the information proportion of the original design. For example, if the original design proportions of a four-stage design are 0.25, 0.50, 0.75, 1.0, and the stage one observed proportion is 0.22, the researcher might still opt to target 0.50 for the second stage, even though that now requires an additional information accumulation of 0.28 (proportion). The third and fourth stage targets would also remain 0.75 and 1.0. A second option is to adjust the target information proportionally to the remaining proportions. For this option, if the design proportions are 0.25, 0.50, 0.75, 1.0, and 0.22 is observed, the remaining 0.78 is distributed proportionally to the remaining stages. In this example, the remaining target proportions become 0.48, 0.74, 1.0. For either option, once the target information is determined for the next stage, revised target sample sizes are given (in the NCSS procedure), and the study continues until the decision is made to perform the next interim analysis on the cumulative response data. In the same manner as the first stage, the current stage information proportion is used with the spending function to determine alpha and/or beta spent at the current stage. The current stage boundaries are then computed. The z-statistic is calculated and compared to the boundaries, and a decision is made to stop or continue. If a boundary is crossed, the study is typically stopped. If none of the boundaries are crossed the study continues to the next stage. Once again, if no boundary is crossed, conditional power and stopping probabilities may be considered based on a choice of a supposed true difference. The study continues from stage to stage until the study is stopped for the crossing of a boundary, or until the final stage is reached.#### Final Stage (if reached)

The final stage (if reached) is similar to all the interim stages, with a couple of exceptions. For all interim analyses the decision is made whether to stop for the crossing of a boundary, or to continue to the next stage. At the final stage, only the decision of efficacy or futility can be made. Another intricacy of the final stage that does not apply to the interim stages is the calculation of the maximum information. At the final stage, the current information must become the maximum information, since the spending functions require that the proportion of information at the final look must be 1.0. If the current information at the final stage is less than the design maximum information, the scenario is sometimes described as under-running. Similarly, if the current information at the final stage is greater than the design maximum information, the result may be termed over-running. For both under-running and over-running, the mechanism for adjustment is the same, and is described in the Technical Details section, under Information and Total Information. Aside from these two exceptions, the final stage analysis is made in the same way that interim analyses were made. The remaining alpha and beta to be spent are used to calculate the final stage boundaries. If the test is a one-sided test, then the final stage boundary is a single value. The final stage z-statistic is computed from the sample proportions of the complete data from each group. The z-statistic is compared to the boundary and a decision of efficacy or futility is made.### Reporting Phase

Once a group-sequential boundary is crossed and the decision is made to stop, there remains the need to properly summarize and communicate the study results. Some or all of the following may be reported:- Boundary plot showing the crossed boundary
- Adjusted confidence interval and estimate of the proportion difference
- Sample size used

#### Boundary plot showing the crossed boundary

The boundary plot gives an appropriate visual summary of the process leading to the reported decision of the study.#### Adjusted confidence interval and estimate of the proportion difference

Due to the bias that is introduced in the group-sequential analysis process, the raw data confidence interval of the difference in proportions should not be used. An adjusted confidence interval should be used instead.#### Sample size used

The sample size at the point the study was stopped should be reported in addition to the sample size that would have been used had the final stage been reached.## Technical Details

Many articles and texts have been written about group sequential analysis. Details of many of the relevant topics are discussed below, but this is not intended to be a comprehensive review of group-sequential methods. One of the more influential works in the area of group-sequential analysis is Jennison and Turnbull (2000).### Null and Alternative Hypotheses

The null and alternative hypotheses for group-sequential tests are the same as those of standard one-stage tests, with alternative hypothesis options of one- or two-sided tests.### Stages in Group-Sequential Testing

The potential to obtain the benefit from a group-sequential design and analysis occurs when the response data are collected over a period of weeks, months, or years rather than all at once. A typical example is the case where patients are enrolled in a study as they become available, as in many types of clinical trials. A group-sequential testing stage is a point in the accumulation of the data where an interim analysis occurs, either by design or by necessity. At each stage, a test statistic is computed with all the accumulated data, and it is determined whether a boundary (efficacy or futility) is crossed. When an efficacy (or futility) boundary is crossed, the study is usually concluded, and inference is made. If the final stage is reached, the group-sequential design forces a decision of efficacy or futility at this stage. For the discussions below, a non-specific interim analysis stage is referenced as k, and the final stage is K.### Test Statistic

The z-statistic (or t-statistic) for any stage k is obtained from all the accumulated data up to and including that stage.### Group-Sequential Design Phase

In most group-sequential studies there is a design or planning phase prior to beginning response collection. In this phase, researchers specify the anticipated number and spacing of stages, the types of boundaries that will be used, the desired alpha and power levels, the spending functions, the anticipated parameter values, and an estimate of the true difference. Based on these input parameters, an initial set of boundaries is produced, an estimate of the total number of needed subjects is determined, and the anticipated total information at the final stage is calculated. This procedure can be used to make these planning phase sample size estimation calculations.### Information and Total Information

In the group-sequential design phase, the information at any stage k may be calculated from the specified parameter values (for variance) and the sample sizes. When the analysis is carried out, the sample estimates will be used in place of parameter values for variance calculations. The final stage (K) or total (design) information is calculated from the appropriate parameter estimates and the final sample sizes. The proportion of the total information (or information fraction) at any stage is the ratio of the current stage information to the total information. The information fractions are used in conjunction with the spending function(s) to define the alpha and/or beta to be spent at each stage. However, if the final stage is reached, the final stage information will likely be larger or smaller than the total information used in planning. When the final stage information is larger than the total information used in planning, it is called over-running. When the final stage information is smaller than the total information used in planning, it is called under-running. In either case, the spending function is adjusted to accommodate the inequality. See the discussion in Wassmer and Brannath (2016), pages 78-79, or Jennison and Turnbull (2000), pages 153-154, 162.### Types of Boundaries

A variety of boundary designs are available to reflect the needs of the study design.#### Efficacy Only (One-Sided)

The simplest group-sequential test involves a single set of stage boundaries with early stopping for efficacy.#### Efficacy Only (Two-Sided, Symmetric)

This boundary type would be used if the goal is to compare treatments, and it is not known in advance which treatment should be better.#### Efficacy 1 and Efficacy 2 / Harm (Two-Sided, Asymmetric)

These boundaries might be used to show efficacy on one side or harm on the other side. This design might be used in place of a one-sided efficacy and futility design if showing harm has additional benefit over stopping early for futility.#### Efficacy and Binding Futility (One-Sided)

This design allows early stopping for either efficacy or futility. For binding futility designs, the Type I error protection (alpha) is only maintained if the study is strictly required to stop if either boundary is crossed.#### Efficacy and Non-Binding Futility (One-Sided)

This design also allows early stopping for either efficacy or futility. For non-binding futility designs, the Type I error protection (alpha) is maintained, regardless of whether the study continues after crossing a futility boundary. However, the effect is to make the test conservative (alpha is lower than the stated alpha and power is lower than the stated power).#### Efficacy and Binding Futility (Two-Sided, Symmetric)

This design allows early stopping for either efficacy or futility on either side. Alpha is preserved only if crossing of futility boundaries strictly leads to early stopping for futility. In early looks of this design, the futility boundaries may overlap. Overlapping futility boundaries may be skipped or left as they are.#### Efficacy and Non-Binding Futility (Two-Sided, Symmetric)

This design allows early stopping for either efficacy or futility on either side. Alpha is preserved even when the study is allowed to continue after crossing a futility boundary. In early looks of this design, the futility boundaries may overlap. Overlapping futility boundaries may be skipped or left as they are.#### Efficacy 1, Efficacy 2 / Harm, and Binding Futility (Two-Sided, Asymmetric)

This design allows early stopping for efficacy and efficacy futility, and for harm and harm futility (or efficacy 2 and efficacy 2 futility). Binding futility boundaries require that the study is stopped when a binding futility boundary is crossed. In early looks of this design, the futility boundaries may overlap. Overlapping futility boundaries may be skipped or left as they are.#### Efficacy 1, Efficacy 2 / Harm, and Non-Binding Futility (Two-Sided, Asymmetric)

This design allows early stopping for efficacy and efficacy futility, and for harm and harm futility (or efficacy 2 and efficacy 2 futility). Non-binding futility boundaries do not require that the study is stopped when a binding futility boundary is crossed, but the study design is conservative. In early looks of this design, the futility boundaries may overlap. Overlapping futility boundaries may be skipped or left as they are.#### Futility Only (One-Sided)

In this design, the interim analyses are used only for futility. Please be aware that, due to computational complexity, these boundaries may take several minutes to compute, particularly when some stages are skipped.#### Futility Only (Two-Sided, Symmetric)

In this design, the study is stopped early only for futility. Overlapping futility boundaries may be skipped or left as they are. Please be aware that, due to computational complexity, these boundaries may take several minutes to compute, particularly when overlapping boundaries are removed or some stages are skipped.#### Futility Only (Two-Sided, Asymmetric)

In this design, all stages previous to the final stage are used only for futility. Overlapping futility boundaries may be skipped or left as they are. Please be aware that, due to computational complexity, these boundaries may take several minutes to compute, particularly when overlapping boundaries are removed or some stages are skipped.### Boundary Calculations

The foundation of the spending function approach used in these procedures is given in Lan & DeMets (1983). These procedures implement the methods given in Reboussin, DeMets, Kim, & Lan (1992) to calculate the boundaries and stopping probabilities of the various group sequential designs. Some adjustments are made to these methods to facilitate the calculation of futility boundaries.### Binding vs. Non-Binding Futility Boundaries

Futility boundaries are used to facilitate the early stopping of studies when early evidence leans to lack of efficacy. When binding futility boundaries are to be used, the calculation of the futility and efficacy boundaries assumes that the study will be strictly stopped at any stage where a futility or efficacy boundary is crossed. If strict adherence is not maintained, then the Type I and Type II error probabilities associated with the boundaries are no longer valid. One (perhaps undesirable) effect of using binding futility boundaries is that the resulting final stage boundary may be lower than the boundary given in the corresponding fixed-sample design. When non-binding futility boundaries are calculated, the efficacy boundaries are first calculated ignoring futility boundaries completely. This is done so that alpha may be maintained whether or not a study continues after crossing a futility boundary. One (perhaps undesirable) effect of using non-binding futility boundaries is that the overall group-sequential test becomes conservative (alpha is lower than the stated alpha and power is lower than the stated power).### Spending Functions

Spending functions are used to distribute portions of alpha (or beta) to the stages according to the proportion of accumulated information at each look.#### Spending Function Characteristics

- Spending functions give a value of zero when the proportion of accumulated information is zero.
- Spending functions are increasing functions.
- Spending functions give a value of alpha (or beta) when the proportion of accumulated information is one.