[Frontiers in Bioscience E2, 266-278, January 1, 2010]

Application and review of the separate ray model to investigate interaction effects

Roel Straetemans1, Luc Bijnens1

1Johnson and Johnson Pharmaceutical Research and Development, a division of Janssen Pharmaceutica N.V., Beerse Belgium

TABLE OF CONTENTS

1. Abstract
2. Introduction
3. Statistical Methodologies
3.1. Concentration-response model
3.2. The Separate Ray Model
3.3. Changes to original published work
3.4. Hard- and software
4. Overview of Applications
4.1. First data set: Combination of trimetrexate and AG2034 with 2.3�M folic acid
4.2. Second data set: Combination of trimetrexate and AG2034 with 78�M folic acid
5. Summary and Perspective
6. Acknowledgement
7. References

1. ABSTRACT

In this paper we review the application of the Separate Ray Model to analyze drug combination experiments coming from a fixed ratio design. The idea is the joint fit of separate concentration response curves to each ray under investigation leading to an interaction index for each together with a 95 percent Confidence Interval. The approach is a simple and easy to implement parametric modeling approach and allows estimation and testing of drug interactions based on regularly sampling in the entire space of all combinations going from pure compound A to pure compound B. The analysis is implemented using the SAS/STAT procedure NLMIXED. Two datasets were provided for the modeling exercise. One included different qualitative effects with some rays showing synergy, others antagonism and again others additivity. The second dataset involved the presence of very large synergy together with different observed background effects for the individual rays. The Separate Ray Model is able to handle these practical issues making it a flexible tool to investigate drug interaction experiments using a fixed ratio design.

2. INTRODUCTION

In recent years the study of drug interactions in pre-clinical drug development has gained importance among pharmacologists, biologists and statisticians. Two important questions when performing a drug interaction experiment concern the design and the statistical methodology to assess the presence of interaction. Before these questions can be answered however a clear definition of drug interaction, and how to calculate it needs to be available. When two (or more) drugs are applied as a combination in a mixture to a biological system the resulting effect can be equal or different as compared to what is expected from the biological activity of the individual compounds. In the first case no interaction is said to be present while in the second interaction is said to exist. This concept of drug interaction is generally accepted but the reference 'what is expected from the biological activity of the individual compounds' plays a crucial role and to this day is a topic of debate. Two excellent review papers (1, 2) describe existing reference models used to calculate the expected treatment effect under assumption of no interaction. In accordance to the authors, we consider the so called Loewe additivity model as the most suitable one and is therefore the reference model used in this paper. Next to the choice of reference model there is also debate on how to define drug interaction terms if an interaction is observed. In this paper the so called Sarriselkä agreement (3) on terminology will be used, as well as the assumption that both individual compounds are active.

The additivity term in the Loewe additivity model follows from the dose equivalent concept (4) which leads (5, 6) to the linear isobole of additivity given by equation (1):

 (1)

where:

ICX,A is the concentration of pure compound A reaching X% inhibition,

ICX,B is the concentration of pure compound B reaching X% inhibition,

CX,a,r is the concentration of compound A present in the concentration of combination (or ray) r that reaches X% inhibition and

CX,b,r is the concentration of compound B present in the concentration of combination (or ray) r that reaches X% inhibition. The definition of ray will be explained in more detail later on.

If this equation on the right, also known as Berenbaum's interaction index I (7), sums to one the mixture is said to be additive. When I < 1 Loewe synergy is concluded and when I > 1 the mixture is said to be Loewe antagonistic. In the remainder Loewe synergy and Loewe antagonism are abbreviated to respectively synergy and antagonism.

The remainder of the paper is organized as follows. In section 3 the details of the statistical methodology of the Separate Ray Model is explained. Section 4 contains the analysis results for both datasets and an overall discussion and conclusion will be given in Section 5.

3. STATISTICAL METHODOLOGIES

The applied study design of the two experiments is the so called fixed ratio or ray design (8). In this design the two individual compounds are mixed according to some fraction f to form a mixture Z, as

Z = f ICX,A + (1-f) ICX,B (2)

with ICX,A and ICX,B being preliminary estimates of the concentrations of the individual compounds required to reach a certain effect level, typically the 50% effect level, and f, called the mixture factor, ranging from 0 to 1. Depending on the choice of f, different mixtures Z can be prepared. For each mixture Z, m dilutions are prepared to study the concentration-response profile of the combination. The m dilutions of a specific mixture Z are called a ray. Within a ray the ratio of the two individual compounds is constant or fixed and hence the name fixed ratio design. By choosing appropriate rays the whole spectrum of mixtures going from pure A (f=1) to pure B (f=0) can be studied. This is illustrated in Figure 1. Because of the constant proportion between the two individual compounds within a ray, the amount of one can be written as a linear expression of the other as

CX,b,r = pr CX,a,r (3)

where:

CX,b,r is the concentration of compound B present in the concentration of ray r reaching X% inhibition,

CX,a,r is the concentration of compound A present in the concentration of ray r reaching X% inhibition and

pr is the constant proportion of the two compounds within the ray r.

In the current datasets, 12 different mixtures were prepared, each studied in 11 dilutions. In the provided datasets each ray was identified with the variable curvelo and curvehi in respectively dataset 1 and 2. In Table 1 the link between these original provided mixture identifications in the datasets and identification via ray and slope coefficient pr in the remainder of the paper, is shown. Notice how ray 1 is the concentration range of pure compound A and ray 2 of pure compound B.

The basic idea of the Separate Ray model is to simultaneously fit a concentration-response model to each ray under investigation (9, 10). Based on these individual nonlinear curves an interaction index I for each ray, noted as Ir, will be estimated together with a 100 (1-a )% CI. This calculated 100 (1-a )% CI is then used to conclude interaction or additivity for each specific combination (or ray). When the 100 (1-a )% CI contains 1 the null hypothesis of additivity can not be rejected. Otherwise the null hypothesis of additivity is rejected in favor of synergy when the upper limit is smaller than 1 and antagonism when the lower limit is larger than 1.

3.1. Concentration-response model

The concentration-response curve of our choice to fit to each mixture is the four parameter log-logistic curve where the mean response E(Y) is related to the concentration C by

 (4)

where:

q 1 is the extrapolated background at infinite drug concentration,

q 2 is the expected response at zero drug concentration,

q 3 is a slope parameter, where a positive value of q 3 corresponds to a decreasing profile as is seen in the two datasets under study and

IC50 is the concentration at which half the effect (difference between q 2 and q 1) is reached.

This four parameter log-logistic model is well known to describe a sigmoidally shaped curve for response versus the logarithm of concentration. It's application, although in a simpler parameterization with only 3 parameters, assuming q 1 to be zero, dates back to Emmens (11) and is a commonly used nonlinear model to describe concentration-response data.

Equation (4) can more generally be written as

Yr,j = g(q r, Cr,j) + e r,j (5)

where:

Yr,j is the response of ray r at concentration j,

g is the nonlinear function (4),

q r = (q 1,r; q 2,r; q 3,r; IC50,r) is a ray specific parameter vector to be estimated,

Cr,j is the concentration j of ray r and

e r,j is the random error, assumed to be normally distributed with mean zero and variance covariance matrix S .

3.2. Separate ray model

In the Separate Ray Model the ray specific estimated parameters of each mixture together with those from the pure compounds A and B, respectively ray 1 and 2, will be used to estimate the mixture specific interaction index Ir. The link between Ir and those ray specific parameters is based on the constant proportion of the two individual compounds within the ray as defined in equation (3). For each ray, CX,r,j, the concentration j of ray r corresponding to X% inhibition, consists of an amount of A (CX,a,r) and B (CX,b,r). Specific for 50% inhibition, this corresponds to

C50,r,j = IC50,r = C50,a,r + C50,b,r, (6)

which after combination with expression (3) becomes

IC50,r = (1+pr) C50,a,r. (7)

Combination of the Loewe additivity model (1), equation (3), equation (7) and replacing 1 by Ir leads then to the following expression,

 (8)

which equivalently can be written as

 (9)

Expressions (8) and (9) now allow us to calculate for each ray the specific interaction index Ir, based on pr, a known constant from the design, the parameters IC50,A and IC50,B from pure A and B and the ray specific parameter IC50,r. Equation (8) and (9) provide the Ir values at the 50% inhibition level. The above described approach can however be extended to other effect levels using the same principles. For a given effect level X expression (8) can be written as,

 (10)

where:

IX,r is the interaction index for ray r at effect level X% inhibition,

CX,r,j is the estimated concentration j of ray r for which X% inhibition effect is obtained,

CX,A and CX,B are the estimated concentrations of pure compounds, A and B respectively, for which X% inhibition effect is obtained.

The estimation of the interaction index at the 50% effect level requires IC50 values, obtained directly as parameters from the model. Any other effect level requires Cx values that are not parameters in the model. Hence they need to be estimated via inverse estimation from the fitted concentration-response model.

The approach is implemented using the SAS/STAT® procedure NLMIXED (12). This procedure is a flexible tool which allows performing the joint fit of the different ray specific concentration-response models and estimation of Ir, the ray specific interaction indices at 50% inhibition, as parameters. In addition the NLMIXED procedure has an ESTIMATE statement which enables the user to estimate any expression from the model parameters and thus estimation of the general expression IX,r via equation (10). The statement uses the delta method to estimate the corresponding standard error and produce a 100(1-a )%CI. Other advantages of the NLMIXED procedure are the possibility to specify non-normal distributions for the response variable and specification of a non-constant variance function. In the two datasets studied, the final model assumed the residual variance in equation (5) to follow a normal distribution with a variance being proportional to a power of the mean, as follows

e r,j ~ N(0, s �( g(q r, Cr,j))r ). (11)

3.3. Changes to original published work

Application of the Separate Ray Model in drug combination experiments has been published previously (10). Although the methodology has stayed the same, four practical changes compared to the original published work are incorporated. First, the originally used three parameter log-logistic concentration-response model is extended to a four parameter log-logistic model. Second, combination indices for effect levels different from 50% are calculated, using the ESTIMATE statement in the NLMIXED procedure. Third, the model fitted is slightly reparameterized. Compared to the original SAS code provided, the separate Ray model is fitted using the log-logistic parameterization in equation (4), instead of the Hill parameterization in equation (12),

 (12)

and the ray specific interaction indices Ir are fitted or estimated (when different from 50%) as lognormal parameters. This has the advantage that all estimated values and confidence interval of the concentration parameters as well as the ray specific interaction indices are always strict positive. Finally, compared to the model fitted in the original published work, no model adjustment for possible row and column effects is incorporated.

3.4. Hard- and Software

All analyses were performed using SAS v9.1.3 under Microsoft Windows 2000 as operation system. The computer used contained an Intel(R) Pentium (R)M processor of 1.60 GHz and had 1 Gb RAM memory. Graphs were produced using Splus v7.0 with the exception of Figure 1 which was made using PowerPoint.

4. OVERVIEW OF APPLICATIONS

For both datasets, compound trimetrexate (TMQ) and AG2034 are labeled as compound A and B respectively in the analysis.

4.1. First data set: Combination of trimetrexate and AG2034 with 2.3�M folic acid

A plot of the mean observed concentration response profiles by curvelo identification is given in Figure 2. The estimates of the ray specific interaction indices together with their 95%CI are given in Table 2 for 10, 25, 50, 75 and 90% inhibition. The corresponding isobolograms can be found in Figure 3. Figure 4 is a graphical representation of Table 2.

From Table 2 and Figure 4 we notice two important results. First for a given % inhibition the estimated effect changes over the different mixtures, both in a quantitative, since different mixtures have different sizes of Ir as a qualitative meaning, as for some mixtures the null hypothesis of additivity can not be rejected, for others it can be reject in favor of synergy while for some it is rejected in favor of antagonism. Second it is seen how for a given mixture a similar change in quantitative and qualitative result can be observed in function of the inhibition level. An example is curvelo 4 which goes from synergy at the 90 and 75% inhibition level over additivity at 50% inhibition to an antagonistic effect at 25 and 10% inhibition. These results highlight the importance of being able to assess drug interaction for different mixtures of two compounds. A graphical assessment of the model fit, given in Figure 5, shows an acceptable fit for all rays.

4.2. Second data set: Combination of trimetrexate and AG2034 with 78�M folic acid

A plot of the mean observed concentration response profiles by curvehi identification is given in Figure 6. From this graph we should notice how for pure compound B (curvehi = 2) it seems that at the highest drug concentration the lower asymptote is not completely reached. Second for pure compound A (curvehi = 1) no concentrations are present between the two asymptotes. The observations are more clear in Figure 10 where only pure A and B are plotted. The estimates of the ray specific interaction indices together with their 95%CI are given in Table 3 for 10, 25, 50, 75 and 90% inhibition. The corresponding isobolograms can be found in Figure 7. Figure 8 is a graphical representation of Table 3.

Table 3, as well as Figure 8, show a large synergistic effect. Based on the point estimate of Ir all mixtures are synergistic at all levels of % inhibition. For a minority of combinations, curvehi 14 at 90% inhibition and curvehi 13, 14 and 15 at 10% inhibition, the null hypothesis of additivity can not be rejected based on the 95%CI. Notice however how no adjustment for multiplicity has been performed. As a result the overall type I error will be higher than 5%. Although multiple adjustment could be performed, these experiments typically are situated in a screening setting where the main purpose is to pick up certain effects Those observed will then be confirmed in a second experiment. Moreover for some settings these in vitro combination experiments are performed to pick up strong antagonistic effects for safety reasons, meaning that non adjustment is a conservative approach. Hence the multiple comparison adjustment is not considered to be essential here.

A valuable observation in this dataset is the profile for pure compound A. Notice from Figure 10 how almost no data points are available in the decreasing part of the concentration-response curve. This has a clear effect on the curve estimation as shown in table 4 where the estimate of q 3 for pure compound A is estimated with a large uncertainty. A graphical assessment of the model fit, given in Figure 9, shows an acceptable fit for all rays.

5. SUMMARY AND PERSPECTIVES

In pre-clinical research the study of combination experiments is recognized as being very valuable. A specific application is the field of oncology where efforts are made for finding successful treatments of cancer by combining different treatments. The quantification of combination therapies in clinical trials is expensive and time-consuming. As a result there is a need for the in vitro quantification of interaction effects The success of the in vitro quantification depends on both an adequate design as well as a statistical analysis of the results. Preferably both need to be fast, easy and robust. The fixed ratio design is used in industry for these reasons. Several analysis techniques are developed to process the results coming from drug combination experiments and one of them is the Separate Ray Model. In this modeling exercise the Separate Ray Model is applied to two previously analyzed datasets coming from the field of oncology (17).

For the first dataset, the analysis result show how the interaction between TMQ and AG2034 depends both in a quantitative as qualitative manner from the mixture chosen. At each effect level it is seen how the point estimates of the interaction indices range from synergy over no interaction to antagonism. When looking at the 95%CI it can be seen that these differences are statistically significant as for some the hypothesis of no interaction can not be rejected, for others it can be rejected in favor of synergy while for others in favor of antagonism. Also notice how for some mixtures the same phenomenon of changing interaction, both qualitative as quantitative, is observed when looking at different effect levels. For the second dataset the main message is the presence of large synergistic effect for most mixtures at each effect level. A second main observation is the apparent difference in background response for pure compound B. By applying ray specific concentration-response parameters this effect can easily be corrected for.

The performed analysis highlights some of the most appealing features of the Separate Ray Model. First it allows the individual quantification of interaction for different mixtures, covering the whole spectrum between the two individual compounds, by using ray specific interaction indices. Second the methodology allows the quantification of uncertainty by calculating a 95% CI for the interaction indices. These two features provide information and allow easy visualization on how the interaction, both qualitative as quantitative, can change over the different mixtures. Finally the methodology can be easily implemented using SAS, a commercially available software program. The NLMIXED procedure allows correct modeling of heteroscedasticity, a phenomenon typically observed in these concentration response profiles.

We realize that the discussed approach has its strenghts and drawbacks, compared to a response surface approach. To our knowledge, before 2005, most response surface approaches focused on calculating one single parameter for the assessment of interaction over the whole surface. Noteworthy exceptions were Minto (18) and White (19). More recently new methods such as Kong (20) and Fang (21) seem to be very promising in terms of expanding the response surface methodology to local estimation of interactions. However when the biological focus is on specific fixed fractions the ray approach has the advantage of having a richer and more informative sampling scheme. A clear advantage of the afore mentioned methods is the possibility to investigate local interactions anywhere in the entire surface, which is not possible using our current analysis model.

Finally the authors want to point out that the methodology presented makes use of the linear isobole of additivity. There is some discussion about the general validity of this linear isobole of additivity and opposing viewpoints can be found. Loewe questioned the validity and allowed the possibility of curved isoboles for which the linear one is a special case in his original paper (4). Other authors do not agree with his view and claim the lineair isobole is generally valid, as exemplified on p.100 in the review by Berenbaum (2). In some recent published work by Tallarida (5) and Grabovsky and Tallarida (6) these authors describe how the concept of dose equivalence leads to the general nonlinear isobole of additivity and claim to have proven the validity of the curved isobole where under the assumption of constant relative potency it reduces to the linear isobole of additivity. It is clear that there is discussion and controversy, a well found basis for science in general, and we would applaud any similar initiative as this current modeling exercise with respect to going in depth into the theoretical arguments of both sides.

6. ACKNOWLEDGEMENTS

The authors would like to thank Bill Greco for organizing this initiative and giving us the opportunity to participate. Also the referees are thanked for providing valuable comments which improved the paper considerably.

7. REFERENCES

1.Greco W.R., G. Bravo and J.C. Parsons: The Search for Synergy: A Critical Review from a Response Surface Perspective. Pharm Rev 47, 331-385 (1995)

2. Berenbaum M.C.: What is Synergy? Pharm Rev 41, 93-141 (1989).

3. Greco W.R., H.D. Unkelbach, G. Pöch, J. Sühnel, M. Kundi and W. Bödeler: Consensus on concepts and terminology for interaction assessment: the Sarriselkä Agreement. Arch Complex Environ Studies 4, 65-69 (1992).

4. Loewe S.: The problem of synergism and antagonism of combined drug. Arzneim-Forsch 3, 385-390 (1953)

5. Tallarida R.J.: An Overview of Drug Combination Analysis with Isobolograms. J Pharmacol. Exp Ther 319, 1-7 (2006)
doi:10.1124/jpet.106.104117
PMid:16670349

6. Grabovsky Y. and R.J. Tallarida: Isobolographic Analysis for Combinations of a Full and Partial Agonist: Curved Isoboles. J Pharmacol. Exp Ther 310, 981-986 (2004)
doi:10.1124/jpet.104.067264
PMid:15175417

7. Berenbaum M.C.: Synergy, additivism and antagonism in immunosuppression. Clin Exp Immunol 28, 1-18 (1977).

8. Tallarida R.J.: Drug Synergism and Dose-Effect Data Analysis. Chapman and Hall/CRC, Boca Raton, Fl. (2000).

9. O'Brien T.E.: Modeling and Design to Detect Interaction of Insecticides, Herbicides and Other Similar Compounds. Johnson, D. and Milliken G., eds., Proceedings of the 15th Conference on Applied Statistics in Agriculture 303-321 (2004).

10. Straetemans R., T.E. O'Brien, L. Wouters, J. Van Dun, M. Janicot, L. Bijnens, T. Burzykowski and M. Aerts: Design and Analysis of Drug Combination Experiments. Biometrical Journal 47, 299-308 (2005).
doi:10.1002/bimj.200410124
PMid:16053254

11. Emmens C.W.: The dose/response relation for certain principles of the pituitary gland, and of the serum and urine of pregnancy. J Endocrinol 2, 194-225 (1940).
doi:10.1677/joe.0.0020194

12. Online documentation for the NLMIXED procedure can be found at http://support.sas.com/documentation/onlinedoc/91pdf/index.html

13. Feng P. and C. Kelly: An Extension of the Model Free Test to Test Synergy in Multiple Drug Combinations. Biometrical Journal 46, 293-304 (2004).
doi:10.1002/bimj.200310038

14. White D.B., H.M. Faessel, H.K. Slocum, L. Khinkis and W.R. Greco: Nonlinear Response Surface and Mixture Experiment Methodologies Applied to the Study of Synergism. Biometrical Journal 46, 56-71 (2004).
doi:10.1002/bimj.200210002

15. Minto C.F., T.W. Schnider, T.G. Short, K.M. Gregg and A. Gentilini: Response Surface Model for Anesthetic Drug Interactions. Anesthesiology 92, 1603-1616 (2000).
doi:10.1097/00000542-200006000-00017
PMid:10839909

16. Machado G.W. and G.A. Robinson: A direct, general approach based on isobolograms for assessing the joint action of drugs in pre-clinical experiments. Stat in Med 13, 2289-2309 (1994).
doi:10.1002/sim.4780132202
PMid:7855464

17. Faessel H.M., H.K. Slocum, C. Jackson, T.J. Boritzki, Y.M. Rustum, M.G. Nair and W.R. Greco : Super in vitro Synergy between Inhibitors of Dihydrofolate Reductase and Inhibitors of Other Folate-requiring Enzymes: The Critical Role of Polyglutamylation. Cancer Res 58, 3036-3050 (1998).

18. Kong M. and J.J. Lee: A Generalized Response Surface Model with Varying Relative Potency for Assessing Drug Interactions. Biometrics 62, 986-995 (2006).
doi:10.1111/j.1541-0420.2006.00579.x
PMid:17156272

19. Fang H.B., D. Ross, E. Sausville and M.Tan: Experimental Design and Interaction Analysis of Combination Studies on Drugs with Log-linear Dose Responses. Stat in Med (epub)(2008).

20 Minto C.F., T.W. Schnider, T.G. Short, K.M. Gregg, A. Gentilini & S.L. Shafer: Response surface model for anesthetic drug interactions. Anesthesiology 92, 1603-1616 (2000)
doi:10.1097/00000542-200006000-00017
PMid:10839909

21 White D.B., H.K. Slocum, Y.F. Brun, C. Wrzosek & W.R. Greco: A new nonlinear mixture response surface paradigm for the study of synergism: a three drug example. Curr Drug Metab 2, 399-409 (2003)
doi:10.2174/1389200033489316
PMid:14529372

Abbreviations: CI: Confidence Interval, TMQ: trimetrexate

Key Words Synergy, Antagonism, Ray Design, Fixed Ratio Design, Loewe, Review

Send correspondence to: Roel Straetemans, Turnhoutseweg 30 2340 Beerse, Belgium, Tel: 0032-0-14 60 2744, Fax: 0032-0-14 60 5802, E-mail:rstraete@its.jnj.com

9