help button home button Am J Pathol R & D Systems
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Supplemental Material
Right arrow Purchase Article
Right arrow View Shopping Cart
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Alonso, S. R.
Right arrow Articles by Rodríguez-Peralto, J. L.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Alonso, S. R.
Right arrow Articles by Rodríguez-Peralto, J. L.
(American Journal of Pathology. 2004;164:193-203.)
© 2004 American Society for Investigative Pathology

Progression in Cutaneous Malignant Melanoma Is Associated with Distinct Expression Profiles

A Tissue Microarray-Based Study

Soledad R. Alonso*, Pablo Ortiz{dagger}, Marina Pollán{ddagger}, Beatriz Pérez-Gómez{ddagger}, Lydia Sánchez§, Ma Jesús Acuña§, Raquel Pajares§, Francisco J. Martínez-Tello, Carlos M. Hortelano||, Miguel A. Piris* and José L. Rodríguez-Peralto

From the Molecular Pathology Program* and Histology and Immunohistochemistry Unit,§ Centro Nacional de Investigaciones Oncológicas (CNIO), Madrid; the Departments of Pathology and Dermatology,{dagger} Hospital Universitario, 12 de Octubre, Madrid; Centro Nacional de Epidemiología,{ddagger} Instituto de Salud Carlos III, Madrid; and MDS Pharma Services,|| Madrid, Spain


    Abstract
 Top
 Abstract
 Materials and Methods
 Results
 Discussion
 References
 
Cutaneous malignant melanoma remains the leading cause of skin cancer death in industrialized countries. Clinical and histological variables that predict survival, such as Breslow’s index, tumor size, ulceration, or vascular invasion have been identified in malignant melanoma. Nevertheless, the potential relevance of biological variables still awaits an in-depth exploration. Using tissue microarrays (TMAs), we retrospectively analyzed 165 malignant melanoma samples from 88 patients corresponding to distinct histological progression phases, radial, vertical, and metastases. A panel of 39 different antibodies for cell cycle, apoptosis, melanoma antigens, transcription factors, DNA mismatch repair, and other proteins was used. Integrating the information, the study has identified expression profiles distinguishing specific melanoma progression stages. Most of the detected alterations were linked to the control of cell cycle G1/S transition; cyclin D1 was expressed in radial cases 48% (12 of 25) with significant lost of expression in vertical cases 14% (9 of 65), P = 0.002; whereas p16INK4a (89% in vertical versus 71% in metastatic cases, P = 0.009) and p27KIP1 (76% in radial versus 45% in vertical cases, P = 0.010) were diminished in advanced stages. The study also defines a combination of biological markers associated with shorter overall survival in patients with vertical growth phase melanoma, that provided a predictor model with four antibodies (Ki67, p16INK4a, p21CIP1, and Bcl-6). This predictor model was validated using an independent series of 72 vertical growth phase melanoma patients.


Cutaneous malignant melanoma, the most aggressive common skin tumor, is characterized by a multi-factorial etiology. Sun exposure and genetic susceptibility have been proposed as major etiological and predisposing factors that somehow explain the reported increased incidence.1,2 Metastatic melanoma tumors have a poor response to any therapy, with a 5-year survival probability ranging from 0 to 30%.3-5

Cutaneous malignant melanoma develops in three different stages, from radial to vertical growth phases and metastatic disease. The underlying molecular events that explain malignant melanoma genesis have been only partially characterized, and only a small number of genes have been identified as playing key roles in melanoma initiation and progression. Among these, some cell cycle regulators, apoptotic, signal transduction, cell adhesion, and matrix digestion genes have been demonstrated to be deregulated in this neoplasm.6-11

The variability of clinical behavior in patients with malignant melanoma is only partially explained by clinical and histological data, and we need to identify biological variables of use in assigning patients to specific risk groups. Although this aim has been achieved for single markers, malignant melanoma has benefited little from the use of massive molecular analytical techniques. The use of tissue microarrays (TMAs) is a technique suitable for malignant melanoma progression study, since it is a powerful tool that allows hundreds of specimens to be interrogated simultaneously with a panel of antibodies or probes directed against selected targets. Information obtained with TMAs not only contributes to the identification of key molecular events, but also facilitates the development of outcome predictor models of unprecedented accuracy.12-14

In this study, we have collected a large series of human malignant melanomas of different stages, and factor, signal-transduction, transcription-factor, differentiation, and melanoma-specific antigens. The study identifies a set of stage-specific markers, and allows a predictor model to be developed that identifies groups of patients with increased risk of death.


    Materials and Methods
 Top
 Abstract
 Materials and Methods
 Results
 Discussion
 References
 
Malignant Melanoma Samples

A total of 175 tissue samples from common nevi (n = 10), primary radial growth phase malignant melanoma (n = 28), primary vertical growth phase malignant melanoma (n = 66), skin (n = 34), and nodal (n = 37) melanoma metastases were examined. Primary (radial and vertical phases) and metastatic tumors used to construct the TMAs were all taken from a series of 88 patients consecutively diagnosed at the 12 Octubre University Hospital, Madrid, between 1995 and 2000. In 2 of 88 cases, biopsies from both vertical and radial phases were included. In 30 of 88 patients, samples corresponding to primary (vertical phase in all cases) and metastatic disease were included. In 11 of 88 patients it was possible to include biopsies from both cutaneous and lymph node metastases. Additional metastases (8 of 88 cases) from patients from whom primary tumors could not be obtained were also included in the study. There was no history of familial occurrence in the selected patients.

All patients were treated according to standard criteria: surgical resection in all primary cases and surgical resection (when possible) plus chemotherapy, if indicated, in cases with demonstrated metastases. For survival analysis, all included samples corresponded to the initial diagnostic specimens before any further treatment.

Paraffin blocks were selected on the basis of the availability of suitable formalin-fixed, paraffin-embedded tissue (at least 1-mm thick). Hematoxylin and eosin-stained slides were available for review in all cases measured as Breslow’s index, and histological progression phase were defined according to standard criteria15,16 (also see additional information at http://ajp.amjpathol.org). Approval for this study was obtained from the 12 Octubre Hospital Institutional Review Board. Informed consent, when necessary, was obtained following the guidelines of the Helsinki Declaration.

Generation of Tissue Arrays

For characterization of immunohistochemical protein expression, we constructed six different tissue arrays containing the distinctive histological stages of the tumor. Each tissue array was assembled as previously described.12 Briefly, two 1.5-mm-diameter cylinders of tissue were taken from representative areas of each archival paraffin block and arrayed into a new recipient paraffin block with a custom-built precision instrument (Beecher Instruments, Silver Spring, MD) according to the previously described method.12

These tissues had been fixed in 4% formalin (Panreac, Barcelona, Spain) and paraffin-embedded according to routine procedures. Areas chosen for the cylinder core had high tumor cellularity. To evaluate the most adequate part of each primary tumor we selected the invasive border of the tumor in large lesions and all tumor cells in smaller samples. In addition, normal tissues (skin, tonsil, and reactive lymphoid tissue) and three different cell lines with known cell cycle alterations were placed adjacent to tumoral tissues to serve as internal controls and to ensure the quality of staining slides. Initial sections were stained for hematoxylin and eosin to verify the histopathological findings.

Immunohistochemistry

Three-micrometer tissue sections from the TMA blocks were sectioned and applied to special immunohistochemistry coated slides (DAKO, Glostrup, Denmark). These slides were baked overnight in a 56°C oven. Sections were deparaffinized in xylene for 20 minutes, rehydrated through a graded ethanol series and washed with phosphate-buffered saline. Antigen retrieval was achieved by a 2-minute heat treatment in a pressure cooker, containing 1 liter of 10 mmol/L sodium citrate buffer, (pH 6.5, DAKO) that had been previously brought to the boil. Before staining, endogenous peroxidase activity was quenched with 1.5% hydrogen peroxide (DAKO) in methanol for 10 minutes.

Immunohistochemical staining was performed on these sections using 39 different antibodies, (source and concentration are listed in Table 1 ). Antibodies used in this study were selected for reporting on key aspects of cell cycle, apoptosis, signal transduction, and melanoma differentiation. We have also considered the status of the markers described in previous studies in this tumor type. After incubation, in the case of nuclear markers, immunodetection was performed with the LSAB Visualization System (DAKO) using 3,3'-diaminobenzidine chromogen as substrate, according to the manufacturer’s instructions. In addition, whenever possible, cytoplasmic markers were visualized with the APAAP System (alkaline phosphatase anti-alkaline phosphatase, DAKO), using neo-fuchsine chromogen as substrate to rule out the possibility of a role of endogenous melanin in the observed reactivity. All sections were counter-stained with hematoxylin (DAKO). Negative controls were obtained by omitting the primary antibody.


View this table:
[in this window]
[in a new window]
 
Table 1. Parameters Measured and Antibodies Tested in the Study, Indicating Source, Dilution, Visualization Method, Pattern of Reactivity, Threshold and Positive Control (Evaluated in Skin, Tonsil, and Reactive Lymph Node Tissue)

 
Scoring Systems

Immunostaining intensity was evaluated by two different pathologists (S.R.A.G. and J.L.R.P.) and scored using uniform and clear cut-off criteria, to maintain the reproducibility of the method. Discrepancies were resolved by simultaneous re-evaluation. Briefly, the result of immunostaining was recorded as negative or positive, and low versus high expression, taking into account the expression in tumoral cells and the specific cut-off for each marker (see Table 1 for definition of positive phenotype). As a general criterion, the cut-offs were selected to facilitate reproducibility, and when possible, to translate biological events. Selected sample replicates were highly reproducible in our series (96%), as other authors have found.9,14 STAT1-positive expression was considered only with respect to the nuclear signal that translates the active form of this protein.

Statistics

Clinical data and immunohistochemistry scoring were performed blind, and data were compiled only after all analyses were completed. Fisher’s exact test was used to test whether a specific protein-expression profile was associated with a particular histological stage of melanoma progression. Significance was concluded for values of P < 0.05. All statistical tests were two-sided. To avoid the influence of multiple testing, adjusted P values were also computed using the method proposed by Hochberg and Benjamini17 to minimize the false discovery rate.

Complete follow-up survival data for 6 years or more were available in 60 vertical malignant melanoma cases. The overall survival (OS) predictive value of the studied markers these cases was explored using Kaplan-Meier, log-rank test, and Cox regression analysis. A multivariate model was developed by backwards elimination, starting with all markers with a P value lower than 0.10 in the univariate analysis. This statistical significance level was selected to allow for optimal discovery in the initial phases of this analysis. From the final model for each patient a score was computed taking the linear predictor from the multivariate model.

Validation Set

Given the exploratory nature of the study, an independent series of 72 vertical growth phase melanoma cases was included to validate the prognostic value of the set of prognostic markers. This validation set was similar to the training set and included patients with vertical growth phase melanoma diagnosed from 1986 through 1998.

Validation was carried out in two ways: first, the previously mentioned score was computed using the linear predictor from the multivariate model in the original sample and the statistical significance of this score was tested. Differences in survival according to this score are presented graphically for both the original and the validation set of patients. For this representation, score values were collapsed into three risk groups, dividing the whole range into three equally spaced categories. Second, the same multivariate model was fitted in the validation sample to test whether the hazard ratios (HRs) obtained in this set of patients were different from those in the original model. All statistical analyses were carried out using the Stata Statistical Program (StataCorp 2001, Release 7.0).


    Results
 Top
 Abstract
 Materials and Methods
 Results
 Discussion
 References
 
Clinical Data

The series comprises 88 patients diagnosed with cutaneous malignant melanoma (41 males and 47 females). Their ages at the time of diagnosis ranged from 21 to 91 years (mean, 58 years). The average ages of patients with radial and vertical growth phases were 28 and 61 years and the percentage metastases were 0% and 55%, respectively. The survival analysis was restricted to vertical growth melanomas patients with follow-up information (n = 60) as, in this series, only these cases developed metastases and some of them died. In the patients with vertical growth phase melanomas the median follow-up was 61 months (range, 2 to 186 months). During the 6 years considered in the survival analysis, 4 were lost to follow-up, 19 patients died of melanoma, 4 patients died of other causes, and 33 patients remained alive.

Expression Profiling at Each Stage of Malignant Melanoma Progression

Immunohistochemical analysis of protein expression was carried out on 28 radial and 66 vertical growth phase malignant melanomas, 71 metastatic malignant melanoma, and 10 nevus specimens. The results of expression profiling at each stage are detailed in Table 2 and illustrated in Figure 1 and Figure 2 , where each phase in the growth of malignant melanoma is distinguished by a specific constellation of markers. Nevertheless, some of the most significant features are worth comment: S-100 was positive in all but one case (the exception being a metastasis). HMB45 and melan A (specific markers of melanocytic origin) were constitutively expressed in the majority of primary malignant melanomas [95.6% (88 of 92) for HMB45 and 92.4% (85 of 92) for melan A] and in most metastatic cases, [81% (55 of 68) and 75% (50 of 67), for HMB45 and melan A, respectively; see Table 2 ]. Ki-67, a proliferation marker, was significantly higher in vertical growth phase melanoma and metastases than in nevi and radial growth phase tumors.


View this table:
[in this window]
[in a new window]
 
Table 2. Contingency Analysis (Fisher’s Exact Test) Comparing the Level of Protein Expression in Each Progression Step of Cutaneous Malignant Melanoma

 


View larger version (108K):
[in this window]
[in a new window]
 
Figure 1. TMA design for melanoma progression. Cylinders corresponding to nevus (A), radial growth phase (B), vertical growth phase (C), and metastases (D). Immunohistochemical patterns. Core samples with positive and negative (or high and low) expression for selected antibodies are shown. All of the cases are representative of nevus-column A, and of each malignant melanoma progression step-columns B, C, and D. Note the high expression of cyclin D1 in radial (B) and metastases (D) when compared with vertical cases (C) and the loss of p16INK4a expression in metastases. Note also the loss of p27KIP1 and caveolin with tumor progression and the nuclear survivin expression in melanomas when compared with nevi. Original magnification for A–D, x40; insets, x600 and x800, respectively. HE, hematoxylin and eosin.

 


View larger version (38K):
[in this window]
[in a new window]
 
Figure 2. Signature in melanoma progression. Representative proteins differentially expressed in cutaneous malignant melanoma identified by tissue array analysis. Subheadings indicate protein function and arrows represent up- or down-regulation in radial growth phase melanoma relative to nevus; vertical growth phase relative to radial growth phase and metastasis versus vertical growth phase. If there was no difference in protein expression between one phase and the comparative phase, the name of the marker is not included. See also Table 2 for differences in protein expression. A total of 175 specimens were evaluated, including 10 nevus, 28 radial malignant melanoma, 66 vertical malignant melanoma, and 71 metastases (34 skin metastases and 37 nodal metastases).

 
High levels of expression of specific cyclins (cyclin A, cyclin D1, and cyclin D3) and CDKs (CDK1 and CDK 2) were found when comparing nevus to malignant melanoma. Particularly striking was cyclin D1, which was negative in all nevi and was markedly expressed in radial growth phase malignant melanoma (12 of 25, 48%) and metastases (21 of 65, 32%). Surprisingly, the expression decreased significantly in the deepest component of the primary vertical growth phase tumor (see Figure 1 ). In the case of cyclin D3, high levels of expression were found only in metastatic stages. We found no significant change in cyclin E protein expression in any melanocytic lesions; however, CDK 2, the normal cyclin E partner, was more strongly expressed in radial growth phase melanoma (27 of 28, 86%) than in nevus (0%) and its expression progressively diminished in the subsequent steps (46 of 66, 48% in vertical cases and 34 of 68, 34% in metastases, respectively).

In the group of cell cycle suppressors, loss of the p16INK4a protein was observed to be associated with advanced stages, with significantly lower expression levels in metastatic cases (48 of 68, 71%) compared with primary tumors (82 of 92, 89.13%) and benign lesions (9 of 9, 100%). The loss of p27KIP1 protein expression with melanoma progression was significant in vertical growth phase (30 of 66, 45%) compared with radial growth phase (19 of 25, 76%, P = 0.010).

Nuclear expression of the apoptotic inhibitor survivin was negative in all nevi (10 cases), and commonly expressed in malignant melanoma (97 of 159 cases, 61%), showing notably increased expression with melanoma progression. Regarding other proteins, caveolin, a membrane-scaffolding protein, experienced significant losses in primary malignant melanomas compared with nevi. MUM-1/IRF4, a known transcription factor detected in most primary melanocytic lesions (5 of 10, 50% benign nevi and 58 of 92, 70% of primary melanomas in our series, respectively), was progressively lost with tumoral advance and had a very low level of expression in metastatic cases (only 5 of 70, constituting 7% of positive cases).

Simultaneous Analysis of Vertical versus Metastatic Melanoma in the Same Patients

The existence of changes in the expression of a set of relevant molecules, when comparing vertical growth phase with metastatic melanoma, was confirmed in a restricted series of 30 patients, in which simultaneous analysis of samples representative from both stages was performed (Table 3) .


View this table:
[in this window]
[in a new window]
 
Table 3. Comparative Expression of Primary versus Metastatic Tumors in the Same Patient (30 Patients)

 
Protein Expression and Survival Analysis

None of the radial growth phase malignant melanoma developed metastases or cause-related death, thus we have only considered vertical growth cases with follow-up information (n = 60) in the survival analysis. The results of this analysis using Kaplan-Meier and Cox regression models are shown in Table 4 (more data concerning the univariate analysis are available in Supplemental Table 1 at http://ajp.amjpathol.org). Shorter overall survival (OS) was significantly related to loss of p16INK4a, high Ki-67, and positive expression of cyclin E, p21CIP1, Bcl-6, Rb, and HLA DP.


View this table:
[in this window]
[in a new window]
 
Table 4. Biological Markers Associated with Patient’s Outcome

 
The Cox multivariate regression model included four biological markers: p16INK4a, Bcl-6, Ki 67, and p21CIP1. The strongest predictors were p16INK4a and Bcl-6. The probability of death was around eight times higher when either p16INK4a was lost or Bcl-6 was positive.

The predictive model was not substantially altered by the inclusion of Breslow’s index as a variable, although the effect of Ki-67 was somewhat attenuated, probably reflecting its close relationship with Breslow’s index. This fact corroborates the view that the markers included in the prognostic model and Breslow’s index each contain independent information. To validate the predictor model, TMAs from an independent series of patients with follow-up information (n = 72) were stained and evaluated for the predictive set of markers.

A risk score was computed for each patient taking the linear predictor from the multivariate model. The formula of the score is depicted below, when each marker is considered 0 if negative and 1 if positive:

When this score was calculated for patients in the validation sample, it was significantly related to the probability of death (P = 0.001).

Figure 3 presents the survival curves for the original and the validation groups collapsing the score into three categories, as described in the Materials and Methods, and specifically demonstrates the existence of a subset of tumors with an unfavorable profile, corresponding to the third risk group. Finally, when the same multivariate model was fitted using the validation sample (see right-hand columns in Table 4 ) the loss of p16INK4a and the expression of Bcl-6 were again identified as the most significant predictors.



View larger version (17K):
[in this window]
[in a new window]
 
Figure 3. Kaplan-Meier estimation of overall survival according to the assigned probability in the multivariate analysis. A score was built-up according with the multivariate model. The survival curves for the original and the validation groups are presented. Patients are grouped collapsing the score values into three categories (low, intermediate, and high risk patients) obtained by dividing the whole hazard ratio range into three equally spaced categories (groups).

 

    Discussion
 Top
 Abstract
 Materials and Methods
 Results
 Discussion
 References
 
The analysis using TMAs allows the integration not only of the capability for detecting multiple proteins in large series of patients, but also the recognition of discrete cell subpopulations, such as intraepidermal melanocytes, which constitute the bulk of the malignant melanoma in the initial phases of melanoma genesis. The current study demonstrates the suitability of this technique in the study of a classical model in human tumor progression: malignant melanoma. To our knowledge, only a few studies based solely on the expression of single proteins9,18-20 have previously provided evidence of the feasibility of this powerful tool in malignant melanoma samples.

The present paper reports a comparative analysis of the different stages of the malignant melanoma sequence. Thus, each step in malignant melanoma progression is characterized by the expression of a specific profile: including cyclin D1, cyclin A, CDK1, CDK2, STAT1 in radial growth phase; Ki 67, survivin, and PKC-B in vertical growth phase; and cyclin D1, cyclin D3, and loss of p16INK4a, BclII, and MUM1 in metastatic melanoma (Figure 2) . The results of this study illustrate how melanoma cells progress, as do other aggressive tumors, through the deregulation of the mechanisms controlling proliferation and escape from programmed cell death.21 Strikingly, progression is meticulously choreographed, and each step is distinguished by the expression of a characteristic set of proteins.

Many of the changes observed in this series involve a key cell cycle step: the progression beyond the G1/S stage. Indeed, most of the cell cycle regulatory proteins found in this study to be deregulated are involved in the control of the G1/S transition, including cyclin D1, D3, cyclin E, CDK2, p16INK4a, p27KIP1, and p21CIP1. Although many of these changes are stage-specific, in general it seems that an increasing degree of expression of cyclins and CDKs, in conjunction with a loss of CDK inhibitors, facilitated the progression to advanced clinical and histological stages. These findings confirm previous observations in single G1/S markers in human malignant melanoma specimens6,7,9,22-24 and is supported by experimental observations in cell lines25,26 and animal models.27-30 Additionally, studies of familiar malignant melanoma have demonstrated mutations in genes regulating G1/S transition, including p16INK4a and CDK4.8,31,32

One of the most striking changes observed in this series is related to cyclin D1 protein. Cyclin D1 is negative in nevi (0 of 10) and expressed in 12 of 25 (48%) radial growth phase malignant melanomas. These findings strongly suggest a role for cyclin D1 in malignant melanoma development. Moreover, this study confirms the previous observation that cyclin D1 is increasingly expressed in malignant melanoma,6,9,33 and also indicates that the precise stage where cyclin D1 is increased is the radial growth phase, showing a trend (P = 0.08) in the metastatic stage. The diminishing expression toward the deep reticular dermis observed in vertical growth phase melanoma cases is consistent with the findings of Sauter and co-workers,9 in which the high level of cyclin D1 expression seemed to be confined to the superficial component of the tumor.

Vertical growth phase malignant melanoma shows a simultaneous increase in proliferation (Ki67) and a decrease in p27KIP1 protein expression (p 0.001) comparing with radial growth phase or benign lesions. Loss of p27KIP1 is required for the G1/S transition, as has been demonstrated in different experimental models.34 The study of SKP2, a protein involved in the ubiquitination and degradation of p27KIP1, shows a constant increase during the different stages of melanoma, which could explain the parallel increase in proliferation and decrease in p27KIP1 expression. A potential role of the extracellular matrix has also been proposed for inducing p27KIP1 degradation in melanoma.35

The significant loss of p16INK4a expression in the present series is correlated with advanced stages of malignant melanoma (metastatic disease). The p16INK4a protein exerts an inhibitory function in the cell cycle by acting at the level of the cyclin D/CDK4-Rb pathway. Inactivation of p16INK4a by homozygous deletions, point mutations, and promoter methylation has been involved in the genesis of malignant melanoma in familial and sporadic cases.10,23,26

Malignant melanomas also feature defective regulation of apoptosis in parallel with progression, as shown by the increasing overexpression of survivin from nevus (0 of 10) to radial (10 of 28, 36%), vertical growth phases (46 of 65, 71%), and metastases (41 of 66, 62%). The frequent expression of survivin in our series is consistent with the results of previous studies,11,36 suggesting that its activation is critical in resistance to apoptosis in malignant melanoma. This observation must be added to those already reported concerning APAF 1 in malignant melanoma.37

The transcription factor MUM-1/IRF4 also seems to play a role in melanoma progression, as previously suggested.18 Interestingly, our results reflect how this expression decreases according to tumor progression, from 85% (22 of 26) in radial and 55% (36 of 66) in vertical growth phase to 7% (5 of 70) in metastases.

Caveolin, a structural membrane-scaffolding protein, is involved in cell-signal transduction and in angiogenesis inhibition.38 It has been proposed that caveolin down-regulation may be associated with loss of apoptotic stimulus induced by caspase-339 and also with a significant role in neovascularization and, consequently, in development of metastatic disease.40-42 In this study, caveolin shows a loss of expression in malignant melanoma compared with nevus, which suggests that down-regulation of caveolin expression may contribute to malignant melanoma development.

This study also develops a predictor model for survival. The proteins included are p16INK4a, Ki67, p21CIP1, and Bcl-6. The data obtained from the overall survival model identify a group of patients with relatively short-term survival (<6 years) that seems to depend on an association between the absence of p16INK4a or the presence of Bcl-6 protein expression in conjunction with either high proliferation (Ki 67 >20) or positive p21CIP1. The absence of p16INK4a expression as a prognostic marker in cutaneous malignant melanoma has previously been noted.10 On the other hand, no data about the expression and significance of Bcl-6 protein in malignant melanomas have been reported to date. In this study, only a small number of invasive melanoma cases (5 of 64, 8%) expressed this protein, but it is noteworthy that all positive cases were strongly associated with poor prognosis in the univariate and the multivariate models. The inclusion of Breslow’s index in this predictive model does not produce any substantial change, thus showing that this index and the biomarkers included represent independent information. The independent series used to validate the model confirmed the adverse prognostic value of both the loss of p16INK4a and the acquisition of retinoblastoma markers.

In summary, a combination of tissue microarrays and clinical and pathological data can facilitate rapid characterization of candidate biomarkers of the development and regulation of progression in malignant melanoma tumors. The present analysis has highlighted the G1/S checkpoint abnormalities as being a critical step in the genesis and progression of malignant melanoma and has successfully identified new candidate proteins involved in melanoma genesis and progression as possible therapy targets.


    Acknowledgements
 
We thank the Spanish National Tumor Bank Network, CNIO, and are particularly grateful to Alicia Maroto (12 de Octubre Hospital, Madrid), Dr. Pilar Fernández Segoviano (Getafe Hospital), Dr. José L. Sarasa (Fundación Jiménez Díaz, Madrid), Dr. Anastasio Serrano Egea and Dr. Jesús Razquin Murillo (Virgen de la Luz Hospital, Cuenca), and Dr. Teresa Rivera (Móstoles Hospital) for their help in providing specific tissue samples for this study. Dr. Miguel Angel Vidal (Centro de Investigaciones Biologicas-Consejo Superior de Investigaciones Cientificos) and Dr. Giovanna Roncador (CNIO) have kindly provided some of the antibodies used in this study. We also thank Gonzalo Herrero Tambo for his expertise and excellent assistance with schematic pictures, Dr. David Rimm and Ana Diez for their valuable guidance with TMA construction, and Dr. Phil Mason for his help with the final version of the manuscript.


    Footnotes
 
Address reprint requests to Dr. Miguel A. Piris, Programa de Patología Molecular, Centro Nacional de Investigaciones Oncológicas, C/Melchor Fernández Almagro, 3, Madrid 28029, Spain. E-mail: mapiris{at}cnio.es

Supported by grants from the Ministerio de Sanidad y Consumo Fondo de Investigaciones Sanitaries (FIS 01/ 0037–03) and the Ministerio de Ciencia y Tecnologia (MCYT) (Bio2000 CO275/01 and 02), Spain. S. A. is supported by a grant from the Ministerio de Sanidad y Consumo (FIS 01/9269) and the Centro Nacional de Investigaciones Oncologies (CNIO).

Accepted for publication September 25, 2003.


    References
 Top
 Abstract
 Materials and Methods
 Results
 Discussion
 References
 

  1. Urist MM, Karnell LH: The National Cancer Data Base: report on melanoma. Cancer 1994, 74:782-788[Medline]
  2. Sober AJ, Lew RA, Koh HK, Barnhill RL: Epidemiology of cutaneous melanoma: an update. Dermatol Clin 1991, 9:617-629
  3. Koh HK: Cutaneous melanoma. N Engl J Med 1991, 325:171-182[Medline]
  4. Geller AC, Miller DR, Annas GD, Demierre MF, Gilchrest BA, Koh HK: Melanoma incidence and mortality among US whites, 1969–1999. JAMA 2002, 288:1719-1720[Free Full Text]
  5. Crowson AN, Margo CM, Mihn MC: The melanocytic proliferations. A Comprehensive Textbook of Pigmented Lesions 2001:pp 315-332, 501513 Wiley-Liss New York
  6. Maelandsmo GM, Florenes VA, Hovig E, Oyjord T, Engebraaten O, Holm R, Borresen AL, Fodstad O: Involvement of the pRb/p16/cdk4/cyclin D1 pathway in the tumorigenesis of sporadic malignant melanomas. Br J Cancer 1996, 73:909-916[Medline]
  7. Florenes VA, Faye RS, Maelandsmo GM, Nesland JM, Holm R: Levels of cyclin D1 and D3 in malignant melanoma: deregulated cyclin D3 expression is associated with poor clinical outcome in superficial melanoma. Clin Cancer Res 2000, 6:3614-3620[Abstract/Free Full Text]
  8. Soufir N, Avril MF, Chompret A, Demenais F, Bombled J, Spatz A, Stoppa-Lyonnet D, Benard J, Bressac-de Paillerets B: Prevalence of p16 and CDK4 germline mutations in 48 melanoma-prone families in France: The French Familial Melanoma Study Group. Hum Mol Genet 1998, 7:209-216[Abstract/Free Full Text]
  9. Sauter ER, Yeo UC, von Stemm A, Zhu W, Litwin S, Tichansky DS, Pistritto G, Nesbit M, Pinkel D, Herlyn M, Bastian BC: Cyclin D1 is a candidate oncogene in cutaneous melanoma. Cancer Res 2002, 62:3200-3206[Abstract/Free Full Text]
  10. Straume O, Sviland L, Akslen LA: Loss of nuclear p16 protein expression correlates with increased tumor cell proliferation (Ki-67) and poor prognosis in patients with vertical growth phase melanoma. Clin Cancer Res 2000, 6:1845-1853[Abstract/Free Full Text]
  11. Grossman D, McNiff JM, Li F, Altieri DC: Expression and targeting of the apoptosis inhibitor, survivin, in human melanoma. J Invest Dermatol 1999, 113:1076-1081[Medline]
  12. Kononen J, Bubendorf L, Kallioniemi A, Barlund M, Schraml P, Leighton S, Torhorst J, Mihatsch MJ, Sauter G, Kallioniemi OP: Tissue microarrays for high-throughput molecular profiling of tumor specimens. Nat Med 1998, 4:844-847[Medline]
  13. Nocito A, Kononen J, Kallioniemi OP, Sauter G: Tissue microarrays (TMAs) for high-throughput molecular pathology research. Int J Cancer 2001, 94:1-5[Medline]
  14. Garcia JF, Camacho FI, Morente M, Fraga M, Montalban C, Bellas TA, Castano A, Diez A, Flores T, Martin C, Martinez MA, Mazorra F, Menarguez J, Mestre MJ, Mollejo M, Saez AI, Sanchez L, Piris MA: Hodgkin and Reed-Sternberg cells harbor alterations in the major tumor suppressor pathways and cell-cycle checkpoints: analyses using tissue microarrays. Blood 2003, 101:681-689[Abstract/Free Full Text]
  15. Breslow A: Thickness, cross-sectional areas, and depth of invasion in the prognosis of cutaneous melanoma. Ann Surg 1970, 172:902-908[Medline]
  16. Clark WH, Jr, Elder DE, Guerry Dt, Braitman LE, Trock BJ, Schultz D, Synnestvedt M, Halpern AC: Model predicting survival in stage I melanoma based on tumor progression. J Natl Cancer Inst 1989, 81:1893-1904[Abstract/Free Full Text]
  17. Benjamini Y, Hochberg Y: Controlling the false discovery rate and practical and powerful approach to multiple testing. J R Stat Soc 1995, B57:289-300
  18. Natkunam Y, Warnke RA, Montgomery K, Falini B, van De Rijn M: Analysis of MUM1/IRF4 protein expression using tissue microarrays and immunohistochemistry. Mod Pathol 2001, 14:686-694[Medline]
  19. Kielhorn E, Provost E, Olsen D, D’Aquila TG, Smith BL, Camp RL, Rimm DL: Tissue microarray-based analysis shows phospho-ß-catenin expression in malignant melanoma is associated with poor outcome. Int J Cancer 2003, 103:652-656[Medline]
  20. Polsky D, Bastian BC, Hazan C, Melzer K, Pack J, Houghton A, Busam K, Cordon-Cardo C, Osman I: HDM2 protein overexpression, but not gene amplification, is related to tumorigenesis of cutaneous melanoma. Cancer Res 2001, 61:7642-7646[Abstract/Free Full Text]
  21. Malumbres M, Barbacid M: To cycle or not to cycle: a critical decision in cancer. Nat Rev Cancer 2001, 1:222-231[Medline]
  22. Sauroja I, Smeds J, Vlaykova T, Kumar R, Talve L, Hahka-Kemppinen M, Punnonen K, Jansen CT, Hemminki K, Pyrhonen S: Analysis of G(1)/S checkpoint regulators in metastatic melanoma. Genes Chromosomes Cancer 2000, 28:404-414[Medline]
  23. Sparrow LE, Eldon MJ, English DR, Heenan PJ: p16 and p21WAF1 protein expression in melanocytic tumors by immunohistochemistry. Am J Dermatopathol 1998, 20:255-261[Medline]
  24. Florenes VA, Maelandsmo GM, Kerbel RS, Slingerland JM, Nesland JM, Holm R: Protein expression of the cell-cycle inhibitor p27Kip1 in malignant melanoma: inverse correlation with disease-free survival. Am J Pathol 1998, 153:305-312[Abstract/Free Full Text]
  25. Tang L, Li G, Tron VA, Trotter MJ, Ho VC: Expression of cell cycle regulators in human cutaneous malignant melanoma. Melanoma Res 1999, 9:148-154[Medline]
  26. Sviderskaya EV, Hill SP, Evans-Whipp TJ, Chin L, Orlow SJ, Easty DJ, Cheong SC, Beach D, DePinho RA, Bennett DC: p16(Ink4a) in melanocyte senescence and differentiation. J Natl Cancer Inst 2002, 94:446-454[Abstract/Free Full Text]
  27. Sotillo R, Garcia JF, Ortega S, Martin J, Dubus P, Barbacid M, Malumbres M: Invasive melanoma in Cdk4-targeted mice. Proc Natl Acad Sci USA 2001, 98:13312-13317[Abstract/Free Full Text]
  28. Yang FC, Merlino G, Chin L: Genetic dissection of melanoma pathways in the mouse. Semin Cancer Biol 2001, 11:261-268[Medline]
  29. Bardeesy N, Bastian BC, Hezel A, Pinkel D, DePinho RA, Chin L: Dual inactivation of RB and p53 pathways in RAS-induced melanomas. Mol Cell Biol 2001, 21:2144-2153[Abstract/Free Full Text]
  30. Tietze MK, Chin L: Murine models of malignant melanoma. Mol Med Today 2000, 6:408-410[Medline]
  31. Zuo L, Weger J, Yang Q, Goldstein AM, Tucker MA, Walker GJ, Hayward N, Dracopoli NC: Germline mutations in the p16INK4a binding domain of CDK4 in familial melanoma. Nat Genet 1996, 12:97-99[Medline]
  32. Wolfel T, Hauer M, Schneider J, Serrano M, Wolfel C, Klehmann-Hieb E, De Plaen E, Hankeln T, Meyer zum Buschenfelde KH, Beach D: A p16INK4a-insensitive CDK4 mutant targeted by cytolytic T lymphocytes in a human melanoma. Science 1995, 269:1281-1284[Abstract/Free Full Text]
  33. Walker GJ, Flores JF, Glendening JM, Lin AH, Markl ID, Fountain JW: Virtually 100% of melanoma cell lines harbor alterations at the DNA level within CDKN2A, CDKN2B, or one of their downstream targets. Genes Chromosomes Cancer 1998, 22:157-163[Medline]
  34. Sanchez-Beato M, Camacho FI, Martinez-Montero JC, Saez AI, Villuendas R, Sanchez-Verde L, Garcia JF, Piris MA: Anomalous high p27/KIP1 expression in a subset of aggressive B-cell lymphomas is associated with cyclin D3 overexpression: p27/KIP1-cyclin D3 co-localization in tumor cells. Blood 1999, 94:765-772[Abstract/Free Full Text]
  35. Henriet P, Zhong ZD, Brooks PC, Weinberg KI, DeClerck YA: Contact with fibrillar collagen inhibits melanoma cell proliferation by up-regulating p27KIP1. Proc Natl Acad Sci USA 2000, 97:10026-10031[Abstract/Free Full Text]
  36. Chiodino C, Cesinaro AM, Ottani D, Fantini F, Giannetti A, Trentini GP, Pincelli C: Communication: expression of the novel inhibitor of apoptosis survivin in normal and neoplastic skin. J Invest Dermatol 1999, 113:415-418[Medline]
  37. Soengas MS, Capodieci P, Polsky D, Mora J, Esteller M, Opitz-Araya X, McCombie R, Herman JG, Gerald WL, Lazebnik YA, Cordon-Cardo C, Lowe SW: Inactivation of the apoptosis effector Apaf-1 in malignant melanoma. Nature 2001, 409:207-211[Medline]
  38. Okamoto T, Schlegel A, Scherer PE, Lisanti MP: Caveolins, a family of scaffolding proteins for organizing "preassembled signaling complexes" at the plasma membrane. J Biol Chem 1998, 273:5419-5422[Free Full Text]
  39. Liu J, Lee P, Galbiati F, Kitsis RN, Lisanti MP: Caveolin-1 expression sensitizes fibroblastic and epithelial cells to apoptotic stimulation. Am J Physiol 2001, 280:C823-C835
  40. Liu J, Razani B, Tang S, Terman BI, Ware JA, Lisanti MP: Angiogenesis activators and inhibitors differentially regulate caveolin-1 expression and caveolae formation in vascular endothelial cells: angiogenesis inhibitors block vascular endothelial growth factor-induced down-regulation of caveolin-1. J Biol Chem 1999, 274:15781-15785[Abstract/Free Full Text]
  41. Engelman JA, Wykoff CC, Yasuhara S, Song KS, Okamoto T, Lisanti MP: Recombinant expression of caveolin-1 in oncogenically transformed cells abrogates anchorage-independent growth. J Biol Chem 1997, 272:16374-16381[Abstract/Free Full Text]
  42. Koleske AJ, Baltimore D, Lisanti MP: Reduction of caveolin and caveolae in oncogenically transformed cells. Proc Natl Acad Sci USA 1995, 92:1381-1385[Abstract/Free Full Text]



This article has been cited by other articles:


Home page
JNCI J Natl Cancer InstHome page
B. E. G. Rothberg, M. B. Bracken, and D. L. Rimm
Tissue Biomarkers for Prognosis in Cutaneous Melanoma: A Systematic Review and Meta-analysis
J Natl Cancer Inst, April 1, 2009; 101(7): 452 - 474.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
T. Klatte, D. B. Seligson, J. LaRochelle, B. Shuch, J. W. Said, S. B. Riggs, N. Zomorodian, F. F. Kabbinavar, A. J. Pantuck, and A. S. Belldegrun
Molecular Signatures of Localized Clear Cell Renal Cell Carcinoma to Predict Disease-Free Survival after Nephrectomy
Cancer Epidemiol. Biomarkers Prev., March 1, 2009; 18(3): 894 - 900.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Pathol.Home page
I. Roodink, G. Kats, L. van Kempen, M. Grunberg, C. Maass, K. Verrijp, J. Raats, and W. Leenders
Semaphorin 3E Expression Correlates Inversely with Plexin D1 During Tumor Progression
Am. J. Pathol., December 1, 2008; 173(6): 1873 - 1881.
[Abstract] [Full Text] [PDF]


Home page
Clin. Cancer Res.Home page
P. D. Da Forno, J. H. Pringle, P. Hutchinson, J. Osborn, Q. Huang, L. Potter, R. A. Hancox, A. Fletcher, and G. S. Saldanha
WNT5A Expression Increases during Melanoma Progression and Correlates with Outcome
Clin. Cancer Res., September 15, 2008; 14(18): 5825 - 5832.
[Abstract] [Full Text] [PDF]


Home page
Cancer Res.Home page
C. K. Augustine, Y. Yoshimoto, M. Gupta, P. A. Zipfel, M. A. Selim, P. Febbo, A. M. Pendergast, W. P. Peters, and D. S. Tyler
Targeting N-Cadherin Enhances Antitumor Activity of Cytotoxic Therapies in Melanoma Treatment
Cancer Res., May 15, 2008; 68(10): 3777 - 3784.
[Abstract] [Full Text] [PDF]


Home page
CarcinogenesisHome page
O. Renner, J. Fominaya, S. Alonso, C. Blanco-Aparicio, J. F.M. Leal, and A. Carnero
Mst1, RanBP2 and eIF4G are new markers for in vivo PI3K activation in murine and human prostate
Carcinogenesis, July 1, 2007; 28(7): 1418 - 1425.
[Abstract] [Full Text] [PDF]


Home page
Cancer Res.Home page
S. R. Alonso, L. Tracey, P. Ortiz, B. Perez-Gomez, J. Palacios, M. Pollan, J. Linares, S. Serrano, A. I. Saez-Castillo, L. Sanchez, et al.
A High-Throughput Study in Melanoma Identifies Epithelial-Mesenchymal Transition as a Major Determinant of Metastasis
Cancer Res., April 1, 2007; 67(7): 3450 - 3460.
[Abstract] [Full Text] [PDF]


Home page
Genes Dev.Home page
S. Carreira, J. Goodall, L. Denat, M. Rodriguez, P. Nuciforo, K. S. Hoek, A. Testori, L. Larue, and C. R. Goding
Mitf regulation of Dia1 controls melanoma proliferation and invasiveness
Genes & Dev., December 15, 2006; 20(24): 3426 - 3439.
[Abstract] [Full Text] [PDF]


Home page
Cancer Res.Home page
D. Becker, M. C. Mihm, S. M. Hewitt, V. K. Sondak, J. W. Fountain, and M. Thurin
Markers and Tissue Resources for Melanoma: Meeting Report.
Cancer Res., November 15, 2006; 66(22): 10652 - 10657.
[Abstract] [Full Text] [PDF]


Home page
Mol. Cell. ProteomicsHome page
F. Bertucci, D. Birnbaum, and A. Goncalves
Proteomics of Breast Cancer: Principles and Potential Clinical Applications
Mol. Cell. Proteomics, October 1, 2006; 5(10): 1772 - 1786.
[Abstract] [Full Text] [PDF]


Home page
Cancer Res.Home page
K. Gao, D. L. Dai, M. Martinka, and G. Li
Prognostic Significance of Nuclear Factor-{kappa}B p105/p50 in Human Melanoma and Its Role in Cell Migration.
Cancer Res., September 1, 2006; 66(17): 8382 - 8388.
[Abstract] [Full Text] [PDF]


Home page
NEJMHome page
A. J. Miller and M. C. Mihm Jr.
Melanoma.
N. Engl. J. Med., July 6, 2006; 355(1): 51 - 65.
[Full Text] [PDF]


Home page
J. Clin. Pathol.Home page
R Bauer, P J Wild, S Meyer, F Bataille, A Pauer, M Klinkhammer-Schalke, F Hofstaedter, and A K Bosserhoff
Prognostic relevance of P-cadherin expression in melanocytic skin tumours analysed by high-throughput tissue microarrays
J. Clin. Pathol., July 1, 2006; 59(7): 699 - 705.
[Abstract] [Full Text] [PDF]


Home page
Clin. Cancer Res.Home page
L. Tang, D. L. Dai, M. Su, M. Martinka, G. Li, and Y. Zhou
Aberrant Expression of Collagen Triple Helix Repeat Containing 1 in Human Solid Cancers.
Clin. Cancer Res., June 15, 2006; 12(12): 3716 - 3722.
[Abstract] [Full Text] [PDF]


Home page
Clin. Cancer Res.Home page
S. Scala, P. Giuliano, P. A. Ascierto, C. Ierano, R. Franco, M. Napolitano, A. Ottaiano, M. L. Lombardi, M. Luongo, E. Simeone, et al.
Human Melanoma Metastases Express Functional CXCR4
Clin. Cancer Res., April 15, 2006; 12(8): 2427 - 2433.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
P. A. Gimotty, P. Van Belle, D. E. Elder, T. Murry, K. T. Montone, X. Xu, S. Hotz, S. Raines, M. E. Ming, P. Wahl, et al.
Biologic and Prognostic Significance of Dermal Ki67 Expression, Mitoses, and Tumorigenicity in Thin Invasive Cutaneous Melanoma
J. Clin. Oncol., November 1, 2005; 23(31): 8048 - 8056.
[Abstract] [Full Text] [PDF]


Home page
JCOHome page
P. A. Gimotty, J. Botbyl, S.-j. Soong, and D. Guerry
A Population-Based Validation of the American Joint Committee on Cancer Melanoma Staging System
J. Clin. Oncol., November 1, 2005; 23(31): 8065 - 8075.
[Abstract] [Full Text] [PDF]


Home page
Clin. Cancer Res.Home page
E. Grafstrom, S. Egyhazi, U. Ringborg, J. Hansson, and A. Platz
Biallelic Deletions in INK4 in Cutaneous Melanoma Are Common and Associated with Decreased Survival
Clin. Cancer Res., April 15, 2005; 11(8): 2991 - 2997.
[Abstract] [Full Text] [PDF]


Home page
Ann. Surg. Oncol.Home page
D. S. Tyler and C. M. Balch
Nomograms and Staging in Melanoma: New Tools for Better Predicting Outcomes
Ann. Surg. Oncol., April 1, 2005; 12(4): 267 - 269.
[Full Text] [PDF]


Home page
Cancer Res.Home page
J. Jacquemier, C. Ginestier, J. Rougemont, V.-J. Bardou, E. Charafe-Jauffret, J. Geneix, J. Adelaide, A. Koki, G. Houvenaeghel, J. Hassoun, et al.
Protein Expression Profiling Identifies Subclasses of Breast Cancer and Predicts Prognosis
Cancer Res., February 1, 2005; 65(3): 767 - 779.
[Abstract] [Full Text] [PDF]


Home page
Arch DermatolHome page
S. Nambiar, A. Mirmohammadsadegh, R. Doroudi, A. Gustrau, A. Marini, G. Roeder, T. Ruzicka, and U. R. Hengge
Signaling Networks in Cutaneous Melanoma Metastasis Identified by Complementary DNA Microarrays
Arch Dermatol, February 1, 2005; 141(2): 165 - 173.
[Abstract] [Full Text] [PDF]


Home page
Cancer Res.Home page
A. J. Berger, R. L. Camp, K. A. DiVito, H. M. Kluger, R. Halaban, and D. L. Rimm
Automated Quantitative Analysis of HDM2 Expression in Malignant Melanoma Shows Association with Early-Stage Disease and Improved Outcome
Cancer Res., December 1, 2004; 64(23): 8767 - 8772.
[Abstract] [Full Text] [PDF]


Home page
Cancer Res.Home page
K. A. DiVito, A. J. Berger, R. L. Camp, M. Dolled-Filhart, D. L. Rimm, and H. M. Kluger
Automated Quantitative Analysis of Tissue Microarrays Reveals an Association between High Bcl-2 Expression and Improved Outcome in Melanoma
Cancer Res., December 1, 2004; 64(23): 8773 - 8777.
[Abstract] [Full Text] [PDF]


Home page
Cancer Res.Home page
K. Hoek, D. L. Rimm, K. R. Williams, H. Zhao, S. Ariyan, A. Lin, H. M. Kluger, A. J. Berger, E. Cheng, E. S. Trombetta, et al.
Expression Profiling Reveals Novel Pathways in the Transformation of Melanocytes to Melanomas
Cancer Res., August 1, 2004; 64(15): 5270 - 5282.
[Abstract] [Full Text] [PDF]


Home page
J. Clin. Pathol.Home page
M R Hussein
Genetic pathways to melanoma tumorigenesis
J. Clin. Pathol., August 1, 2004; 57(8): 797 - 801.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Supplemental Material
Right arrow Purchase Article
Right arrow View Shopping Cart
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Alonso, S. R.
Right arrow Articles by Rodríguez-Peralto, J. L.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Alonso, S. R.
Right arrow Articles by Rodríguez-Peralto, J. L.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS