help button home button Am J Pathol R & D Systems
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Purchase Article
Right arrow View Shopping Cart
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Chang, S. H.
Right arrow Articles by Trump, B. F.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Chang, S. H.
Right arrow Articles by Trump, B. F.
(American Journal of Pathology. 2000;156:637-649.)
© 2000 American Society for Investigative Pathology


Regular Articles

Studies on the Mechanisms and Kinetics of Apoptosis Induced by Microinjection of Cytochrome c in Rat Kidney Tubule Epithelial Cells (NRK-52E)

Seung H. Chang, Patricia C. Phelps, Irene K. Berezesky, M. Lee Ebersberger, Jr. and Benjamin F. Trump

From the Department of Pathology, University of Maryland School of Medicine, Baltimore, Maryland


    Abstract
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 References
 
Recent reports substantiating the role of cytochrome c in the induction of apoptosis led us to examine the kinetics and mechanisms involved in this process as an extension of our ongoing studies of cell injury and cell death. Microinjection of cytochrome c into NRK-52E kidney cells produced rapid apoptosis, which usually began within 30 minutes and reached a maximum of 60–70% by 3 hours. The changes that occurred included four phases: an initial shrinkage phase, an active phase, a spherical phase, and a necrotic phase. For morphological purposes, the progressive changes were followed by phase-contrast and fluorescence microscopy, transmission and scanning electron microscopy, and time-lapse video microscopy. Cells first showed shrinkage, then displayed multiple pseudopods, which rapidly extended and retracted, giving the cells a bosselated appearance. During this active phase there was chromatin condensation, mitochondria were swollen but retained membrane potential, and the endoplasmic reticulum was dilated. Within 2–4 hours, active-phase cells became spherical and smooth-surfaced but were still alive, the nuclei showed chromatin clumping, the mitochondria underwent high-amplitude swelling but retained membrane potential, the endoplasmic reticulum was highly dilated, and many large apical vacuoles were present. Elevation of [Ca2+]i was seen at the late spherical phase, shortly before cell death. Pretreatment with the caspase 3 inhibitor (Ac-DEVD-CHO) prevented apoptosis, whereas overexpression of Bcl-2 did not. Depletion of cellular ATP by cyanide inhibition of energy metabolism prevented cytochrome c from inducing the active and later phases of apoptosis. The results clearly indicate that cytochrome c-induced apoptosis is a dynamic and energy-requiring process that has a distinct active and spherical phase before cell death.



    Introduction
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 References
 
Apoptosis is an important mechanism of cell death in the kidney during development and after many and diverse injuries.1 As part of our ongoing studies of cell injury and cell death in the kidney, we are exploring the detailed stages and mechanisms of apoptosis and comparing them with those of oncosis. As the prelethal changes of oncosis have been well characterized, we wished to carefully examine the changes of apoptosis before and after cell death.2,3

Cytochrome c release into the cytosol has been implicated as an intermediate event in the initiation of apoptosis after a variety of toxic and other stimuli and injury in several cell types4-9 ; it also serves as a useful model, inasmuch as we found that after microinjection, the early phase of apoptosis usually begins within 30 minutes. This means that the progression of changes in single injected cells can be followed by many important techniques. These include the use of time-lapse phase-contrast video microscopy, digital imaging fluorescence, and confocal microscopy to analyze mitochondrial membrane potential, mitochondrial permeability transition, cytosolic calcium concentration [Ca2+]i, and cell death, as well as phase-contrast and electron microscopy for morphological characterization.

The results clearly defined three principal prelethal stages or phases of apoptosis and characterized the morphology at the light and electron microscope levels. We also showed that ATP is required for the initiation of apoptosis, that the loss of mitochondrial membrane potential and the precipitation of the mitochondrial permeability transition occur immediately before cell death, and that increased [Ca2+]i occurs in the prelethal phase just before cell death. The results also revealed that after apoptotic cell death the necrosis phase is essentially identical to the necrotic phase that is seen after the induction of oncosis, eg, by chemical anoxia or nephrotoxins such as mercuric chloride.


    Materials and Methods
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 References
 
Cell Culture

All media and additives were obtained from Gibco-BRL. The NRK-52E normal kidney cell line (CRL 1571) was obtained from the American Type Culture Collection. This cell line is derived from the proximal tubule epithelium (PTE) of the rat kidney, is nontumorigenic, and retains many morphological and physiological characteristics of PTE in vivo.10,11 Cells were grown in low-glucose Dulbecco’s modified Eagle’s medium (DMEM) with 10% fetal bovine serum and antibiotics (100 U/ml penicillin, 100 µg/ml streptomycin) and maintained at 37°C in 5% CO2, 95% air. Cells were plated onto 0.8 x 1.4 cm segments of letter-identified, grid-embossed glass slides (Cel-Line) and grown to about 40% confluency for microinjection.

Microinjection and Examination of Cells

Before microinjection, a grid slide with cells was transferred to a special culture dish that was constructed by predrilling a hole in the bottom of the dish and gluing a cover glass over the hole with aquarium cement. The dish was placed on the stage of an Olympus IMT-2 inverted microscope equipped with a Narishige microinjection system. The cytoplasm of the cells, which averaged 4 µl in volume, was microinjected with approximately 1 fl of 500 µmol/L (6.2 mg/ml) rat heart cytochrome c (Sigma) containing 5 µg/ml Texas Red dextran (Molecular Probes). For each slide usually four to five grid windows of cells were injected, to achieve a total of 200–300 injected cells. The cells were followed by phase-contrast and fluorescence microscopy, using a Texas Red, UV, or rhodamine filter, for up to 24 hours. For time-lapse video microscopy, a video camera was interfaced between the microscope and the tape recorder. Images were recorded at 1/60 of normal time.

Examination and Evaluation of Apoptotic Cells

Apoptotic cells were evaluated by phase-contrast and fluorescence microscopy; the presence of Texas Red fluorescence was used to confirm that the cell had been microinjected. In addition, the DNA-binding fluorphore dye Hoechst 33342 (1 µmol/ml) was used to further evaluate chromatin morphology in living cells. The percentage of Texas Red positive cells that showed morphological features of apoptosis was calculated every 30 minutes for 5 hours in 18 separate experiments. Propidium iodide was used to identify dead cells. In addition, cells were fixed for 10 minutes in 2% phosphate-buffered paraformaldehyde, followed by 20 minutes in absolute methanol, and then mounted with Vectashield mounting medium (Vector Labs) containing 0.5 µg/ml diamidino phenylindole (DAPI) for DNA staining. Microinjected cells fixed in buffered paraformaldehyde were stained with an ApopTag plus fluorescein assay kit from Intergen Co. (Purchase, NY) (formerly a product of Oncor, Gaithersburg, MD) to detect DNA fragmentation in morphologically identified apoptotic cells. ApopTag uses the terminal deoxytidyl transferase (TdT)-mediated dUTP nick-end labeling assay (TUNEL assay) to specifically stain single- and double-stranded DNA breaks associated with apoptosis. Cells were stained according to the instructions of the manufacturer. The percentage of the fluorescein-positive cells was calculated over a 4-hour period in several separate experiments. The Texas Red remained visible after fixation and again was used to identify microinjected cells.

Cytosolic Calcium [Ca2+]i Analysis

Cells grown on glass coverslips mounted over holes in 60-mm dishes were incubated with 5 µmol/L Fura 2/AM (Molecular Probes, Eugene, OR) for 90 minutes at 22°C after microinjection of cytochrome c. Analysis was performed by digital imaging fluorescence microscopy (DIFM), using a Nikon inverted microscope and a dual-excitation chopper-based Tracor Northern FluoroPlex III and image analysis system (Tracor Northern, Madison, WI) as previously described.12 After loading, three to five fields of Fura-2-loaded uninjected control cells were selected, and image pairs were collected at 340/380-nm excitation. Two hours after microinjection of cytochrome c and Fura-2/AM loading, image pairs were collected at 20-minute intervals for up to 6 hours in fields having apoptotic cells. [Ca2+]i calibrations were performed as described previously.12 The ratioed image pairs were displayed using a pseudocolor or gray scale to indicate levels of [Ca2+]i.

Mitochondrial Membrane Potential Analysis

The mitochondrial membrane potential (MMP) (terminology defining the integrity of the inner mitochondrial membrane and associated respiratory chain complexes) was measured indirectly by use of the vital fluorochrome dye rhodamine 123. Loss of membrane integrity is indicated when the dye leaves the mitochondria. The time of opening of the mitochondria permeability pore(s) (high-conductance pore(s)), which precipitates the mitochondrial permeability transition, is also often indirectly established by the loss of rhodamine 123 from mitochondria. Cytochrome c-microinjected cells were incubated with 5 µg/ml rhodamine 123 (Sigma) for 20–40 minutes at 37°C. Mitochondrial staining in apoptotic cells was monitored and photographed for 4 hours by both fluorescence and phase microscopy with the inverted Olympus microscope. Bright fluorescence was maintained by reincubating the grids periodically in medium with rhodamine 123.

Electron Microscopy

For transmission electron microscopy (TEM), cells were plated onto grid slides precoated with a thin carbon film, microinjected with cytochrome c, and then fixed after 0.5, 1, 1.5, 2, and 4 hours with 2% glutaraldehyde in 0.1 mol/L sodium cacodylate buffer (pH 7.3) for 2–16 hours, followed by 1% osmium tetroxide fixation (1 hour at 22°C). Before fixation, apoptotic cells were located on grid slide windows and accurately mapped on a clear acetate sheet for future reference and for final epoxy block trimming. Cells on grid slides were gently dehydrated and infiltrated with Polybed 812 epoxy resin (Polysciences), mounted on a blank epoxy block, and cured. Blocks were trimmed using the prefixation acetate maps to pinpoint exact cell location, and thin sections were cut, stained, examined, and photographed with a JEOL EX1200 transmission electron microscope. For scanning electron microscopy (SEM) samples were fixed, dehydrated, critical-point dried, gold coated, examined, and photographed with an AMR-1000 scanning electron microscope.

Treatment of Cells with Protease and Enzyme Inhibitors

Cells were incubated with either the caspase-3 inhibitor Ac-DEVD-CHO (Ac-Asp-Glu-Val-L-aspartic acid aldehyde) or the caspase 1-inhibitor YVAF-CHO (Ac-Tyr-Val-Ala-ASp aldehyde) (Bioscience, King of Prussia, PA) for 1.5 hours before microinjection of cytochrome c. Both inhibitors were used at various concentrations ranging from 5 to 200 µmol/L and were kept in the media throughout the course of the experiment.

Microinjection of Bcl-2

Cytochrome c was microinjected into NRK-52E cells that had been stably transfected with the Bcl-2 gene (NRK-Bcl-2) and which overproduced Bcl-2 protein.13 In separate experiments, the vector pD5-neo/Bcl-2 was microinjected into the nuclei of NRK-52E cells 24 hours before the coinjection of cytochrome c and Texas Red dextran. The vector was kindly supplied by Dr. Paul Amstad.14

Actin Staining

Injected cells on grid slides were sampled at 30-minute intervals up to 4 hours, fixed in 1.5% formaldehyde (10–30 minutes), and then stored in PBS. Cells were first permeabilized with Triton X-100 (0.5%) for 3 minutes before staining for 30 minutes with a 1:10 dilution of fluorescein phalloidin (Molecular Probes). Grids were then mounted on coverslips with Vectashield medium and photographed by fluorescence microscopy, using either a fluorescein filter or a dual Texas Red/fluorescein filter.

ATP Depletion

Cells grown on grids were preincubated in DMEM without serum for 30 minutes and then treated with freshly prepared potassium cyanide to inhibit mitochondrial respiration and sodium iodoacetate to block glycolysis (KCN + IAA), in equal concentrations ranging from 0.25 to 1 mmol/L for different times (0.5, 1, 1.5, 2–4 hours) before microinjection with cytochrome c. The percentage of dead cells was calculated for each time point, and a final optimum concentration of 0.25 mmol/L was selected. Cells were also grown in flasks for adenosine triphosphate (ATP) evaluation and treated with 0.25 mmol/L KCN and 0.25 mmol/L IAA for time periods similar to those mentioned above but were not microinjected with cytochrome c. At zero time and at each time point, a flask of cells was exposed to 1 ml trypsin-EDTA for 10 minutes, followed by the addition of 2 ml DMEM without serum. Aliquots of cells were analyzed by a luciferase method,15 using the Sigma Assay Kit and a luminometer (model TD-20-20; Turner Designs). ATP concentrations were expressed in fmol/cell.


    Results
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 References
 
Microinjection of cytochrome c resulted in a very rapid initiation of the apoptotic pathway in NRK-52E cells. After microinjection, the number of injected cells that became apoptotic over a period of 5 hours was counted at 30- or 60-minute time intervals. The progressive morphological changes were analyzed and recorded. The cell changes that occurred during apoptosis after microinjection were divided into an initial shrinkage phase, an active phase, a quiescent spherical phase, and a final necrosis phase at cell death. Results are presented in correlation with these phases.

Control Cells

The untreated NRK-52E cells in culture formed colonies of epithelial cells that were polyhedral in shape and contained eccentric nuclei that bulged upward and had multiple nucleoli. At 100% confluency, the cells exhibited a compact cobblestone appearance, as reported previously.10,11 The surfaces of the cells were covered with short microvilli (Figure 1A) , and the apical region contained vesicles, tubules, and vacuoles similar to those of PTE in vivo. The mitochondria were elongated and had a moderately dense matrix (Figure 2A) . A network of actin was situated immediately below the apical cell surface, and a well-developed network of actin bundles was seen in the cytosol with phalloidin staining. In apical regions of the cells, microtubules were associated with the actin filaments and were seen elsewhere in the cytoplasm, where they formed a characteristic network. The Golgi apparatus was well developed and surrounded by multivesicular bodies, secondary lysosomes, and occasional triglyceride droplets.



View larger version (141K):
[in this window]
[in a new window]
 
Figure 1. Scanning EM of a control cell and cells microinjected with cytochrome c. A: A typical untreated epithelial cell with many short microvilli and thin peripheral processes (original magnification, x2400). B: A contracted cell in the early (1 hour) active phase of apoptosis, showing multiple pseudopods on the cell body and on remnant cytoplasmic strands (arrows) (original magnification, x2800). C: Cells in late active phase (2 hours) that have formed aggregates and show large pseudopods. The upper group includes three or four active-phase cells (original magnification, x3100). D: Two spherical-phase cells (4 hours), identified by shape and lack of pseudopods. Occasional pitted areas are seen at the cell surface (arrows) (original magnification, x3500). These areas are presumed to correspond to vacuoles, as seen in Figure 2D .

 


View larger version (184K):
[in this window]
[in a new window]
 
Figure 2. A: Transmission EM of a normal untreated cell, showing a nucleus and elongated mitochondria (original magnification, x3750). B and C: Active-phase cells after microinjection, showing multiple pseudopods, often containing annular patterns of RER profiles, dense free ribosomes, and nuclear fragments or processes (arrows). Cellular organelles are concentrated in one area, mitochondria (M) are mostly condensed or slightly swollen, and the RER is dilated (original magnification, x4500). In B at lower left, note a process of a necrotic cell (arrowhead). Also note at middle right a pseudopod with a nuclear process showing dense chromatin (arrow). In C at lower left, there is a narrow band region of chromatin with nuclear pores (arrowheads); also note two pseudopods with a nuclear process (arrows). D: A spherical phase cell with an eccentric nucleus having peripheral patches of dense chromatin, nuclear budding (arrow), highly dilated RER, swollen mitochondria (M), and large apical vacuoles (V) (original magnification, x3000). An outlined area of nuclear filaments is enlarged (inset) (original magnification, x8250).

 
Shrinkage and Active Phase

Within 30 minutes after microinjection of cytochrome c, some cells began to exhibit apoptotic changes, but others changed less rapidly. Within 2–3 hours approximately 60–70% of the microinjected cells became apoptotic, as evaluated by morphological criteria (Figure 3) . In the experiments where cells were stained with ApopTag, about 70–80% of the microinjected cells became fluorescent (or ApopTag-positive) within 2–3 hours (Figure 4) . Initially, the cells exhibited a very rapid shrinkage phase, becoming roundish and leaving behind cytoplasmic strands (Figures 1B and 5B) . The active phase immediately followed this. In this phase the cells exhibited rapid extension and retraction of buds or pseudopods (not to be confused with bleb formations seen in oncosis) over the entire cell surface (Figures 1B, 1C, 5C, 6E, 7A, and 7B) . Many of these pseudopods had secondary pseudopods (Figure 1B , arrows) that also extended and retracted. This active phase lasted for a period of approximately 30 minutes to 4 hours, although occasionally a few cells remained active for as long as 6 hours. In the early active phase there is positive cell staining after use of the TUNEL ApopTag kit (Figure 8, A and B) .



View larger version (24K):
[in this window]
[in a new window]
 
Figure 3. Graph of percentage of apoptotic cells (in media with serum) seen over a 5-hour time period in four experiments after microinjection with cytochrome c and in one experiment where cells were microinjected with Bcl-2 plasmid (pD5-neo-Bcl-2) 24 hours before cytochrome c microinjection. Also shown is a curve representing cells that were incubated with 50 mmol/L Ac-DEVD-CHO for 1.5 hours before, during, and after microinjection with cytochrome c, which shows minimal apoptosis similar to that of control cells.

 


View larger version (13K):
[in this window]
[in a new window]
 
Figure 4. Graph of percentage of cytochrome c microinjected cells that were positive for ApopTag staining over a period of 4 hours, indicating DNA strand breaks characteristic of apoptosis.

 


View larger version (116K):
[in this window]
[in a new window]
 
Figure 5. Series of phase-contrast images of the same group of live cells after microinjection of cytochrome c (original magnification, x785). A: Just after microinjection. B: Thirty minutes after microinjection, showing a cell beginning to shrink (arrow). C: Thirty-two minutes after microinjection, showing the start of active-phase apoptosis (arrow). D: A fluorescent image (UV filter) of the cells stained with Hoechst 33342 at 35 minutes, demonstrating early chromatin condensation in the apoptotic cell (arrow).

 


View larger version (82K):
[in this window]
[in a new window]
 
Figure 6. Sets of phase-contrast images (left) and their corresponding fluorescent images (right) of control cells and cells microinjected with cytochrome c, followed by incubation with rhodamine 123 (original magnification, x430). A and B: Control cells. B: The fluorescent staining of thread-like mitochondria. C and D: Two groups of active-phase cells. D: Staining of condensed mitochondria. E and F: Two groups of spherical-phase cells. F: Shows staining of mitochondria, indicating maintenance of mitochondrial membrane potential. (Arrows in D and F indicate apoptotic cells.)

 


View larger version (72K):
[in this window]
[in a new window]
 
Figure 8. Phase and fluorescent images of cells after comicroinjection with cytochrome c and Texas Red dextran, fixed and stained with the ApopTag assay kit to determine DNA fragmentation (original magnification, x500). A: Texas Red fluorescent image of cells 30 minutes after microinjection and in early active phase. B: A fluorescein fluorescent image of the identical area, showing ApopTag-positive staining. C: Phase-contrast image of cells in the spherical phase 3 hours after microinjection. D: A fluorescein fluorescent image of the identical area, showing ApopTag-positive staining.

 
In this active phase most of the organelles were aggregated in the perinuclear regions, while the cell periphery was relatively organelle-free (Figure 2, B and C) . The nuclei showed chromatin condensation, which was mild at first and then extreme. At the same time, multiple patches of chromatin were seen with the use of DAPI on fixed cells (Figure 7D) or Hoechst 33342 dye on living cells (Figure 5D) , giving the appearance of nuclear fragmentation. These nuclear "fragments" were often observed in the extending and retracting pseudopods (Figure 2, B and C) . However, in many EM sections it was seen that these fragments were often connected to the main body of the nucleus by a very narrow stem and therefore represented nuclear processes (see Figure 12 ). Occasionally, portions of pseudopods pinched off and were observed floating in the medium. During this phase, an almost immediate disorganization of the normal actin network occurred, which was replaced by patchy homogeneous areas of actin staining throughout the cell. The actin staining did not extend into the pseudopods. DIFM revealed a slight increase of [Ca2+]i (Figures 9B, a –c). SEM of this phase clearly revealed the details of the pseudopods and the retraction processes and showed that groups of adjacent apoptotic cells tended to form aggregates (Figure 1C) .



View larger version (119K):
[in this window]
[in a new window]
 
Figure 7. Sets of phase-contrast and companion fluorescent images of cells after comicroinjection of cytochrome c and fixable Texas Red dextran (original magnification, x540). A (phase) and B (fluorescent): Cells 2 hours after microinjection. Groups of active apoptotic cells with pseudopods (A, arrows) also show Texas Red fluorescence (B, arrows), verifying positive microinjection (four cells are not positive for microinjection; A, arrowheads). C (phase) and D (fluorescent): Cells 4 hours after microinjection. Some cells are in the spherical phase (C, arrows) and show condensed chromatin after fixation and DAPI staining (D, arrows).

 


View larger version (175K):
[in this window]
[in a new window]
 
Figure 12. Transmission EM of a spherical-phase cell, showing areas of intense chromatin clumping and a large, dramatic nuclear-chromatin bud with a bilobular configuration (original magnification, x15,600). The inset shows a smaller nuclear chromatin process, which can be identified by the presence of a nuclear envelope and small strands that connect the process with the main body of the nucleus (arrows) (original magnification, x13,000).

 


View larger version (56K):
[in this window]
[in a new window]
 
Figure 9. A: Phase-contrast images of Fura-2-loaded cells after microinjection with cytochrome c. A: a, b, and c: Active-phase cells at 2 hours, 2 hours, and 3 hours, respectively. A: d, e, and f: Spherical-phase cells at 5 hours, 5.25 hours, and 6 hours, respectively. B: Ratioed and normalized images of the identical cells in A. Cells were analyzed for [Ca2+]i by digital imaging fluorescence microscopy. Images are displayed in gray tone, ranging from ~200 nmol/L (darkest) to 900 nmol/L calcium (whitest). The calcium range for the active phase cells was from 150 to 200 nmol/L (B, b and c), and for the spherical cells the maximum range was 900 nmol/L (B, d, cell 2), 500 nmol/L (B, e, cells 1 and 2), and 500 nmol/L (B, f, cell 3). Scale bar: A and B, 22.3 mm.

 
TEM revealed that the apoptotic cells were shrunken with a denser cytosol than the controls (Figure 2, B and C) . The pseudopods typically contained free ribosomes and sometimes profiles of rough endoplasmic reticulum (RER) (Figure 10) , which often assumed an annular pattern (Figure 2C) . Mitochondria and/or nuclear fragments or long and irregular nuclear processes were also observed in the pseudopods (Figures 2B, 2C, and 10) . Aggregates of ~20-nm filaments were observed in the cytosol (Figure 10 , inset). In the apical regions of the cell, enlarged vesicles and vacuoles were seen. The RER cisternae were often dilated, as were those of the Golgi apparatus.



View larger version (172K):
[in this window]
[in a new window]
 
Figure 10. Transmission EM of an active-phase cell, showing portions of several pseudopods and part of the central organelle area. Mitochondria appear to be slightly swollen and rounded, and the RER is dilated. Pseudopods contain a few mitochondria, free ribosomes, RER, and an occasional nuclear process with condensed chromatin (left pseudopod, arrowhead). Within the organelle region are phagolysosomes (arrows) and areas of filaments measuring ~200 nm (original magnification, x16,500). The inset shows a prominent area of filaments from another active-phase cell (original magnification, x16,500).

 
The mitochondria differed from the controls in that the profiles were rounded instead of elongated (Figures 2B, 2C, and 10) . On occasion, mitochondrial profiles showed matrical condensation. Studies using rhodamine 123 revealed persistence of the mitochondrial membrane potential (MMP) (Figure 6D) , but there was no mitochondrial swelling.

Spherical Phase

Beginning approximately 2–4 hours after microinjection, the cells became spherical and quiescent (Figures 1D, 2D, 7C, 8C, 8D, and 9B, d –f). SEM confirmed the spherical shape and showed some remnants of the retraction processes (Figure 1D) . The surface of these cells did not show pseudopods, but instead often revealed a pitted appearance (Figure 1D , arrows) corresponding to the vacuoles seen by TEM. Spherical cells showed positive staining after the use of the TUNEL ApopTag assay kit, indicating DNA fragmentation (Figure 8 C,D). TEM typically showed a polarized appearance with the eccentric nucleus at one pole and a series of variably sized membrane-bound vacuoles at the other pole (Figure 2D) . Many of these apical vacuoles were highly dilated, and some could be seen to communicate with the cell surface.

The cytosol was relatively electron-dense, with closely packed ribosomes (Figure 11) . The cytosol also contained numerous phagolysosomes (Figure 11 , arrowheads) and frequently contained bundles of filaments similar to those seen in the active phase. At this stage the nuclei showed intense chromatin clumping (Figure 12) and marked shape changes, sometimes resulting in multiple nuclear profiles in any one thin-section plane. In most cases the nuclear processes, which were often quite small, could be identified by the recognition of a nuclear envelope and the fact that many distant nuclear protrusions could be seen to connect with the main part of the nucleus (Figure 12 , inset). However, nuclear chromatin could sometimes be seen in the pseudopods of active-phase cells without any identifiable nuclear envelope (Figure 2, B and C , arrows). Most nuclei were markedly irregular and frequently contained nuclear inclusions composed of aggregates of filaments (Figure 2D , inset). Nucleoli often showed marked segregation. The RER, on the other hand, was even more dilated than in the active phase (Figures 11 and 12) . In general, the mitochondria were seen as rounded profiles that showed high-amplitude swelling of the inner compartments (Figure 11 , arrows). The MMP, however, remained unchanged in virtually all of the cells observed (Figure 6F) . At the late stages of the spherical phase, but before cell death, [Ca2+]i was markedly increased (Figure 9B, d –f).



View larger version (114K):
[in this window]
[in a new window]
 
Figure 11. Transmission EM of the perinuclear area of a spherical phase cell. A dense chromatin area in the nucleus is just visible at the bottom of the micrograph. Mitochondria are rounded (arrows) and show high-amplitude swelling of the inner compartment, the cytoplasm is densely packed with free ribosomes, the RER is dilated, and phagolysosomes are present (arrowheads) (original magnification, x15,600).

 
Necrotic Phase

Fragments of cells in the necrotic phase were seen adjacent to cells in the active and spherical phases (Figure 2B , lower left, arrowhead). In these cells, the cytosol was swollen, as was the RER and the mitochondria, which often showed flocculent intramatrical densities. These changes were identical to those seen after many other injuries that do not cause apoptosis, such as ischemia or mercuric chloride toxicity.

Cytosolic Calcium Analysis

DIFM studies showed that normal cells had a [Ca2+]i range of 50–100 nmol/L, and cells in the active phase showed a slight increase to about 200 nmol/L (Figure 9B, a –c). There was an increase to approximately 900 nmol/L in the late stages of the spherical phase, just before cell death (Figure 9B, d –f).

Caspase-3 Inhibition

Pretreatment of cells with Ac-DEVD-CHO before and after microinjection of cytochrome c prevented all of the changes of the active phase, whereas pretreatment with YVAD-CHO apparently had no effect (Figure 3) .

Excess Bcl-2

Microinjection of cells with cytochrome c after overexpression of Bcl-2, resulting from either transfection by NRK-Bcl-2 or microinjection with the pD5-neo/Bcl-2 vector, resulted in no inhibition of the apoptotic pathway (Figure 3) .

ATP Analysis

Preincubation of cells with 0.25 mmol/L KCN + 0.25 mmol/L IAA for 1.5 hours before cytochrome c microinjection showed a maximum of about 30% apoptosis in microinjected cells by 4 hours. However, preincubation for 2 hours or longer with 0.25 mM KCN + 0.25 mM IAA followed by microinjection of cytochrome c resulted in the complete absence of apoptosis (Figure 13) . (Note: Control cells in DMEM without serum, microinjected with cytochrome c, resulted in almost 100% of the cells becoming apoptotic by 1–2 hours, whereas microinjected cells in DMEM with serum had a maximum of about 60–70% apoptosis by 2–3 hours (Figure 3) .)



View larger version (19K):
[in this window]
[in a new window]
 
Figure 13. Graph of percentage of apoptotic cells in media without serum over a 5-hour period after different pretreatment times with 0.25 mmol/L KCN + 0.25 mmol/L IAA, followed by microinjection of cytochrome c. Zero time represents the time of microinjection. Control cells (no chemical treatment) had almost 100% apoptosis by 1–2 hours. Cells pretreated for up to 1.5 hours before microinjection showed a reduction to about 30% apoptosis by 4 hours, and cells pretreated for 2 hours or longer before microinjection had no apoptotic cells.

 
Control cells and cells pretreated with 0.25 mmol/L KCN + 0.25 mmol/L IAA for from 0.5 to 4 hours, but not postmicroinjected with cytochrome c, were assayed forATP. Control cells contained approximately 20 fmol ATP/cell; by 2 hours of treatment, cells had approximately 4 fmol/cell, and by 4 hours they had approximately 2 fmol/cell.


    Discussion
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 References
 
Summary of Kinetics

These studies clearly show that microinjection of cytochrome c in NRK-52E cells resulted in apoptosis, followed by cell death and necrosis. The changes proceeded rapidly and were particularly dramatic when viewed by time-lapse video microscopy. The apoptotic phase began as early as 30 minutes after microinjection, and within 2–3 hours 60–70% of the microinjected cells (as evaluated morphologically) and 70–80% by the ApopTag assay were apoptotic. Cell death, as indicated by nuclear propidium iodide staining, occurred at the late spherical phase, frequently when the cells were detaching from the substrate.

Examination of time-lapse video tapes (accelerated 60 times) revealed that the process of cytochrome c-induced apoptosis was extremely dynamic. (The excellent review on cell death by G. Majno and I. Joris2 provides earlier descriptions of this phenomenon.) In our most graphic video sequences, the changes occurred explosively once they began. The initial shrinkage phase of the cell was followed by active pseudopod formation around the periphery of the cell. Although this active phase typically lasted for 1–1.5 hours, some cells continued active pseudopod formation for as long as 6 hours. This prolonged active and prelethal phase of apoptosis strongly suggests that ATP is required for this violent activity, as has been suggested by other models. Reports by Tsujimoto16 and Lieberthal et al17 support the hypothesis that both cytochrome c and a sizable pool of ATP are necessary to induce apoptosis. Our preliminary experiments using KCN + IAA as a model of inhibition of energy metabolism showed that cells treated with 0.25 mmol/L concentrations of both for 2 hours before microinjection with cytochrome c resulted in a reduction of ATP and complete prevention of apoptosis. The ATP assay data showed a correlation between the loss of ATP and the absence of apoptosis, which also supports the hypothesis that apoptosis is an ATP-requiring phenomenon. The maintenance of ATP in the active phase provides an explanation for the relatively normal-appearing mitochondria and normal range of cytosolic calcium seen in this phase. After the active phase, the cells again became quiescent. They changed shape, rounded up, and became more or less spherical. The cells remained in this conformation until they began to die (as shown by uptake of PI into nuclei) and detach from the coverslip.

Morphological Alterations

Shape Changes

The initial shrinkage and retraction of the cells in the first phase as observed by phase-contrast microscopy is most likely related to loss of water from the cytosol. Bortner and co-workers18 have hypothesized that shrinkage is secondary to loss of K+ and Na+ from the cytosol in that K+ at normal concentrations (when efflux is prevented) inhibited DNA fragmentation and caspase-3 activity, suggesting an important early role for K+ loss in apoptosis.

The subsequent active phase of pseudopod formation and the ultimate rounding up and retraction of the cells imply marked dynamic alterations in the cytoskeleton, probably involving actin and associated proteins. During this phase, actin staining patterns were markedly abnormal, with loss of the normal F-actin patterns and replacement by patchy, homogeneously staining areas throughout the cell. Actin staining appeared to be concentrated at the base of the pseudopods, whereas the pseudopods per se showed almost no staining. Similar bands of actin staining were also observed at the base of cytoplasmic blebs in rat PTE cells after treatment with HgCl2.19

The fact that caspase-3 inhibition eliminates all of these shape changes and changes in actin staining leads us to presume that caspase-3 is directly involved. Actin is known to be a major cellular substrate for caspase-3, and Williams’s group20 has reported that caspase-3 cuts gelsolin, which is a Ca2+-dependent actin-severing and -capping protein. The cleaved gelsolin fragments can, in turn, sever actin polymers. Microinjection of cells with NH2-terminal gelsolin fragments was shown to result in actin depolymerization and cellular shape changes, whereas gelsolin-null cells were shown to be resistant to the apoptotic shape changes induced by tumor necrosis factor (TNF) plus cycloheximide.20 Because our data showed no significant [Ca2+]i elevation during the active phase, we presume that normal concentrations of [Ca2+]i are sufficient for these putative gelsolin-induced changes.

Mitochondrial Changes

The mitochondria also underwent dynamic changes in conformation, which related to the phases of apoptosis. In the untreated NRK cells, the mitochondria appeared as long, thread-like bodies that were in continual movement, as seen in time-lapse video microscopy. By TEM, they appeared as elongated profiles with moderately dense matrices and narrow intercristal spaces. During the active phase, where there is dramatic extension and retraction of pseudopods, mitochondria remained in their orthodox conformation. Some, however, show matrical condensation. The latter can be seen during periods of rapid ATP utilization, such as state 3 respiration,21 and is completely compatible with the presumed ATP requirement for cells in the active phase, as mentioned above.

When the cells entered the quiescent spherical phase, the mitochondria began to show varying degrees of matrical swelling, similar to that which occurs in oncosis in renal tubules after other types of prelethal injury, such as total ischemia in vivo,22 or after exposure to many nephrotoxins, including mercuric chloride.12 This swelling is known to be reversible and is usually associated with ATP depletion.3 In the spherical phase the MMP initially remains intact, as measured by rhodamine 123 retention, demonstrating that the mitochondrial permeability transition had not occurred. The progression to cell death followed by necrosis then takes place and the mitochondria show flocculent densities. The identical changes leading up to cell death and necrosis are shared by apoptosis and oncosis, as recently pointed out by LeMasters.23

Because treatment with Ac-DEVD-CHO prevented all of the mitochondrial changes, it is presumed that caspase-3 is either directly or indirectly involved. On the other hand, overexpression of Bcl-2 did not prevent these mitochondrial changes, which implies that, at least in this system, Bcl-2 overexpression did not prevent changes in mitochondrial inner membrane permeability. Furthermore, the observation that Bcl-2 overexpression did not protect against apoptosis may render it less likely that caspase-3 produces mitochondrial swelling by attacking the mitochondrial permeability transition pore complex directly.24 In our experiments, Bcl-2 protection was not observed downstream of cytochrome c, as suggested by Rosse et al.25 However, they used Bax-induced apoptosis, which they reported invokes a different type of cell death pathway.25 At the same time it has been reported that Bcl-2 can be cleaved, at least in some circumstances, by caspases. Furthermore, cleavage of Bcl-2 may not only inactivate these proteins, but may also produce fragments that promote apoptosis.26

The results of previous work in our laboratory have indicated that Bcl-2 protection resulting from oxidant injury is due to mitochondrial buffering of increased [Ca2+]i.13 This buffering has also been reported to occur in neural cells.27 Another possibility for this protection is that the change in inner membrane permeability may be secondary to caspase-induced activation of a phospholipase A2, as suggested by Atsumi et al28 and Wissing et al.29

This study has shown that microinjection of cytochrome c into NRK-52E cells results in rapid apoptosis that can be separated into four distinct morphological phases: shrinkage, active, spherical, and necrotic. It was also found that the caspase-3 inhibitor Ac-DEVD-CHO totally prevented apoptosis, whereas excess Bcl-2 did not. In addition, preliminary data showed that ATP is a requirement for the active phase of apoptosis.


    Acknowledgements
 
We thank Dr. Judy M. Strum for her kind help with the manuscript and Perry Comegys for his excellent photographic assistance. This is contribution no. 3981 from the Cellular Pathobiology Laboratory.


    Footnotes
 
Supported by National Institutes of Health grant DK15440.

Accepted for publication October 13, 1999.


    References
 Top
 Abstract
 Introduction
 Materials and Methods
 Results
 Discussion
 References
 

  1. Davis MA, Ryan DH: Apoptosis in the kidney. Toxicol Pathol 1998, 26:810-825[Abstract/Free Full Text]
  2. Majno G, Joris I: Apoptosis, oncosis, and necrosis: an overview of cell death. Am J Pathol 1995, 146:3-15[Abstract]
  3. Trump BF, Berezesky IK, Chang SH, Phelps PC: The pathways of cell death: oncosis, apoptosis, and necrosis. Toxicol Pathol 1997, 25:82-88[Abstract/Free Full Text]
  4. Liu X, Kim CN, Yang J, Jemmerson R, Wang X: Induction of apoptotic program in cell-free extracts: requirement of dATP and cytochrome c. Cell 1996, 86:147-157[Medline]
  5. Kluck RM, Bossy-Wetzel E, Green DR, Newmeyer DD: The release of cytochrome c from mitochondria: a primary site for Bcl-2 regulation of apoptosis. Science 1997, 275:1132-1136[Abstract/Free Full Text]
  6. Kharbanda S, Pandey P, Schofield L, Israels S, Roncinske R, Yoshida K, Bharti A, Yuan Z-M, Saxena S, Weichselbaum R, Nalin C, Kufe D: Role for Bcl-xL as an inhibitor of cytosolic cytochrome c accumulation in DNA damage-induced apoptosis. Proc Natl Acad Sci USA 1997, 94:6939-6942[Abstract/Free Full Text]
  7. Yang J, Liu X, Bhalla K, Kim CN, Ibrado AM, Cai J, Peng T-I, Jones DP, Wang X: Prevention of apoptosis by Bcl-2: release of cytochrome c from mitochondria blocked. Science 1997, 275:1129-1132[Abstract/Free Full Text]
  8. Zhivtovsky B, Orrenius S, Brustugun OT, Doskeland SO: Injected cytochrome c induces apoptosis. Nature 1998, 391:449-450[Medline]
  9. Li F, Srinivasan A, Wang Y, Armstrong RC, Tomaselli KJ, Fritz LC: Cell-specific induction of apoptosis by microinjection of cytochrome c. J Biol Chem 1997, 272:30299-30305[Abstract/Free Full Text]
  10. Phelps PC, Best CJ, Berezesky IK, Merriman RL, Tanzer LR, Boder GB, Trump BF: Studies on the mechanism of sulofenur and LY295501 toxicity: effect on the regulation of cytosolic calcium in relation to cytotoxicity in normal and tumorigenic rat kidney cell lines. Cancer Lett 1995, 97:7-15[Medline]
  11. Best CJM, Tanzer LR, Phelps PC, Merriman RL, Boder GB, Trump BF, Elliget KA: Characterization of the rat kidney epithelial cell line NRK-52E and two H-ras-transformed variants. In Vitro Cell Dev Biol Animal 1999, 35:205-214[Medline]
  12. Smith MW, Phelps PC, Trump BF: Cytosolic Ca2+ deregulation and blebbing after HgCl2 injury to cultured rabbit proximal tubule cells as determined by digital imaging microscopy. Proc Natl Acad Sci USA 1991, 88:4926-4930[Abstract/Free Full Text]
  13. Ichimiya M, Chang SH, Liu H, Berezesky IK, Trump BF, Amstad PA: Effect of Bcl-2 on oxidant-induced cell death and intracellular Ca2+ mobilization. Am J Physiol 1998, 275:C832-C839[Abstract/Free Full Text]
  14. Amstad PA, Liu H, Ichimiya M, Chang S, Berezesky IK, Trump BF: Bcl-2 enhancement of malignant transformation in mouse epidermal JB6 cells. Mol Carcinog 1997, 20:231-239[Medline]
  15. Lundin A, Hasenson M, Persson J, Pousette A: Estimation of biomass in growing cell lines by adenosine triphosphate assay. Methods Enzymol 1986, 133:27-42[Medline]
  16. Tsujimoto Y: Apoptosis and necrosis: intracellular ATP as determined for cell death modes. Cell Death Differ 1997, 4:429-434
  17. Lieberthal W, Menza SA, Levine JS: Graded ATP depletion can cause necrosis or apoptosis of cultured mouse proximal tubular cells. Am J Physiol 1998, 274:F315-F327[Abstract/Free Full Text]
  18. Bortner CD, Hughes FM, JR, Cidlowski JA: A primary role for K+ and Na+ efflux in the activation of apoptosis. J Biol Chem 1997, 272:32436-32442[Abstract/Free Full Text]
  19. Elliget KA, Phelps PC, Trump BF: HgCl2-induced alteration of actin in cultured primary rat proximal tubule epithelial cells visualized by fluorescein phalloidin. Cell Biol Toxicol 1991, 7:263-280[Medline]
  20. Kothakota S, Azuma T, Reinhard C, Klippel A, Tang J, Chu K, McGarry TJ, Kirschner MW, Koths K, Kwiatkowski DJ, Williams LT: Caspase-3-generated fragment of gelsolin: effector of morphological change in apoptosis. Science 1997, 278:294-298[Abstract/Free Full Text]
  21. Kahng MW, Berezesky IK, Trump BF: Metabolic and ultrastructural response of rat kidney cortex to in vitro ischemia. Exp Mol Pathol 1978, 29:183-198[Medline]
  22. Glaumann B, Trump BF: Studies on the pathogenesis of ischemic cell injury. III. Morphological changes of the proximal pars recta tubules (P3) of the rat kidney made ischemic in vivo. Virchows Arch B 1975, 19:303-323
  23. LeMasters JJ: Mechanism of hepatic toxicity. V. Necroapoptosis and the mitochondrial permeability transition: shared pathways to necrosis and apoptosis. Am J Physiol 1999, 276:G1-G6[Abstract/Free Full Text]
  24. Marzo I, Brenner C, Kroemer G: The central role of the mitochondrial megachannel in apoptosis: evidence obtained with intact cells, isolated mitochondria, and purified protein complexes. Biomed Pharmacother 1998, 52:248-251[Medline]
  25. Rosse T, Olivier R, Monney L, Rager M, Conus S, Fellay I, Jansen B, Borner C: Bcl-2 prolongs cell survival after bax-induced release of cytochrome c. Nature 1998, 391:496-499[Medline]
  26. Cheng EH-Y, Kirsch DG, Clem RJ, Ravi R, Kastan MB, Bedi A, Ueno K, Hardwick JM: Conversion of Bcl-2 to a Bax-like death effector by caspases. Science 1997, 278:1966-1968[Abstract/Free Full Text]
  27. Murphy AN, Bredesan DE, Cortopassi G, Fiskum G: Bcl-2 potentiates the maximal calcium uptake capacity of neural cell mitochondria. Proc Natl Acad Sci USA 1996, 93:9893-9898[Abstract/Free Full Text]
  28. Atsumi G, Tajima M, Hadano A, Nakatani Y, Murakami M, Kudo I: Fas-induced arachidonic acid release is mediated by Ca2+-independent phospholipase A2 but not cytosolic phospholipase A2, which undergoes proteolytic inactivation. J Biol Chem 1998, 273:13870-13877[Abstract/Free Full Text]
  29. Wissing D, Mouritzen H, Egeblad M, Poirer GG, Jaattela M: Involvement of caspase-dependent activation of cytosolic phospholipase A2 in tumor necrosis factor-induced apoptosis. Proc Natl Acad Sci USA 1997, 94:5073-5077[Abstract/Free Full Text]



This article has been cited by other articles:


Home page
Am. J. Physiol. Heart Circ. Physiol.Home page
R. Maruyama, G. Takemura, N. Tohse, T. Ohkusa, Y. Ikeda, K. Tsuchiya, S. Minatoguchi, M. Matsuzaki, T. Fujiwara, and H. Fujiwara
Synchronous progression of calcium transient-dependent beating and sarcomere destruction in apoptotic adult cardiomyocytes
Am J Physiol Heart Circ Physiol, April 1, 2006; 290(4): H1493 - H1502.
[Abstract] [Full Text] [PDF]


Home page
JCBHome page
M. B. Potts, A. E. Vaughn, H. McDonough, C. Patterson, and M. Deshmukh
Reduced Apaf-1 levels in cardiomyocytes engage strict regulation of apoptosis by endogenous XIAP
J. Cell Biol., December 19, 2005; 171(6): 925 - 930.
[Abstract] [Full Text] [PDF]


Home page
JCBHome page
K. M. Wright, M. W. Linhoff, P. R. Potts, and M. Deshmukh
Decreased apoptosome activity with neuronal differentiation sets the threshold for strict IAP regulation of apoptosis
J. Cell Biol., October 25, 2004; 167(2): 303 - 313.
[Abstract] [Full Text] [PDF]


Home page
JCBHome page
P. R. Potts, S. Singh, M. Knezek, C. B. Thompson, and M. Deshmukh
Critical function of endogenous XIAP in regulating caspase activation during sympathetic neuronal apoptosis
J. Cell Biol., November 24, 2003; 163(4): 789 - 799.
[Abstract] [Full Text] [PDF]


Home page
J. Biol. Chem.Home page
K. Anestal and E. S. J. Arner
Rapid Induction of Cell Death by Selenium-compromised Thioredoxin Reductase 1 but Not by the Fully Active Enzyme Containing Selenocysteine
J. Biol. Chem., April 25, 2003; 278(18): 15966 - 15972.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
M. Deshmukh, C. Du, X. Wang, and E. M. Johnson Jr
Exogenous Smac Induces Competence and Permits Caspase Activation in Sympathetic Neurons
J. Neurosci., September 15, 2002; 22(18): 8018 - 8027.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Pathol.Home page
K. Roberg, K. Kagedal, and K. Ollinger
Microinjection of Cathepsin D Induces Caspase-Dependent Apoptosis in Fibroblasts
Am. J. Pathol., July 1, 2002; 161(1): 89 - 96.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Physiol. Renal Physiol.Home page
E. Peherstorfer, B. Mayer, S. Boehm, A. Lukas, P. Hauser, G. Mayer, and R. Oberbauer
Effects of microinjection of synthetic Bcl-2 domain peptides on apoptosis of renal tubular epithelial cells
Am J Physiol Renal Physiol, July 1, 2002; 283(1): F190 - F196.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Pathol.Home page
R. Maruyama, G. Takemura, T. Aoyama, K. Hayakawa, M. Koda, Y. Kawase, X. Qiu, Y. Ohno, S. Minatoguchi, K. Miyata, et al.
Dynamic Process of Apoptosis in Adult Rat Cardiomyocytes Analyzed Using 48-Hour Videomicroscopy and Electron Microscopy : Beating and Rate are Associated with the Apoptotic Process
Am. J. Pathol., August 1, 2001; 159(2): 683 - 691.
[Abstract] [Full Text]


Home page
J. Physiol.Home page
Y. Okada, E. Maeno, T. Shimizu, K. Dezaki, J. Wang, and S. Morishima
Receptor-mediated control of regulatory volume decrease (RVD) and apoptotic volume decrease (AVD)
J. Physiol., April 1, 2001; 532(1): 3 - 16.
[Abstract] [Full Text] [PDF]


Home page
Proc. Natl. Acad. Sci. USAHome page
H. Zieler and J. A. Dvorak
Invasion in vitro of mosquito midgut cells by the malaria parasite proceeds by a conserved mechanism and results in death of the invaded midgut cells
PNAS, October 10, 2000; 97(21): 11516 - 11521.
[Abstract] [Full Text] [PDF]


Home page
Proc. Natl. Acad. Sci. USAHome page
S. P. Yu and D. W. Choi
Ions, cell volume, and apoptosis
PNAS, August 15, 2000; 97(17): 9360 - 9362.
[Full Text] [PDF]


Home page
Am. J. Physiol. Renal Physiol.Home page
L. Michea, C. Combs, P. Andrews, N. Dmitrieva, and M. B. Burg
Mitochondrial dysfunction is an early event in high-NaCl-induced apoptosis of mIMCD3 cells
Am J Physiol Renal Physiol, June 1, 2002; 282(6): F981 - F990.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Purchase Article
Right arrow View Shopping Cart
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Chang, S. H.
Right arrow Articles by Trump, B. F.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Chang, S. H.
Right arrow Articles by Trump, B. F.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS