StatCompGraphShortCourse < Main < Vanderbilt Biostatistics Wiki

<div align="center">
*%NAVY%S%ENDCOLOR% for Statistical Data Analysis and Graphics*
%BR%Frank E. Harrell, Jr. ([[mailto:f.harrell@vanderbilt.edu][f.harrell@vanderbilt.edu]])
%BR%Professor of Biostatistics and Statistics
%BR%Chair, Department of Biostatistics
%BR%Vanderbilt University School of Medicine
%BR%Course Web Page: StatCompCourse
</div> 

   <b>Objectives</b>: To be able to use the high-level object-oriented %NAVY%S%ENDCOLOR% language to
      1 recode, manipulate, and reshape data
      1 annotate &amp; document data elements
      1 inspect and manipulate data
      1 compute and display summary statistics
      1 make somewhat complex tables
      1 use Trellis and other %NAVY%S%ENDCOLOR% graphics to display information in multiple variables or multiple summary statistics
      1 use the =Hmisc= library to extend %NAVY%S%ENDCOLOR% graphics by automatically labeling curves, drawing legends, drawing error bars and bands, and plotting aggregate data
      1 compute sample size and power
      1 be introduced to missing value imputation, simulation, and bootstrapping using %NAVY%S%ENDCOLOR%
      1 conduct reproducible analysis

   <b>Audience</b>: Applied statisticians and data analysts who already know how to use %NAVY%S%ENDCOLOR% basics. The course will be of particular interest to:
      * applied statisticians who want to incorporate new statistical methodology and graphical methods into their everyday work
      * data analysts who want to increase productivity in analyzing data and generating statistical graphics
      * data analysts who want to learn new ways to prepare graphical and tabular reports
      * research statisticians who want to acquire new tools for conducting and presenting methodologic research
      * SAS users who want to learn %NAVY%S%ENDCOLOR% or to enhance their %NAVY%S%ENDCOLOR% skills
      * %LATEX% users who want to interface %LATEX% to %NAVY%S%ENDCOLOR%
      * statisticians responsible for producing data and safety monitoring and other clinical reports for pharmaceutical and medical device studies who seek alternatives to Microsoft Word

   <b>Statistical&nbsp;Software&nbsp;used&nbsp;during&nbsp;the&nbsp;Course</b>: %NAVY%R%ENDCOLOR%
   %BR%Operating System: Microsoft Windows or Linux
   %BR%Add-on %NAVY%S%ENDCOLOR% library: =Hmisc= (built-in to %NAVY%S%ENDCOLOR%; may be obtained from [[Main.Hmisc][Hmisc]] for use with %NAVY%R%ENDCOLOR% or %NAVY%S-Plus%ENDCOLOR%).  For %NAVY%R%ENDCOLOR%, =Hmisc= may easily be downloaded and stalled from CRAN.

   <b>Course&nbsp;Overview</b>: This short course begins with a quick summary of the %NAVY%S%ENDCOLOR% language and objects and a comparison of %NAVY%S%ENDCOLOR% and SAS. This is followed by methods for inspecting, recoding, reshaping, and manipulating data, some of which use extensions of %NAVY%S%ENDCOLOR% found in the freely available =Hmisc= package written by the instructor. Usage of %NAVY%S%ENDCOLOR% for more advanced statistical methods such as simulation and bootstrapping is surveyed. Then basic sample size and power calculations are discussed, followed by an example using the =Hmisc= library to simulate power for the Cox-logrank test for comparing event times in a clinical trial in which drop-in, drop-out, and delayed treatment response are present. Then major emphasis is given to table making and %NAVY%S%ENDCOLOR% and =Hmisc= graphical functions useful in everyday exploratory work and in presenting final summary statistics. An overview of principles of constructing good graphics will be given. The course will cover how data may be aggregated in a variety of ways including many suitable for use with Trellis graphics, and it will cover how Trellis may be extended to produce more flexible graphics that display confidence bands and error bars, for example, and automatically label curves and produce keys. The course concludes with discussion of some tools for making analyses reproducible, an important facit for regulatory and other scientific review of final results. Advantages of using %NAVY%S%ENDCOLOR% in conjunction with the %LATEX% document processing / typesetting system for constructing reproducible statistical reports and hyperlinked PDF documents are discussed.
   %BR%%BR%The short course is based on the premises that (1) graphical presentation of information is fundamental to understanding data and presenting research findings and (2) modern computing tools are required for extracting information and drawing inferences from data and for constructing the best graphical displays. Such computing tools allow researchers to generate highly informative graphics in a flexible fashion with a minimum of programming. These tools also allow researchers having a grasp of statistical concepts to use modern computationally-intensive techniques to draw inferences without making as many strict assumptions (e.g., about data distributions) as in the past.
   %BR%%BR%The course will utilize both lecture and interactive laboratory format. The former will be used to teach students about the %NAVY%S%ENDCOLOR% language and the add-on %NAVY%S%ENDCOLOR% =Hmisc= library written by the instructor. During interactive labs students will learn how to use %NAVY%S%ENDCOLOR% to manipulate, inspect, analyze, graph raw and summary data, and to report statistical summaries. The %NAVY%S%ENDCOLOR%/%LATEX% interface written by Richard Heiberger and Frank Harrell is briefly introduced. 

   <b>Prerequisites</b>: At least several months experience using %NAVY%S%ENDCOLOR%, including good facility with the %NAVY%S%ENDCOLOR% command line, and experience in statistical data analysis.

<b>Outline</b>
   1 %NAVY%S%ENDCOLOR% Statistical Computing and Graphics Language (Chapter 1 of Alzola &amp; Harrell)
      * Why %NAVY%S%ENDCOLOR%? 
      * Starting %NAVY%S%ENDCOLOR% on Windows 
      * Commands vs. GUIs 
      * Basic commands 
      * Entering and saving commands 
      * Differences between %NAVY%S%ENDCOLOR% and SAS 
      * A quick tour of useful system tools (see also EmacsLaTeXTools) 
   1 Objects, Getting Help, Functions, Attributes, and Libraries (Chapter 2 of A&amp;H)
      * Objects 
      * Getting help 
      * Functions 
      * Vectors 
      * Matrices, lists, data frames 
      * Attributes 
      * Add-on function library: =Hmisc=
   1 Data in %NAVY%S%ENDCOLOR% (Chapter 3)
      * Importing data 
      * Adjustments to variables after input 
      * Cleanup imported data (3.1) 
      * Inspecting data (descriptive statistics, checking quality, 3.2.3-3.4) 
   1 Operating in %NAVY%S%ENDCOLOR% (Chapter 4)
      * Reading and writing data frames and variables 
      * Functions for manipulating and summarizing data (4.2.2-4.2.8, 11.4.3-11.3.3) 
      * Missing value imputation (4.5) 
      * Creating derived variables  
   1 Review of Data Frame Creation, Annotation, and Analysis
      * Importing external data 
      * Making global changes to a data frame 
      * Changing variables within a data frame 
      * Analyses of the entire data frame 
      * Analysis of individual variables 
   1 Brief Introduction to Missing Value Imputation, Simulation &amp; Bootstrapping (4.5-4.6)
      * Simple imputation and bookkeeping of imputed values 
      * Simulation example 
      * Basic bootstrap example 
   1 Probability and Statistical Functions (Chapter 5)
      * Statistical summaries 
      * Probability distributions 
      * Statistical tests 
      * Basic power/sample size calculations; one example of using simulution to compute power in a complex situation 
      * Computing confidence limits using commands &amp; menus  
   1 Making Tables (Chapter 6 of A&amp;H) 
   1 Some Principles of Graph Construction (A &amp; H 10) 
   1 Some Useful Traditional Graphics and the %NAVY%S-Plus%ENDCOLOR% GUI
      * Introduction to the GUI (see Pam Goodman handout at [[%ATTACHURL%/../RS/gui.graphics.tricks.pdf][gui.graphics.tricks.pdf]])
      * Histograms and density plots (=hist.data.frame, histSpike=) 
      * Cumulative distribution plots (=Hmisc ecdf= function, 11.3) 
      * Box plots 
   1 Using %NAVY%S%ENDCOLOR% Functions for Graphing Data (Chapters 11-12 in A &amp; H)
      * Basic plotting commands 
      * Graphical snapshot of a dataset: =Hmisc datadensity= 
      * Graphical summary of missing data patterns: =Hmisc naclus= 
      * Graphical summary of interrelationships of variables: =Hmisc varclus= 
      * Basic scatterplots and rug plots; scatterplot matrices 
      * Nonparametric regression fits (trends without linearity assumptions) using =Hmisc plsmo= 
      * Turning tables into plots (review of =summary.formula=) 
      * Trellis graphics (11.4)
         * =bwplot, densityplot, dotplot, histogram, splom, density, stripplot, xyplot= functions 
         * =Hmisc panel.bpplot= Trellis panel function for extended box plots 
         * =Hmisc xYplot= and =Dotplot= functions for error bars and bands (11.4.1) 
      * Plotting summary statistics using =Hmisc summarize= and =xYplot= and =Dotplot= functions and other Trellis graphics functions (11.4.3)  
   1 Tools for Reproducible and Analyses and Reports (Chapter 13 in A&amp;H)
      * Batch processing and managing analyses: The =Hmisc do= function (13.2) 
      * Reproducible analysis using Makefiles (13.3) 
      * Reproducible reports (see [[%ATTACHURL%/../RS/sintro.pdf][sintro.pdf]])
         * A 15-minute course in %LATEX% 
         * %NAVY%S%ENDCOLOR%/%LATEX% interface and =summary.formula's latex= function 
         * Producing HTML and hyperlinked PDF documents   

   <b>Texts</b>: Alzola CF, Harrell FE: <em>An Introduction to %NAVY%S%ENDCOLOR%</em><em> and to the</em> =Hmisc= <em>and Design Libraries</em>, 2002. [[%ATTACHURL%/../RS/sintro.pdf][sintro.pdf]].
   %BR%Harrell FE: <em>Statistical Tables and Plots using %NAVY%S%ENDCOLOR%</em><em> and %LATEX%</em>, 1999. [[%ATTACHURL%/../StatReport/summary.pdf][summary.pdf]].

   <b>References&nbsp;for&nbsp;Statistical&nbsp;Graphics</b>: Cleveland W: <em>The Elements of Graphing Data</em>, Summit NJ: Hobart Press, 1994.
   %BR%Tufte ER: <em>The Visual Display of Quantitative Information</em>, Cheshire CT: Graphics Press, 1983.
   %BR%Tufte ER: <em>Envisioning Information</em>, Cheshire CT: Graphics Press, 1990.
   %BR%Tufte ER: <em>Visual Explanations</em>, Cheshire CT: Graphics Press, 1997.
   %BR%Cleveland WS: <em>Visualizing Data</em>, Summit NJ: Hobart Press, 1993.
   %BR%%NAVY%S%ENDCOLOR% Manuals. (Also see General Bibliography in Alzola &amp; Harrell)
   %BR%Wilkinson L: <em>The Grammar of Graphics</em>, New York: Springer, 1999.
   %BR%Wallgren A, Wallgren B, Persson R, Jorner U, Haaland, J: <em>Graphing Statistics &amp; Data</em>, Thousand Oaks: SAGE Publications, 1996. 

   <b>References&nbsp;for&nbsp;%LATEX%</b>: Lamport A: <em>%LATEX%: A Document Preparation System</em>, Reading MA: Addison-Wesley, 2<sup>nd</sup> edition, 1994.
   %BR%Oetiker T, Partl H, Hyna I, Schlegl E: <em>The Not So Short Introduction to %LATEX%2e</em>, 2005.
   %BR% =[[http://ctan.tug.org/tex-archive/info/lshort/english/lshort.pdf][http://ctan.tug.org/tex-archive/info/lshort/english/lshort.pdf]]=

   <b>References&nbsp;for&nbsp;S&nbsp;and&nbsp;Statistical&nbsp;Methods</b>: Venables WN, Ripley BD: <em>Modern Applied Statistics with %NAVY%S%ENDCOLOR%</em>, New York: Springer-Verlag, 4<sup>th</sup> edition, 2002.

   <b>Datasets</b>: StatCompCourse

   <b>Hardcopy Handouts and Books Supplied to Participants</b>
   1 [[%ATTACHURL%/../StatCompCourse/sCompGraph.pdf][sCompGraph.pdf]]
   1 [[%ATTACHURL%/../RS/sintro.pdf][sintro.pdf]]
   1 Printout of this web page
   1 Printout of web page DataSets
   1 [[%ATTACHURL%/../RS/gui.graphics.tricks.pdf][gui.graphics.tricks.pdf]]
   1 [[%ATTACHURL%/ShortCourse.hw.pdf][ShortCourse.hw.pdf]]
   1 Copy of solutions to the above lab assignments 
   1 Copy of Cleveland's <em>Elements of Graphing Data</em> 

-- Main.ColeBeck - 25 Aug 2005
This topic: Main > WebHome > StatComp > RS > Hmisc > StatCompGraphShortCourse
Topic revision: 29 Aug 2005, FrankHarrell (raw view)
Copyright © 2013-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Vanderbilt Biostatistics Wiki? Send feedback