Jun 4-5, 2018
8:30am - 4:30pm
Instructors: Lauren Michael, Michelle Craft, Dorothea Salo, Maria Kamenetsky, Karl Broman
Helpers: Trisha Adamus, Christina Koch
Registration is required and will be available just below, starting at 5:00pm on Wednesday, 9 May 2018. Make sure to read all details below before registering and to choose appropriately between UW-Madison’s Data Carpentry and Software Carpentry workshops.
Data Carpentry workshops are for any researcher who has data they want to analyze, and no prior computational experience is required. This hands-on workshop teaches basic concepts, skills and tools for working more effectively with data.
We will cover data organization in spreadsheets, OpenRefine, SQL for data management, and R for data analysis and visualization.
For researchers who have already been programming and seek to expand their capabilities, our UW-Madison Software Carpentry workshop (Jun 6-7) will likely be more appropriate. These two workshops are NOT intended to be taken back-to-back, and you can learn about future workshops at UW-Madison by joining the mailing list of UW-Madison’s Advanced Computing Initiative.
Who: The course is aimed at UW-Madison-affiliated graduate students, staff, and other researchers.
Where: Social Science Computing Cooperative, 4226 William H Sewell Social Sciences Building, 1180 Observatory Dr, Madison, WI 53706. Get directions with OpenStreetMap or Google Maps.
When: Jun 4-5, 2018. Add to your Google Calendar.
Requirements: Participants should plan to attend BOTH days of the workshop and bring a laptop with a Mac, Linux, or Windows operating sytem (not a tablet, Chromebook, etc.) that they have administrative privileges on. They should have a few specific software packages installed (listed below). They are also required to abide by Data Carpentry's Code of Conduct.
Accessibility: We are committed to making this workshop accessible to everybody. The workshop organizers have checked that:
Materials will be provided in advance of the workshop and large-print handouts are available if needed by notifying the organizers in advance. If we can help making learning easier for you (e.g. sign-language interpreters, lactation facilities) please get in touch (using contact details below) and we will attempt to provide them.
Contact: Please email ContactACI@lists.wisc.edu for more information.
Please be sure to complete these surveys before and after the workshop.
| 8:30 - 9:00 | Installation Help |
| 9:00 - 9:10 | Introduction |
| 9:10 - 10:30 | Data Organization in Spreadsheets |
| 10:30 - 10:45 | Break |
| 10:45 - 12:00 | Data Cleaning with OpenRefine |
| 12:00 - 1:00 | Lunch Break |
| 1:00 - 2:15 | Data Management with SQL |
| 2:15 - 2:30 | Coffee |
| 2:30 - 4:00 | Data Management with SQL |
| 8:30 - 9:00 | Installation Help |
| 9:00 - 9:15 | Day 2 intro |
| 9:15 - 10:30 | Intro to R |
| 10:30 - 10:45 | Break |
| 10:45 - 12:00 | Data manipulation with dplyr [R script] |
| 12:00 - 1:00 | Lunch Break |
| 1:00 - 2:30 | Data Visualization with ggplot2 [R script] |
| 2:30 - 2:45 | Coffee |
| 2:45 - 3:15 | Reproducible reports with R Markdown |
| 3:15 - 4:00 | Capstone project [Solutions: Rmd | html] |
| 4:00 - 4:15 | Wrap up and fill out the post-workshop survey (see above) |
We will use this collaborative document for chatting, taking notes, and sharing URLs and bits of code.
To participate in a Data Carpentry workshop, you will need working copies of the software described below. Please make sure to install everything and try opening it to make sure it works before the start of your workshop. If you run into any problems, please feel free to email the instructor or arrive early to your workshop on the first day.
Participants should bring and use their own laptops to insure the proper setup of tools for an efficient workflow once you leave the workshop.
This workshop will be using the software outlined in the install instructions below. Please see the section for your operating system for those directions.
Please go through all the installation steps below and make sure that you not only installed them, but start them up to make sure they’re working. If you have any problems, don’t hesitate to email the instructors to ask for help, or arrive early on the first day of the workshop to get help.
A spreadsheet program
For this workshop you will need a spreadsheet program. Many people already have Microsoft Excel installed, and if you do, you’re set!
If you need a spreadsheet program, there are a few other options, like OpenOffice and LibreOffice. Install instructions for LibreOffice, which is free and open source, are here.
Download the Installer
Install LibreOffice by going to the installation page. The version for Windows should automatically be selected. Click on the button below “Main Installer” Download Version x.y.z. You will go to a page that asks about a donation, but you don’t need to make one. Your download should begin automatically.
Install LibreOffice
Once the installer is downloaded, double click on it and it should install.
To use LibreOffice, double click on the icon and it will open.
OpenRefine
OpenRefine (previously Google Refine) is a tool for data cleaning that runs through a web browser, and any browser - Safari, Firefox, Chrome, Explorer - should work fine. You will need to download OpenRefine and install it, and when you open it, it will run through the browser, but you don’t need an internet connection, and the data will all be stored on your computer.
Go to the OpenRefine download page
Click on Windows kit to download the install file
To use it, unzip, and double-click on openrefine.exe (if you’re having issues with openrefine.exe try refine.bat instead)
OpenRefine will then open in your web browser.
If it doesn’t open automatically, open a web broswer after you’ve started the program and go to the URL http://localhost:3333 and you should see OpenRefine.
R
In the workshop, we will use RStudio. RStudio is a nice interface to the programming language R. To use RStudio, you need to install both R and RStudio.
Download R from here
Run the .exe file that was just downloaded
Go to the RStudio Download page
Under Installers select RStudio 0.98.1103 - Windows XP/Vista/7/8
Double click the file to install it
Once it’s installed, open RStudio to make sure it works and you don’t get any error messages.
SQLite
For this workshop we’re going to use DB Browser for SQLite.
Download the Windows.exe installer from the the DB Browser for SQLite website.
Open the downloaded file and follow the instructions to install to your computer.
Please go through all the installation steps below and make sure that you not only installed them, but start them up to make sure they’re working. If you have any problems, don’t hesitate to email the instructors to ask for help, or arrive early on the first day of the workshop to get help.
A spreadsheet program
For this workshop you will need a spreadsheet program. Many people already have Microsoft Excel installed, and if you do, you’re set!
If you need a spreadsheet program, there are a few other options, like OpenOffice and LibreOffice. Install instructions for LibreOffice, which is free and open source, are here.
Download the Installer
Install LibreOffice by going to the installation page. The version for Mac should automatically be selected. Click on the button below “Main Installer” Download Version x.y.z. You will go to a page that asks about a donation, but you don’t need to make one. Your download should begin automatically.
Install LibreOffice
Once the installer is downloaded, double click on it and it should install.
To use LibreOffice, double click on the icon and it will open.
OpenRefine
OpenRefine (previously Google Refine) is a tool for data cleaning that runs through a web browser, and any browser - Safari, Firefox, Chrome, Explorer - should work fine. You will need to download Google Refine and install it, and when you open it, it will run through the browser, but you don’t need an internet connection, and the data will all be stored on your computer.
Go to the OpenRefine download page
Click on Mac kit to download the install file
Open the downloaded .dmg file
Drag the icon in to the Applications folder
Double click on the icon and Google Refine will then open in your web browser.
If it doesn’t open automatically, open a web broswer after you’ve started the program and go to the URL http://localhost:3333 and you should see OpenRefine.
R
In the workshop, we will use RStudio. RStudio is a nice interface to the programming language R. To use RStudio, you need to install both R and RStudio.
Go to CRAN and click on Download R for (Mac) OS X
Select the .pkg file for the version of OS X that you have and the file will download.
Double click on the file that was downloaded and R will install
Go to the RStudio Download page
Under Installers select RStudio x.yy.zzz - Mac OS X 10.6+ (64-bit) to download it.
Once it’s downloaded, double click the file to install it
Once it’s installed, open RStudio to make sure it works and you don’t get any error messages.
SQLite
For this workshop we’re going to use DB Browser for SQLite.
Download the Mac .dmg installer from the the DB Browser for SQLite website.
Open the downloaded file and follow the instructions to install to your computer.
Please go through all the installation steps below and make sure that you not only installed them, but start them up to make sure they’re working. If you have any problems, don’t hesitate to email the instructors to ask for help, or arrive early on the first day of the workshop to get help.
A spreadsheet program
For this workshop you will need a spreadsheet program. LibreOffice comes
preinstalled with several Linux distributions. If you don’t already have it, use
your package manager to install it: (e.g., sudo apt-get install
libreoffice for Ubuntu and other Debian-based distributions).
OpenRefine
OpenRefine (previously Google Refine) is a tool for data cleaning that runs through a web browser, and any browser - Safari, Firefox, Chrome, Explorer - should work fine. You will need to download Google Refine and install it, and when you open it, it will run through the browser, but you don’t need an internet connection, and the data will all be stored on your computer.
Go to the OpenRefine download page
Click on Linux kit to download the install file
Download and extract
Type ./refine in your terminal and Google Refine will then
open in your web browser.
If it doesn’t open automatically, open a web broswer after you’ve started the program and go to the URL http://localhost:3333 and you should see OpenRefine.
R
In the workshop, we will use RStudio. RStudio is a nice interface to the programming language R. To use RStudio, you need to install both R and RStudio.
Follow the instructions for your distribution
from CRAN. For most distributions, you
can use your package manager (e.g. for Debian/Ubuntu run sudo
apt-get install r-base, and for Fedora run sudo yum install
R) but make sure that you have at least R 3.2.2 (as pre-packaged
versions might be out of date).
To install RStudio, go to the RStudio Download page
Under Installers select the version for your distribution.
Once it’s downloaded, double click the file to install it (or sudo dpkg
-i rstudio-x.yy.zzz-amd64.deb at the terminal).
Once it’s installed, open RStudio to make sure it works and you don’t get any error messages.
SQLite
For this workshop we’re going to use DB Browser for SQLite.
Download the appropriate installer from the the DB Browser for SQLite website.
Open the downloaded file and follow the instructions to install to your computer.