Data Curation Foundations

Add data curation to your data science tool kit. Learn how to develop curation files to document information about datasets and related business processes.

Introduction

• Data curation in data science
• What you should know
• Structure of the course

1. Introduction to Data Curation

• What is data curation?
• Curation as a management function
• Data and measurement
• Overview of back-end curation
• Overview of front-end curation
• Overview of curation for surveys
• Flow diagram overview
• Other helpful curation files

2. Back-End Curation

• Data dictionary basics
• Curating study vs. production data
• Entity-attribute-value (EAV) structure
• Indexes
• Entity-relationship diagrams (ERDs)
• Main tables in a data dictionary
• Picklists in a data dictionary
• Leveraging picklists for crosswalks
• Advanced crosswalks

3. Front-End Curation

• Front-end curation basics
• Curating database front-end
• Front-end mock-ups for changes
• Steps for dashboard design
• Dashboard mock-up, part 1
• Dashboard mock-up, part 2

4. Special Curation for Surveys

• Specifying domains
• Survey mock-ups for online
• Documenting questions and answers
• Annotated surveys
• Survey mock-ups for CATI
• Paper surveys
• Documenting crosswalks for data analysis
• Instruments and scoring

5. Flow Diagrams

• Warehouse data flow diagrams
• Analytic data flow diagrams
• Application flow diagrams
• Workflow diagrams
• Study flow diagrams
• Data reduction diagrams

6. Text-Based Curation Files

• Standardized code
• Data reports
• Founding documents
• Project-related agreements
• Manuals
• Cheat sheets and diagrams

7. Application in the Field

• Back-end curation
• Front-end curation
• Survey curation
• Flow diagrams
• Text-based curation files

Conclusion

• Next steps