DS2002 Data Science Systems

Course Description

This course introduces you to the core technical concepts and practical skills needed to interact with systems to process data science workloads. You’ll learn how to choose and manage computing environments and storage options, from small local setups to larger cloud-based systems, and how to use essential database models for storage and analysis.

Throughout the course, you’ll work extensively with the command line, scripting, and managing code and resources across local and cloud platforms. By the end of the course, you’ll have a solid technical foundation and a practical set of tools to support your work in future data science courses and projects.

Getting Started

To get started with the course, please follow the Setup Instructions to configure your development environment.

Practice

Work through the Hands-on Exercises to practice and consolidate concepts introduced during class lectures and discussions.

Each unit contains an “Advanced Concepts” section that allows you to dive deeper into a topic. Note: Advanced concepts will not be covered in quizzes or labs.

Check the end of each unit for links to additional resources for further exploration.

Labs

Weekly labs are released with instructions on the course Canvas page.

Projects

As a final assignment you will be working in groups of 4-5 on a data pipeline project that connects key learnings from all course modules. Project choices and specific instructions will be released on course Canvas page after modules 1-3 are completed..

Repository Management

Updating Your Fork

To stay current with new releases into the course repository, follow these steps:

Add an upstream source

git remote add upstream https://github.com/ksiller/ds2002-course.git

Switch to main branch:
```
git switch main
```
Fetch from the upstream branch:
```
git fetch upstream
```
Merge your branch with the upstream branch.
```
git merge upstream/main
```

This can be run in a single block:

git remote add upstream https://github.com/ksiller/ds2002-course.git
git switch main
git fetch upstream
git merge upstream/main

Saving Your Changes

If you generate code, scripts, data files, etc. that you would like to keep, add, commit, and push the files back to your fork of the repository:

git add .
git commit -m "Some meaningful message"
git push origin main

Remember that changes you commit and push will be saved to your fork of the repository.