DIS 3.3 · Data Integration · Winter 2026/27

Data Integration.

Many sources, one answer.

Data and Information Science · TH Köln – University of Applied Sciences

This is the home of the BSc Data Integration course running in 2026/2027 at TH Köln – University of Applied Sciences. The course teaches the basics of working with data-driven questions. You’ll learn how to collect data from different sources, clean it up, and organize it into useful formats. From there, we’ll look at methods for exploring data and using statistics to test hypotheses. You’ll also gain skills in interpreting, visualizing, and presenting results so you can answer both research-based and real-world questions.

Schedule

Schedule and resources

Lectures take place on Fridays. The slides open right here in your browser, and they are also available as PDFs to print or annotate. The labs are hosted in the course repository on GitHub.

DateTopicResourcesMilestone
Wed14 Oct 2026 Kickoff
Block 1 · 23 Oct – 13 Nov 2026Tools, Data, & Software Engineering
Fri23 Oct 2026 Open Source Software and Open Data
Fri30 Oct 2026 Command Line Interface
Fri6 Nov 2026 Version Control Software
Fri13 Nov 2026 Agentic Coding 1st milestone: Roadmap
Block 2 · 27 Nov – 18 Dec 2026Data Engineering
Fri27 Nov 2026 Web Scraping
Fri4 Dec 2026 Data Structures and Formats
Fri11 Dec 2026 Data Cleaning and Python Packages
Fri18 Dec 2026 World Café 2nd milestone: Dataset
Block 3 · 8 Jan – 25 Jan 2027Data Analysis and Presentation
Fri8 Jan 2027 Hypothesis Testing
Fri15 Jan 2027 Guest Lecture
Fri22 Jan 2027 Wrap Up / QA
Mon25 Jan 2027 Exam 3rd milestone: Presentation

Group project

Your own data pipeline, in a team

Throughout the semester, you will collaborate with your team members and work on a group project. A shared Git repository is the technological basis to facilitate your collaboration.

Follow these steps to get started.

Make sure to have everything settled before the 1st milestone on 13 Nov 2026, since your roadmap is supposed to be shared from the Git repository. More details about the group project are shared in the slides.

  1. Create a Git repository on GitHub

    Include all team members as collaborators. As a student, you are eligible to gain access to the GitHub Student Developer Pack that allows you to create an organization that hosts your group work (as an alternative to hosting the repository from a personal account).

  2. Invite breuert as collaborator

    Add breuert to your group repository.

  3. Send an e-mail to breuert

    • your group / project name
    • a list of all team members including their full names, student identifiers, and their GitHub handles

Milestones

Three blocks, three milestones

The lecture series can be divided into three topical blocks. Each block ends with a milestone that helps you to structure and organize the group project. Each milestone builds on the one before, so start early and commit often.

1st milestoneEnd of block 1

Roadmap

Due Fri 13 Nov 2026

Your topic, your datasets and your research questions, and a plan for how you will answer them.

Deliverables

  • Topic and dataset selection, with the license of every source
  • Two or three research questions that your data can answer
  • A roadmap: your plan for the rest of the semester

Format

Markdown documentation in the README of your group repository

2nd milestoneEnd of block 2

Dataset

Due Fri 18 Dec 2026

Your enriched dataset and a first version of your pipeline, presented at the World Café.

Deliverables

  • An enriched dataset that combines several sources, e.g., open data and data you scraped
  • A pipeline prototype (skeleton code) that builds the dataset from the raw data
  • Documentation: sources and licenses, cleaning steps, and a data dictionary

Format

New dataset hosted online · Jupyter notebook in your repository

+10 bonus points for passing the World Café on 18 Dec 2026.

3rd milestoneExam

Presentation

Mon 25 Jan 2027

Your findings, presented in the exam, together with the code and documentation behind them.

Deliverables

  • Presentation of your results
  • Code repository and a demo of your running notebook
  • Project documentation

Format

Exam: presentation · running notebook · open repository and documentation

Your repository is graded as it is at a deadline before the exam: Jan 22, 2026 at 23:59 PM. Later commits do not count.

Lab sessions

Practice what you learned

Each lecture is accompanied by a lab session that helps deepen your understanding of the concepts and methodologies, and you will gain hands-on experience. You can find all labs in the corresponding GitHub repository.

All labs on GitHub

Guides

Tools and further reading

KI:connect as a coding agent

Use the language models of KI:connect.nrw as a coding agent in VS Code. The tutorial shows you how to create an API key with your university login and connect it through Cline, Continue or VS Code’s built-in chat.

Read the tutorial

Software and resources

Tutorials and cheat sheets for Markdown, the command line and Git, recommended software and Python packages, open data portals, and more.

Browse the list