Welcome to the course materials for BTW2401 - Data Science and Visualisation!

Here you can find the course materials for the Data Science course taught at the Bern University of Applied Sciences by Leandro von Werra in 2021. This course was originally co-developed with Lewis Tunstall.

Data science is a big deal in business these days, and with good reasons. Amongst them (Loukides, 2010):

• Almost every aspect of a business is open to data collection, be it web server logs, tweet streams, IoT sensors, online transactions, or some other source. Data science provides techniques to extract useful information from this data and thus generate added value;
• The question facing every company, startup, and non-profit that wants to attract a community in the modern era is how to use data effectively. Using data effectively requires something different from traditional statistics; namely an interdisciplinary approach that involves elements of statistics, computer science, and domain expertise. Data science is the methodology that synthesises these three domains.

In essence, data science is about the extraction of useful information and knowledge from large volumes of data, in order to improve business decision-making (Provost & Fawcett, 2013). With improved decision making comes improved productivity, market value, and competitive edge. Thus the main goal of data science is to enable data-driven decision making across the whole company, where decisions are based on the analysis of data rather than pure intuition.

There are many challenges involved with making data science an effective component of a business, but for those that succeed (Google, Amazon, Facebook, LinkedIn) the rewards are immense.

Figure: Data science in the context of various data-related processes in the organization (Provost and Fawcett, 2013).

This module provides students with a hands-on introduction to the methods of data science, with an emphasis on applying these methods to solve business problems. By the end of this course, it is expected that students will:

• Know how to approach business problems from a data science perspective;
• Understand the fundamental principles behind extracting useful knowledge from data;
• Understand the core concepts and terminology of machine learning;
• Gain hands-on experience with mining data for insights.

Throughout the course, students will also have the opportunity to learn several technical skills:

• Python programming and experience with the core libaries for data analysis, visualisation, and modelling.
• Working with data: collecting, cleaning, and transforming.
• Creating and interpreting descriptive statistics.
• Creating and interpreting data visualisations.
• Practical experience with machine learning.

The module structure consists of classroom sessions, self-study tasks, and group work. The classroom sessions will involve a mix of theoretical and practical (programming) work, with an emphasis on the latter. The self-study tasks will be used to read selected chapters from the module textbook. The outline for the module is shown in the table below.

CW	Date	Topic	Links
8	24.02	Introduction to Data Science
9	03.03	Exploratory Data Analysis
10	10.03	Feature Engineering
11	17.03	Define group project
12	24.03	Introduction to Random Forests
13	31.03	No class
14	07.04	Random Forest Deep Dive
15	14.04	Model Interpretation
16	21.04	Classification
17	28.04	Overfitting
18	05.05	Neighbours and Clusters
19	12.05	Dimensions
20	19.05	No class
21	26.05	Natural language processing I
22	02.06	Natural language processing II & group project submission
23	09.06	Project presentations
24	16.06	Deep learning
25	23.06	Exam preparation
26	30.06	Exam preparation
27	TBC	Final exam

Note: To download the notebooks, right-click on the badge and select "Save Link as ..." and make sure to save them with the .ipynb ending.

We will be teaching most of the class via Jupyter notebooks in Python. The notebooks for each class will be made available from links on this website. Note that some parts of the notebooks are removed for you to fill in as you follow along in class. You can open and run them directly on Binder by clicking on the Binder badge (see example below) at the top of each lecture notebook. We highly encourage the use of Binder, since it requires no local installation and runs for free.

Binder badge:

A few remarks about Binder:

1. Binder is free to use.
2. If you edit a notebook make sure you download it, since Binder does not save your changes.
3. Binder will automatically shut down user sessions that have more than 10 minutes of inactivity (if you leave your browser window open, this will be counted as “activity”).
4. Binder aims to provide at least 12 hours of session time per user session. Beyond that, it is not guaranteed that the session will remain running.

Since Binder does not save your changes permanently, you should download the notebooks you worked on at the end of your session. If you want to continue your session later on you can re-upload them to Binder. See the image below for instructions how to upload and download files.

Figure: Download and upload buttons on JupyterLab as seen in the binder environment.

You can also install the data science lecture material locally on your laptop. In general, when working with Python it is recommended to use virtual environments. This makes sure that the packages you install don't interfere with the packages you already installed in other projects.

To install the data science lectures library run the following command:

pip install dslectures

To install JupyterLab (a more advanced environment than Jupyter notebooks) run:

pip install jupyterlab

Then make sure you download all course material from the GitHub repository or just the missing notebooks. In general you will need to copy all materials, since some resources such as images are not self-contained in the notebooks.

Finally, to start JuypterLab run:

jupyter-lab

Since we are developing the materials throughout the course you will need to update your local environment every time we move on to the next lesson. To do so just run the following command before you start JupyterLab

pip install --upgrade dslectures

Before class

We expect students to prepare for each class by completing the self-study tasks in advance.

During class

Please refrain from using your phone or social media (Facebook, Twitter, etc) during class; we do however encourage you to use the class Slack group! We also expect students to take an active role during the class by asking questions and contributing to the discussions.

Academic integrity and honesty

Your answers to homework, quizzes, and exams must be your own work (except for the group project, which is a collaborative task). Please don’t cheat or plagiarise other people’s work.

The assessment for this module involves two parts whose sum is 100 points: one group project (50 points), and one final written exam (50 points). The total number of points determines the overall grade for the module.

1. Group project: Students will be allocated into small groups and tasked to solve an end-to-end data science project. The results from the analysis must be submitted in the form of a Jupyter notebook, followed by a 15 minute oral presentation to the class. The maximum score for this assessment is 50 points, evenly distributed across the analysis code (25 points) and presentation (25 points).
2. Written examination: The final written examination will consist of multiple choice and short answer questions, covering the content of the lectures and the module textbook. Students will not be required to solve any Python programming questions in the exam. The exam has a maximum score of 50 points and the final date will be announced.

Data Science

• F. Provost and T. Fawcett, Data Science for Business, (O’Reilly Media 2013).
• J. VanderPlas, Python for Data Science Handbook, (O’Reilly Media 2016).

Provost & Fawcett will be used as the primary textbook for the module and is the standard data science text for business programs at over 150 universities around the world. The book by VanderPlas is an excellent reference for the Python programming aspects of the module.

Python Programming

• W. McKinney, Python for Data Analysis, 2nd ed (O’Reilly Media 2017).

We will use the Python programming language to analyse and visualise a variety of datasets in this module. McKinney’s book is an excellent reference to have at hand and covers the nuts and bolts of the NumPy and pandas packages.

Machine Learning

• A. Géron, Hands-On Machine Learning with Scikit-Learn and TensorFlow, (O’Reilly Media 2017).
• J. Howard, Introduction to Machine Learning for Coders, (fastAI 2018).

Although machine learning is not the only focus of this course, Géron’s book or fastAI’s MOOC provide the right level of technical detail to gain a deeper understanding of this exciting field.

Kaggle Learn

• Kaggle Learn

Kaggle Learn is a great resource to brush up on concepts like Python basics, data visualisation or pandas in an online notebook environment (similar to Binder).

• M. Loukides, What is Data Science?, (O’Reilly 2010). Retrieved from https://www.oreilly.com/ideas/what-is-data-science
• D. Conway, The Data Science Venn Diagram, (2010). Retrieved from http://drewconway.com/zia/2013/3/26/the-data-science-venn-diagram