The module “A Face in the Crowd” is the opening module in the 12-credit, 3-semester QEA sequence. The module introduces the major ideas in linear algebra with a focus on intuition building and application in an effort to build deep understanding. The module is organized around the engineering challenging of building a facial recognition system. Rather than purely focus on the technical components of this challenge, students read about the societal issues surrounding the technology (e.g., algorithmic bias). Along the way students also see applications of linear algebra applied to different domains (e.g., neuroscience).

The full course “textbook” can be found using this link AFaceInTheCrowdSpring2020.pdf. Source files for this website and the assignments themselves can be found at https://github.com/qeacourse/AFaceInTheCrowd.

A thumbnail image for a video.  The text QEA Olin College of Engineering appears on a textured blue background

Key Features of QEA

QEA is a highly interdisciplinary, integrated course for teaching technical content.

More details about QEA

A 5 by 5 grid of face images with labels of whether each of them are smiling.

Computational Platform

Students use MATLAB as a programming environment during this module. Use the button below to see sample code and other supporting materials.

Supporting Resources

A sample Eigenface calculated from the class dataset.

Module Overview

The module introduces fundamental ideas in linear algebra through a deep dive into creating a facial recognition system.

Module Details

Inspired to learn more? E-mail Collaboratory@olin.edu.

Supporting Documentation and Code

A 5 by 5 grid of face images with labels of whether each of them are smiling.

These resources provide some of the sample code we give in an easy to download and view format along with a guide to setting up your own photo booth so one can collect a dataset of images for facial recognition from a class.

Sample MATLAB Code

Teaching Team Documentation

Big Picture Framing and Linear Algebra Basics

A schematic of the representation of a red, green, and blue image as a matrix

The module begins with a day 1 activity that frames the big ideas of facial recognition (both in terms of technical concepts and societal implications). Students then build their understanding of the basic entities of linear algebra and how to operate on them.

Schedule and Supporting Documents

Eigenthings and Applications of Linear Algebra

A 3D scatter plot showing the relationship between the temperature in 3 cities along with the principal directions of variance shown as vectos.

Next, students build on the basic properties of matrices and vectors and learn key concepts of Eigenvalues and Eigenvectors. Our presentation of these important concepts is heavy on visualization and intuition-building. We also provide several applications of these concepts to help students understand the power and utility of the math they are learning.

Schedule and Supporting Documents

Matrix Decomposition with Applications in a Project

An image of an Eigenface computed using principal components analysis

Students learn about several algorithms for matrix decomposition: Eigen Value Decomposition, Singular Value Decomposition, and Principal Components Analysis. The module culminates with a substantial project in which students build algorithms for facial recognition and processing while seriously considering the implications of their work for potential users and society in general.

Schedule and Supporting Documents

Conclusion and Learning More

The module “A Face in the Crowd” is a deep dive into the linear algebra and its myriad applications. The module builds towards the creation of algorithms for face processing and recognition, but along the way many other applications of the powerful ideas in linear algebra are shown. We have found that this approach to teaching linear algebra gives a high degree of intuition and understanding of the most important concepts while keeping “turning the crank” (e.g., doing repetitive calculations by hand) to a minimum.

Despite the fact that the module is successful at Olin, we realize that everyone’s institutional context is different. To connect with folks at Olin College to learn more about this module or determine how you might build off of this at your own institution, e-mail Collaboratory@olin.edu to start the conversation.

Other Documents on QEA