complex models

Reproducibility in Computer Science - Part 1

-

B9 L3 R3223

Roy Maxion will give three lectures focusing broadly on different aspects of an increasingly important topic: reproducibility. Reproducibility tests the reliability of an experimental result and is one of the foundations of the entire scientific enterprise. We often hear that certain foods are good for you, and a few years later we learn that they're not. A series of results in cancer research was examined to see if they were reproducible. A startling number of them - 47 out of 53 - were not. Matters of reproducibility are now cropping up in computer science, and given the importance of computing in the world, it's essential that our own results are reproducible -- perhaps especially the ones based on complex models or data sets, and artificial intelligence or machine learning. This lecture series will expose attendees to several issues in ensuring reproducibility, with the goal of teaching students (and others) some of the crucial aspects of making their own science reproducible. Hint: it goes much farther than merely making your data available to the public.

Reproducibility in Computer Science - Part 2

-

B9 L3 R3223

Roy Maxion will give three lectures focusing broadly on different aspects of an increasingly important topic: reproducibility. Reproducibility tests the reliability of an experimental result and is one of the foundations of the entire scientific enterprise. We often hear that certain foods are good for you, and a few years later we learn that they're not. A series of results in cancer research was examined to see if they were reproducible. A startling number of them - 47 out of 53 - were not. Matters of reproducibility are now cropping up in computer science, and given the importance of computing in the world, it's essential that our own results are reproducible -- perhaps especially the ones based on complex models or data sets, and artificial intelligence or machine learning. This lecture series will expose attendees to several issues in ensuring reproducibility, with the goal of teaching students (and others) some of the crucial aspects of making their own science reproducible. Hint: it goes much farther than merely making your data available to the public.

Reproducibility in Computer Science - Part 3

-

B9 L3 R3223

Roy Maxion will give three lectures focusing broadly on different aspects of an increasingly important topic: reproducibility. Reproducibility tests the reliability of an experimental result and is one of the foundations of the entire scientific enterprise. We often hear that certain foods are good for you, and a few years later we learn that they're not. A series of results in cancer research was examined to see if they were reproducible. A startling number of them - 47 out of 53 - were not. Matters of reproducibility are now cropping up in computer science, and given the importance of computing in the world, it's essential that our own results are reproducible -- perhaps especially the ones based on complex models or data sets, and artificial intelligence or machine learning. This lecture series will expose attendees to several issues in ensuring reproducibility, with the goal of teaching students (and others) some of the crucial aspects of making their own science reproducible. Hint: it goes much farther than merely making your data available to the public.

Extraction of Complex DNN Models: Real Threat or Boogeyman? - Graduate Seminar

-

B9 L2 H2 H2

The success of deep learning in many application domains has been nothing short of dramatic. The success has brought the spotlight onto security and privacy concerns with deep learning. One of them is the threat of "model extraction": when a machine learning model is made available to customers via an inference interface, a malicious customer can use repeated queries to this interface and use the information gained to construct a surrogate model. In this talk, I will describe our work in exploring whether model extraction constitutes a realistic threat. I will also discuss possible countermeasures, focussing on deterrence mechanisms that allow for the verification of ownership of ML models.