Submodular functions model the intuitive notion of diminishing returns. Due to their far-reaching applications, they have been rediscovered in many fields such as information theory, operations research, statistical physics, economics, and machine learning. They also enjoy computational tractability as they can be minimized exactly or maximized approximately. The goal of this talk is simple. We see how a little bit of randomness, a little bit of greediness, and the right combination can lead to pretty good methods for offline, streaming, and distributed solutions.
Events
Upcoming Events
Fri
Dec 06
11:00 AM
EER 1.516 (North Tower)
Recent Events
08 Nov 2019
I will talk about finite sample expressivity, aka memorization power of ReLU networks. Recent results showed (unsurprisingly) that arbitrary input data could be perfectly memorized using a shallow ReLU network with one hidden layer having N hidden nodes. I will describe a more careful construction that trades of width with depth to show that a ReLU network with 2 hidden layers, each with 2*sqrt(N) hidden nodes, can perfectly memorize arbitrary datasets. Moreover, we prove that width of Θ(sqrt(N)) is necessary and sufficient for having perfect memorization power.
06 Sep 2019
10 May 2019
03 May 2019
Many modern neural networks are trained in an over-parameterized regime where the parameters of the model exceed the size of the training dataset. Due to their over-parameterized nature these models in principle have the capacity to (over)fit any set of labels including pure noise. Despite this high fitting capacity, somewhat paradoxically, models trained via first-order methods (often with early stopping) continue to predict well on yet unseen test data.
26 Apr 2019
The role of image quality assessment in tasks such as (i) pan sharpening (PS) (i.e. merging high-resolution panchromatic and lower resolution multispectral imagery to create a single high-resolution color image) and (ii) super-resolution (SR) has not been researched extensively from the natural scene statistics (NSS) perspective. For instance, even though there are several well-known measures that quantify the quality of PS and SR images, there has been little work done on analyzing the statistics of PS and SR images and associated distortions.