This talk focuses on the statistical sample complexity and model reduction of Markov decision process (MDP). We begin by surveying recent advances on the complexity for solving MDP, without any dimension reduction. In the first part we study the statistical state compression of general Markov processes. We propose a spectral state compression method for learning state features and aggregation structures from data.
Events
Upcoming Events
Fri
Jan 25
11:00 AM
EER 0.806 / 0.808
Fri
Feb 01
11:00 AM
EER 3.646 - Blaschke Conference Room
Recent years have seen a flurry of activities in designing provably efficient nonconvex procedures for solving statistical estimation problems. The premise is that despite nonconvexity, the loss function may possess benign geometric properties that enable fast global convergence under carefully designed initializations, such as local strong convexity, local restricted convexity, etc.
Recent Events
14 Dec 2018
The concept of a blockchain was invented by Satoshi Nakamoto to maintain a distributed ledger for an electronic payment system, Bitcoin. In addition to its security, important performance measures of a blockchain protocol are its transaction throughput, confirmation latency and confirmation reliability. These measures are limited by two underlying physical network attributes: communication capacity and speed-of-light propagation delay. Existing systems operate far away from these physical limits.
09 Oct 2018
Soft biomaterials such as human skin have very different mechanical properties from conventional electronics, requiring unusual materials and geometries to match the behavior of the skin. One of the biggest challenges in stretchable electronics is the transfer of power and data signals, with physical wiring easily pulled out or damaged. In my talk, I will be discussing all aspects of creating inductors and power circuits for wireless power transfer to stretchable systems. I will focus on the use of room temperature liquid metals and stretchable magnetic materials to maximize power trans
08 Oct 2018
Recent years have witnessed significant progress in entropy estimation, in particular in the large alphabet regime. Concretely, there exist efficiently computable information theoretically optimal estimators whose performance with n samples is essentially that of the maximum likelihood estimator with n log(n) samples, a phenomenon termed ``effective sample size boosting''. Generalizations to processes with memory (estimation of the entropy rate) and continuous distributions (estimation of the differential entropy) have remained largely open.
26 Sep 2018
The signal processing (SP) landscape has been enriched by recent advances in artificial intelligence (AI) and machine learning (ML), especially since 2010 or so, yielding new tools for signal estimation, classification, prediction, and manipulation. Layered signal representations, nonlinear function approximation, and nonlinear signal prediction are now feasible at very large scale in both dimensionality and data size. These are leading to significant performance gains in a variety of long standing problem domains (e.g., speech, vision), as well as providing the ability to construct new
31 Aug 2018
Bio-tissues are soft, curvilinear and dynamic whereas wafer-based electronics are hard, planar, and rigid. Over the past decade, stretchable high-performance inorganic electronics have emerged as a result of new structural designs and unique materials processes. Electronic tattoos (e-tattoos) represent a class of stretchable circuits, sensors, and stimulators that are ultrathin, ultrasoft and skin-conformable. This talk will first introduce stretchable serpentine structures followed by a dry and freeform “cut-and-paste” method for the rapid prototyping of e-tattoos.