Effective feature representation is key to the predictive performance of any algorithm. This paper introduces a meta-procedure, called Non-Euclidean Upgrading (NEU), which learns feature maps that are expressive enough to embed the universal approxim
ation property (UAP) into most model classes while only outputting feature maps that preserve any model classs UAP. We show that NEU can learn any feature map with these two properties if that feature map is asymptotically deformable into the identity. We also find that the feature-representations learned by NEU are always submanifolds of the feature space. NEUs properties are derived from a new deep neural model that is universal amongst all orientation-preserving homeomorphisms on the input space. We derive qualitative and quantitative approximation guarantees for this architecture. We quantify the number of parameters required for this new architecture to memorize any set of input-output pairs while simultaneously fixing every point of the input space lying outside some compact set, and we quantify the size of this set as a function of our models depth. Moreover, we show that no deep feed-forward network with commonly used activation function has all these properties. NEUs performance is evaluated against competing machine learning methods on various regression and dimension reduction tasks both with financial and simulated data.
We consider trading against a hedge fund or large trader that must liquidate a large position in a risky asset if the market price of the asset crosses a certain threshold. Liquidation occurs in a disorderly manner and negatively impacts the market p
rice of the asset. We consider the perspective of small investors whose trades do not induce market impact and who possess different levels of information about the liquidation trigger mechanism and the market impact. We classify these market participants into three types: fully informed, partially informed and uninformed investors. We consider the portfolio optimization problems and compare the optimal trading and wealth processes for the three classes of investors theoretically and by numerical illustrations.
