Celebratio Mathematica — Daubechies

Complete Bibliography

Works connected to Jiaji Huang

Filter the Bibliography List

year	title	people

			clear

W. Zhu, Q. Qiu, J. Huang, R. Calderbank, G. Sapiro, and I. Daubechies: “LDMNet: Low dimensional manifold regularized neural networks,” pp. 2743–2751 in 2018 IEEE/CVF conference on computer vision and pattern recognition (Salt Lake City, UT, 18–23 June 2018). IEEE (Piscataway, NJ), 2018. ArXiv 1711.06246 incollection

Deep neural networks have proved very successful on archetypal tasks for which large training sets are available, but when the training data are scarce, their performance suffers from overfitting. Many existing methods of reducing overfitting are data-independent. Data-dependent regularizations are mostly motivated by the observation that data of interest lie close to a manifold, which is typically hard to parametrize explicitly. These methods usually only focus on the geometry of the input data, and do not necessarily encourage the networks to produce geometrically meaningful features. To resolve this, we propose the Low-Dimensional-Manifold-regularized neural Network (LDMNet), which incorporates a feature regularization method that focuses on the geometry of both the input data and the output features. In LDMNet, we regularize the network by encouraging the combination of the input data and the output features to sample a collection of low dimensional manifolds, which are searched efficiently without explicit parametrization. To achieve this, we directly use the manifold dimension as a regularization term in a variational functional. The resulting Euler–Lagrange equation is a Laplace–Beltrami equation over a point cloud, which is solved by the point integral method without increasing the computational complexity. In the experiments, we show that LDMNet significantly outperforms widely-used regularizers. Moreover, LDMNet can extract common features of an object imaged via different modalities, which is very useful in real-world applications such as cross-spectral face recognition.

Guillermo R. Sapiro	Related
A. Robert Calderbank	Related
Qiang Qiu	Related
Wei Zhu	Related
Jiaji Huang	Related