Publications
Recent Highlights
(For a full list see below or go to Google Scholar, ResearcherID)
Contraction Rate Estimates of Stochastic Gradient Kinetic Langevin Integrators
more estimates for Wasserstein convergence, also extension to stochastic gradient Langevin dynamics
B. Leimkuhler, D. Paulin and P. Whalley, Preprint ,, 2023 arxiv
Friction-adaptive descent - a family of dynamics-based optimization methods
FAD convergence to the minimum of the Rosenbrock problem
K. Karoni, B. Leimkuhler, and G. Stoltz, Preprint ,, 2023 arxiv
Contraction and convergence rates for discretized kinetic Langevin dynamics
sharp estimates for Wasserstein convergence based on synchronous couplings
B. Leimkuhler, D. Paulin and P. Whalley, Preprint ,, 2023 arxiv
Randomized time Riemannian manifold Hamiltonian Monte Carlo
randomising time improves robustness of RMHMC type schemes
P. Whalley, D. Paulin and B. Leimkuhler, Preprint ,, 2022 arxiv
Multirate training of neural networks
...dramatically improve neural network training by making use of latent multiscale structure...
T. Vlaar and B. Leimkuhler, International Conference on Machine Learning ,, 2022 arxiv
Two-dimensional mobile breather scattering in a hexagonal crystal lattice
...two-dimensional scattering of long-lived breathers in a model hexagonal lattice of atoms...
J. Bajars. C. Eilbeck and B. Leimkuhler, Physical Review E 103,9354, 2020 journal
Efficient Numerical Algorithms for the Generalized Langevin Equation
...fast numerical methods for quasi-Markovian GLEs (Langevin dynamics with memory) and applications to sampling...
B. Leimkuhler and M. Sachs, SIAM J. Scientific Computing 44,, 2022 arxiv
Simplest random walk for approximating Robin boundary value problems and ergodic limits of reflected diffusions
A simple-to-implement weak-sense numerical method to approximate reflected stochastic differential equations (RSDEs) is proposed and analysed, with discussion of ergodic limits.
B Leimkuhler, A Sharma, MV Tretyakov, Annals of Applied Probability 33,1904-1960, 2020 arxiv
Constraint-Based Regularization of Neural Networks
We propose a method for efficiently incorporating constraints into a stochastic gradient Langevin framework for the training of deep neural networks, enabling direct control of the parameter space of the model.
B Leimkuhler, T Pouchon, T Vlaar, A Storkey, 12th Annual Workshop on Optimization for Machine Learning (NEURIPS OPT2020) ,, 2020 workshop
Posterior sampling strategies based on discretized stochastic differential equations for machine learning applications
We discuss Bayesian parametrization in machine learning based on Markov Chain Monte Carlo, e.g. Langevin dynamics and extended system methods based on an ensemble of walkers. We also describe a new software package, TATI, for tensorflow-based sampling of neural network posteriors.
F. Heber, Z. Trstanova, and B. Leimkuhler, Journal of Machine Learning Research 21,1-33, 2020 journal
Hypocoercivity properties of adaptive Langevin dynamics
Adaptive Langevin dynamics is a method for sampling the Boltzmann--Gibbs distribution at prescribed temperature in cases where the potential gradient is subject to stochastic perturbation of unknown magnitude. It replaces the friction in underdamped Langevin dynamics with a dynamical variable, updated according to a negative feedback loop control law. This paper shows hypocoercivity imply geometric convergence to equilibrium and an asymptotic central limit theorem.
Benedict Leimkuhler, Matthias Sachs, and Gabriel Stoltz, SIAM Journal on Applied Mathematics 80,1197-1222, 2020 journal
Publication List
Contraction Rate Estimates of Stochastic Gradient Kinetic Langevin Integrators B. Leimkuhler, D. Paulin and P. Whalley, Preprint ,, 2023 arxiv
Friction-adaptive descent - a family of dynamics-based optimization methods K. Karoni, B. Leimkuhler, and G. Stoltz, Preprint ,, 2023 arxiv
Contraction and convergence rates for discretized kinetic Langevin dynamics B. Leimkuhler, D. Paulin and P. Whalley, Preprint ,, 2023 arxiv
Randomized time Riemannian manifold Hamiltonian Monte Carlo P. Whalley, D. Paulin and B. Leimkuhler, Preprint ,, 2022 arxiv
Multirate training of neural networks T. Vlaar and B. Leimkuhler, International Conference on Machine Learning ,, 2022 arxiv
Two-dimensional mobile breather scattering in a hexagonal crystal lattice J. Bajars. C. Eilbeck and B. Leimkuhler, Physical Review E 103,9354, 2020 journal
Efficient Numerical Algorithms for the Generalized Langevin Equation B. Leimkuhler and M. Sachs, SIAM J. Scientific Computing 44,, 2022 arxiv
Simplest random walk for approximating Robin boundary value problems and ergodic limits of reflected diffusions B Leimkuhler, A Sharma, MV Tretyakov, Annals of Applied Probability 33,1904-1960, 2020 arxiv
Constraint-Based Regularization of Neural Networks B Leimkuhler, T Pouchon, T Vlaar, A Storkey, 12th Annual Workshop on Optimization for Machine Learning (NEURIPS OPT2020) ,, 2020 workshop
Posterior sampling strategies based on discretized stochastic differential equations for machine learning applications F. Heber, Z. Trstanova, and B. Leimkuhler, Journal of Machine Learning Research 21,1-33, 2020 journal
Partitioned integrators for thermodynamic parameterization of neural networks Benedict Leimkuhler, Charles Matthews, Tiffany Vlaar, Foundations of Data Science 1,457-489, 2019 journal
Hypocoercivity properties of adaptive Langevin dynamics Benedict Leimkuhler, Matthias Sachs, and Gabriel Stoltz, SIAM Journal on Applied Mathematics 80,1197-1222, 2020 journal
Transferability of Operational Status Classification Models Among Different Wind Turbine Types Z. Trstanova, A. Martinsson, C. Matthews, S. Jimenez, B. Leimkuhler, T. Van Delft, and M. Wilkinson, Journal of Physics-Conference Series 1222,12041, 2019
Local and Global Perspectives on Diffusion Maps in the Analysis of Molecular Systems Z. Trstanova, B. Leimkuhler and T. Lelievre, Proceedings of the Royal Society A 476,20190036, 2019 journal
MIST - A Simple and Efficient Molecular Dynamics Abstraction Library for Integrator Development I. Bethune et al, Computer Physics Communications 236,224-236, 2019 journal
Ergodic properties of quasi-Markovian generalized Langevin equations with configuration dependent noise M. Sachs and B. Leimkuhler, Stochastic Dynamics Out of Equilibrium (IHPStochDyn 2017), Springer 282,282-330, 2019 journal
Quantifying configuration-sampling error in Langevin simulations of complex molecular systems J Fass, D Sivak, GE Crooks, KA Beauchamp, B Leimkuhler, and J Chodera, Entropy 20,318, 2018 journal
Simulated Tempering Method in the Infinite Switch Limit with Adaptive Weight Learning A. Martinsson, J. Lu, B. Leimkuhler and E. Vanden-Eijnden, Journal of Statistical Mechanics-Theory and Experiment 2019,13207, 2019 journal
Assessing numerical methods for molecular and particle simulation X. Shang, M. Kroger and B. Leimkuhler, Soft Matter 13,8565-8578, 2017 journal
Langevin Dynamics with Variable Coefficients and Nonconservative Forces-From Stationary States to Numerical Methods M. Sachs, B. Leimkuhler, and V. Danos, Entropy 19,647-667, 2017 journal
Ensemble preconditioning for Markov chain Monte Carlo simulation C. Matthews, J. Weare, B. Leimkuhler, Statistics and Computing 28,277-290, 2018 journal
Observation-based correction of dynamical models using thermostats K. Myerscough, J. Frank, and B. Leimkuhler, Proceedings of the Royal Society A 473,20160730, 2017 journal
Pairwise adaptive thermostats for improved accuracy and stability in dissipative particle dynamics B. Leimkuhler and X. Shang, Journal of Computational Physics 324,174-193, 2016 journal
Efficient molecular dynamics using geodesic integration and solvent-solute splitting B. Leimkuhler and C. Matthews, Proceedings of the Royal Society A 472,20160138, 2016 journal
A stochastic algorithm for the isobaric-isothermal ensemble with Ewald summations for all long range forces M. Di Pierro, R. Elber,and B. Leimkuhler, Journal of Chemical Theory and Computation ,5624-5637, 2015 journal
Covariance-controlled adaptive Langevin thermostat for large-scale Bayesian sampling X. Shang, Z. Zhu, B. Leimkuhler and A. Storkey, Advances in Neural Information Processing Systems (NIPS 2015) 28,, 2015 proceedings
Extended Hamiltonian approach to continuous tempering G. Gobbo and B. Leimkuhler, Phys Rev E 91,61301, 2015 journal
Adaptive Thermostats for Noisy Gradient Systems B. Leimkuhler and X. Shang, SIAM Journal on Scientific Computing 38,A712-A736, 2015 journal
Direct control of the small-scale energy balance in 2D fluid dynamics J. Frank, B. Leimkuhler and K. Myerscough, Journal of Fluid Mechanics 782,11, 2015 journal
The Adaptive Buffered Force QM/MM method in the CP2K and Amber software packages L. Mones, A. Jones, A. Götz, T. Laino, R. Walker, B. Leimkuhler, G. Csànyi, and N. Bernstein, Journal of Computational Chemistry 36,633-648, 2015 journal
Numerical simulations of nonlinear modes in mica - past, present and future J. Bajars, C. Eilbeck and B. Leimkuhler, in Quodons in Mica-Nonlinear Localized Travelling Excitations in Crystals; Springer Series in Materials Science Vol 221 ,35-67, 2015 journal
Nonlinear propagating localized modes in a 2D hexagonal crystal lattice J. Bajars, C. Eilbeck and B. Leimkuhler, Physica D 301-302,8-20, 2015 journal
On the numerical treatment of dissipative particle dynamics and related systems B. Leimkuhler and X. Shang, Journal of Computational Physics 280,72-95, 2015 journal
On the long-time integration of stochastic gradient systems B. Leimkuhler, C. Matthews and M. Tretyakov, Proceedings of the Royal Society A 470,20140120, 2014 journal
The computation of averages from equilibrium and nonequilibrium Langevin molecular dynamics B. Leimkuhler, C. Matthews and G. Stoltz, IMA Journal on Numerical Analysis ,, 2015 journal
Robust and efficient configurational molecular sampling via Langevin Dynamics B. Leimkuhler and C. Matthews, Journal of Chemical Physics 138,174102, 2013 journal
Stochastic resonance-free multiple time-step algorithm for molecular dynamics with very large time steps B. Leimkuhler, D. Margul and M. Tuckerman, Molecular Physics 111,3579-3594, 2013 journal
Weakly coupled heat bath models for Gibbs-like invariant states in nonlinear wave equations J. Bajars, J. Frank and B. Leimkuhler, Nonlinearity 26,1945-1973, 2013 journal
Rational construction of stochastic numerical methods for molecular sampling B. Leimkuhler and C. Matthews, Applied Mathematics Research Express 2013,34-56, 2013 journal
Comparing the efficiencies of stochastic isothermal molecular dynamics methods B. Leimkuhler, E. Noorizadeh and O. Penrose, Journal of Statistical Physics 143,921-942, 2011 journal
Adaptive stochastic methods for sampling driven molecular systems A. Jones and B. Leimkuhler, Journal of Chemical Physics 135,84125, 2011 journal
Dimensional reductions for the computation of time-dependent quantum expectations B. Leimkuhler and G. Mazzi, SIAM Journal on Scientific Computing 33,2024-2038, 2011 journal
Stochastic-dynamical thermostats for constraints and stiff restraints J. Bajars, J. Frank and B. Leimkuhler, The European Physical Journal 200,131-152, 2011 journal
Simplified modelling of a thermal bath, with application to a fluid vortex system S. Dubinkina, J. Frank, and B. Leimkuhler, SIAM Multiscale Modelling and Simulation 8,1882-1901, 2010 journal
Generalized Bulgac-Kusnezov methods for sampling of the Gibbs-Boltzmann measure B. Leimkuhler, Physical Review E 81,26703, 2010 journal
A gentle stochastic thermostat for molecular dynamics B. Leimkuhler, E. Noorizadeh and F. Theil, Journal of Statistical Physics 135,261-277, 2009 journal
A Metropolis-adjusted Nose-Hoover thermostat B. Leimkuhler and S. Reich, ESAIM Mathematical modelling and numerical analysis 43,743-755, 2009 journal
A temperature control technique for nonequilibrium molecular simulation B. Leimkuhler, F. Legoll and E. Noorizadeh, Journal of Chemical Physics 128,74105, 2008 journal
Molecular dynamics and the accuracy of numerically computed averages S. Bond and B. Leimkuhler, Acta Numerica 16,1-65, 2007 journal
Stabilized integration of Hamiltonian systems with hard-sphere inequality constraints S. Bond and B. Leimkuhler, SIAM Journal on Scientific Computing 30,134-147, 2007 journal
Molecular simulation in the canonical ensemble and beyond Z. Jia and B. Leimkuhler, ESAIM Mathematical modelling and numerical analysis 41,333-350, 2007 journal
Rapid thermal equilibration of coarse-grained molecular dynamics S. Gill, Z. Jia, B. Leimkuhler and A. Cocks, Physical Review B 73,184304, 2006 journal
Geometric integrators for multiple timescale simulation Z. Jia and B. Leimkuhler, Journal of Physics A 39,5379-5403, 2006 journal
Approach to thermal equilibrium in biomolecular simulation E. Barth, B. Leimkuhler, and C. Sweet, New Algorithms for Macromolecular Simulation (Springer Lecture Notes in Computational Science and Engineering) 49,125-140, 2006 journal
A projective thermostatting technique Z. Jia and B. Leimkuhler, SIAM Multiscale Modelling and Simulation 4,563-583, 2005 journal
A Hamiltonian formulation for recursive multiple thermostats in a common timescale B. Leimkuhler and C. Sweet, SIAM Journal on Applied Dynamical Systems 4,187-216, 2005 journal
An efficient geometric integrator for thermostatted anti-/ferromagnetic Models T. Arponen and B. Leimkuhler, BIT Numerical Mathematics 44,403-424, 2004 journal
The canonical ensemble via symplectic integration using Nose and Nose-Poincare chains B. Leimkuhler and C. Sweet, Journal of Chemical Physics 121,108-117, 2004 journal
A parallel multiple time-scale reversible integrator for dynamics simulation Z. Jia and B. Leimkuhler, Future Generation Computer Systems 19,415-424, 2003 journal
Generating generalized distributions from dynamical simulation E. Barth, B. Laird and B. Leimkuhler, Journal of Chemical Physics 118,5759-5769, 2003 journal
Generalized dynamical thermostatting technique B. Laird and B. Leimkuhler, Physical Review E 68, 016704 (2003) 68,16704, 2003 journal
On the approximation of Feynman-Kac path integrals S. Bond, B. Laird, and B. Leimkuhler, Journal of Computational Physics 185,472-483, 2003 journal
An efficient multiple time-scale reversible integrator for the gravitational N-body problem B. Leimkuhler, Applied Numerical Mathematics 43,175-190, 2002 journal
A separated form of Nosé dynamics for constant temperature and pressure simulation B. Leimkuhler, Computer Physics Communications 148,206-213, 2002 journal
A test set for molecular dynamics E. Barth, B. Leimkuhler, and S. Reich, Lecture Notes in Computational Science and Engineering 24,73-103, 2002 journal
A reversible averaging integrator for multiple timescale dynamics B. Leimkuhler and S. Reich, Journal of Computational Physics 171,95-114, 2001 journal
Explicit, time-reversible and variable stepsize integration T. Holder, B. Leimkuhler, and S. Reich, Applied Numerical Mathematics 39,367-377, 2001 journal
Scaling invariance and adaptivity C. Budd, B. Leimkuhler and M. Piggott, Applied Numerical Mathematics 39,261-288, 2001 journal
Molecular dynamics algorithms for mixed hard-core/continuous potentials Y. Houndonougbo, B. Laird, and B. Leimkuhler, Journal of Molecular Physics 98,309-316, 2000 journal
A time-reversible, regularized, switching integrator for the N-body problem A. Kvaerno and B. Leimkuhler, SIAM Journal on Scientific Computing 22,1016-1035, 2000 journal
Geometric integrators based on scaling and switching B. Leimkuhler, Proceedings of the Equadiff Conference (Berlin, 1999), World Scientific ,988-993, 2000 journal
A Semi-explicit, variable-stepsize integrator for constrained dynamics E. Barth, B. Leimkuhler, and S. Reich, SIAM Journal on Scientific Computing 21,1027-1044, 1999 journal
Reversible adaptive regularization- perturbed Kepler motion and classical atomic trajectories B. Leimkuhler, Philosophical Transactions of the Royal Society of London A 357,1101-1134, 1999 journal
Reversible adaptive regularization methods for atomic N-body problems in applied fields B. Leimkuhler, Applied Numerical Mathematics 29,31-43, 1999 journal
Asymptotic error analysis of the Adaptive Verlet method S. Cirilli, E. Hairer and B. Leimkuhler, BIT Numerical Mathematics 39,25-33, 1999 journal
The Nose-Poincare method for constant temperature molecular dynamics S. Bond, B. Leimkuhler and B. Laird, Journal of Computational Physics 151,114-134, 1999 journal
Timestep acceleration of waveform relaxation B. Leimkuhler, SIAM Journal on Numerical Analysis 35,31-50, 1998 journal
Symplectic methods for rigid body dynamics B. Leimkuhler, in Computational Molecular Dynamics - Challenges, Methods, Ideas, Springer Lecture Notes in Computational Science and Engineering 4,, 1998 journal
Time transformations for reversible variable stepsize integration S. Bond and B. Leimkuhler, Numerical Algorithms 19,55-71, 1998 journal
The Adaptive Verlet method W. Huang and B. Leimkuhler, SIAM Journal on Scientific Computing 18,239-256, 1997 journal
Geometric integrators for classical spin systems J. Frank, W. Huang and B. Leimkuhler, Journal of Computational Physics 133,160-172, 1997 journal
Split-Hamiltonian methods for rigid body molecular dynamics A. Dullweber, B. Leimkuhler and R. McLachlan, Journal of Chemical Physics 107,5840-5851, 1997 journal
A symplectic method for rigid-body molecular simulation A. Kol, B. Laird and B. Leimkuhler, Journal of Chemical Physics 107,2580–2588, 1997 journal
Integration Methods for Molecular Dynamics B. Leimkuhler, S. Reich and R.D. Skeel, in IMA Volumes in Mathematics and Its Applications, Springer-Verlag 82,, 1997 journal
A symplectic integrator for Riemannian manifolds B. Leimkuhler and G. Patrick, Journal of Nonlinear Science 6,367-384, 1996 journal
Orthosymplectic integration of linear Hamiltonian systems B. Leimkuhler and E. Van Vleck, Numerische Mathematik 77,269-282, 1996 journal
Symplectic Methods for Conservative Multibody Systems E. Barth and B. Leimkuhler, Communications of the Fields Institute 10,25-43, 1996 journal
Algorithms for constrained molecular dynamics E. Barth, K. Kuczera, B. Leimkuhler and R. Skeel, Journal of Computational Chemistry 16,1192-1209, 1995 journal
Symplectic integration of constrained Hamiltonian systems B. Leimkuhler and S. Reich, Mathematics of Computation 63,589-605, 1994 journal
Symplectic numerical integrators in constrained Hamiltonian systems B. Leimkuhler and R. Skeel, Journal of Computational Physics 112,117-125, 1994 journal
Estimating waveform relaxation convergence B. Leimkuhler, SIAM Journal on Scientific Computing 14,872-889, 1993 journal
Relaxation Techniques in Multibody Dynamics B. Leimkuhler, Transactions of the Canadian Society of Mechanical Engineering 17,459-471, 1993 journal
Rapid Convergence of Waveform Relaxation B. Leimkuhler and A. Ruehli, Applied Numerical Mathematics 11,211-224, 1993 journal
Dynamic Iteration Schemes for Differential-Algebraic Equations in Large Scale Circuit Simulation B. Leimkuhler, Proceedings of the Conference on Computational Ordinary Differential Equations(London, 1990), IMA 39,, 1992 journal
Waveform Relaxation for Linear RC-Circuits B. Leimkuhler, U. Miekkala and O.Nevanlinna, IMPACT of Computing in Science and Engineering 3,123-145, 1991 journal
Differentiation of Constraints in Differential-Algebraic Equations S.L. Campbell and B. Leimkuhler, Mechanics of Structures and Machines 19,19-39, 1991 journal
Numerical solution of differential-algebraic equations for constrained mechanical motion C. Fuehrer and B. Leimkuhler, Numerische Mathematik 59,55-69, 1991 journal
Formulation and Numerical Solution of the Equations of Constrained Mechanical Motion C. Fuehrer and B. Leimkuhler, Proceedings of NUMDIFF-5 (Halle, 1989), Teubner- Texte in Mathematics 121,, 1991 journal
Approximation Methods for the Consistent Initialization of Differential Algebraic Equations B. Leimkuhler, L.R.Petzold and C.W. Gear,, SIAM Journal on Numerical Analysis 28,205-226, 1991 journal
A New Class of Generalized Inverses for Discretized Euler-Lagrange Equations C. Fuehrer and B. Leimkuhler, in NATO Advanced Research Workshop on Real-Time Integration Methods for Mechanical System Simulation, Springer 69,143-154, 1990 journal
Automatic integration of Euler-Lagrange equations with constraints C.W. Gear, B. Leimkuhler, G.K. Gupta, Journal of Computational and Applied Mathematics 12-13,77-90, 1985 journal