loroch > optimization

bookmarks (hide)5
display
all
bookmarks only
bookmarks per page
5
10
20
50
100
sort by
added at
title
RSS
BibTeX
XML

1Efficient Online and Batch Learning Using Forward Backward Splitting
http://www.jmlr.org/papers/volume10/duchi09a/duchi09a.pdf
6 years ago by @loroch
show all tags
dual_averaging
learning
optimization
dual_averaginglearningoptimization
(0)
copydelete
- community post
- history of this post
1Primal-dual subgradient methods for convex problems
http://ium.mccme.ru/postscript/s12/GS-Nesterov%20Primal-dual.pdf
6 years ago by @loroch
show all tags
deep_learning
dual_averaging
optimization
deep_learningdual_averagingoptimization
(0)
copydelete
- community post
- history of this post
1Adaptive Bound Optimization for Online Convex Optimization
https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/36483.pdf
6 years ago by @loroch
show all tags
optimization
optimization
(0)
copydelete
- community post
- history of this post
11506.01186.pdf
https://arxiv.org/pdf/1506.01186.pdf
6 years ago by @loroch
show all tags
deep_learning
optimization
deep_learningoptimization
(0)
copydelete
- community post
- history of this post
1duchi11a.dvi
http://www.jmlr.org/papers/volume12/duchi11a/duchi11a.pdf
6 years ago by @loroch
show all tags
deep_learning
optimization
deep_learningoptimization
(0)
copydelete
- community post
- history of this post

⟨⟨
⟨
1
⟩
⟩⟩

publications (hide)23
display
all
publications only
publications per page
5
10
20
50
100
sort by
added at
title
author
publication date
entry type
help for advanced sorting...
RSS
BibTeX
RDF
more...

3Don't decay the learning rate, increase the batch size
S. Smith, P. Kindermans, C. Ying, and Q. Le. arXiv preprint arXiv:1711.00489, (2017)
5 years ago by @loroch
show all tags
batch_size
deep_learning
learning_rate
optimization
scaling
batch_sizedeep_learninglearning_rateoptimizationscaling
(0)
copydeleteadd this publication to your clipboard
2Accelerating stochastic gradient descent using predictive variance reduction
R. Johnson, and T. Zhang. Advances in neural information processing systems, page 315--323. (2013)
5 years ago by @loroch
show all tags
optimization
variance_reduction
optimizationvariance_reduction
(0)
copydeleteadd this publication to your clipboard
2How Does Batch Normalization Help Optimization?(No, It Is Not About Internal Covariate Shift)
S. Santurkar, D. Tsipras, A. Ilyas, and A. Madry. arXiv preprint arXiv:1805.11604, (2018)
5 years ago by @loroch
show all tags
batch_normalization
deep_learning
optimization
batch_normalizationdeep_learningoptimization
(0)
copydeleteadd this publication to your clipboard
3Adding One Neuron Can Eliminate All Bad Local Minima
S. Liang, R. Sun, J. Lee, and R. Srikant. arXiv preprint arXiv:1805.08671, (2018)
5 years ago by @loroch
show all tags
deep_learning
optimization
deep_learningoptimization
(0)
copydeleteadd this publication to your clipboard
2A Hierarchical Model for Device Placement
A. Mirhoseini, A. Goldie, H. Pham, B. Steiner, Q. Le, and J. Dean. (2018)
5 years ago by @loroch
show all tags
RL
RNN
deep_learning
device
optimization
placement
RLRNNdeep_learningdeviceoptimizationplacement
(0)
copydeleteadd this publication to your clipboard

⟨⟨
⟨
1
2
3
⟩
⟩⟩

BibSonomy

bookmarks (hide)5
display
all
bookmarks only
bookmarks per page
5
10
20
50
100
sort by
added at
title
RSS
BibTeX
XML

1Efficient Online and Batch Learning Using Forward Backward Splitting

1Primal-dual subgradient methods for convex problems

1Adaptive Bound Optimization for Online Convex Optimization

11506.01186.pdf

1duchi11a.dvi

publications (hide)23
display
all
publications only
publications per page
5
10
20
50
100
sort by
added at
title
author
publication date
entry type
help for advanced sorting...
RSS
BibTeX
RDF
more...

3Don't decay the learning rate, increase the batch size

2Accelerating stochastic gradient descent using predictive variance reduction

2How Does Batch Normalization Help Optimization?(No, It Is Not About Internal Covariate Shift)

3Adding One Neuron Can Eliminate All Bad Local Minima

2A Hierarchical Model for Device Placement

browse

related tags

concepts

tags

bookmarks (hide)5 displayallbookmarks onlybookmarks per page5102050100 sort byadded attitle RSSBibTeXXML

publications (hide)23 displayallpublications onlypublications per page5102050100 sort byadded attitleauthorpublication dateentry typehelp for advanced sorting... RSSBibTeXRDFmore...

browse

related tags

tags

bookmarks (hide)5
display
all
bookmarks only
bookmarks per page
5
10
20
50
100
sort by
added at
title
RSS
BibTeX
XML

publications (hide)23
display
all
publications only
publications per page
5
10
20
50
100
sort by
added at
title
author
publication date
entry type
help for advanced sorting...
RSS
BibTeX
RDF
more...