Tuning-Free Decentralized Nonconvex Stochastic Optimization

Li Jiaxiang et al.

Pacific Journal of Optimization2025https://doi.org/10.61208/pjo-2025-009article
AJG 1
Weight
0.50

What the paper says

Existing decentralized algorithms usually require knowledge of problem parameters for updating local iterates. For example, the hyperparameters (such as learning rate) usually require the knowledge of Lipschitz constant of the global gradient or topological information of the communication networks, which are usually not accessible in practice. In this paper, we propose D-NASA, the first algorithm for decentralized nonconvex stochastic optimization that requires no prior knowledge of any problem parameters. We show that D-NASA has the optimal rate of convergence for nonconvex objectives under very mild conditions and enjoys the linear-speedup effect, i.e. the computation becomes faster as the number of nodes in the system increases. Extensive numerical experiments are conducted to support our findings.

Open paper page →

Cite this paper

https://doi.org/https://doi.org/10.61208/pjo-2025-009

Or copy a formatted citation

@article{li2025,
  title        = {{Tuning-Free Decentralized Nonconvex Stochastic Optimization}},
  author       = {Li Jiaxiang et al.},
  journal      = {Pacific Journal of Optimization},
  year         = {2025},
  doi          = {https://doi.org/https://doi.org/10.61208/pjo-2025-009},
}

Paste directly into BibTeX, Zotero, or your reference manager.

Flag this paper

Tuning-Free Decentralized Nonconvex Stochastic Optimization

Flags are reviewed by the Arbiter methodology team within 5 business days.


Evidence weight

0.50

Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40

F · citation impact0.50 × 0.4 = 0.20
M · momentum0.50 × 0.15 = 0.07
V · venue signal0.50 × 0.05 = 0.03
R · text relevance †0.50 × 0.4 = 0.20

† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.