Improved Sample Complexity for Private Nonsmooth Nonconvex Optimization
We study differentially private (DP) optimization algorithms for stochastic and empirical objectives which are neither smooth ...
Read moreTag: Optimization
Hyperparameter Optimization For LLMs: Advanced Strategies
Finding an optimal set of hyperparameters is essential for efficient and effective training of Large Language ...
Read more
NVIDIA Introduces CLIMB: A Framework for Iterative Data Mixture Optimization in Language Model Pretraining
Challenges in Constructing Effective Pretraining Data Mixtures As large language models (LLMs) scale in size and ...
Read more
Defending against Prompt Injection with Structured Queries (StruQ) and Preference Optimization (SecAlign)
Recent advances in Large Language Models (LLMs) enable exciting LLM-integrated applications. However, as LLMs have improved, ...
Read morePremium Content
