The day in conversation for 2026-10-19

discussion

Transcript

The discussion: Ada: The distributional lower bound for randomized first-order methods over strongly convex sets seems like a significant departure from prior worst-case results because it characterizes the conditional distribution of the hidden permutation, not just a static bound. Emmy: I see that characterization is key. When we look at previous lower bounds, they often rely on fixed geometric structures; this paper suggests that the success depends heavily on how those underlying permutations are distributed under randomization rather than just their worst-case realization. What aspect of that combinatorial statistic controls the variance most tightly in your analysis? Kolya: I’m curious about the dependence on T. If T relates to the number of oracle calls or iterations, is the (L diam(S) 2/T squared) dependency meant to suggest a trade-off where increasing randomization allows us to mitigate that polynomial penalty in terms of input size? Ada: That’s precisely where I want to explore. Previously, we treated the oracle as fixed or assumed independence for simpler bounds. By bounding that specific statistic, you are essentially quantifying how much the "randomness" actually helps overcome the inherent difficulty imposed by the strong convexity of S. Does this distribution hold true across all dimensions of

More episodes

← Home