Estimating the Effective Support Size in Constant Query Complexity
November 21, 2022 Β· Declared Dead Β· π SIAM Symposium on Simplicity in Algorithms
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Shyam Narayanan, Jakub TΔtek
arXiv ID
2211.11344
Category
cs.DS: Data Structures & Algorithms
Cross-listed
math.ST
Citations
2
Venue
SIAM Symposium on Simplicity in Algorithms
Last Checked
4 months ago
Abstract
Estimating the support size of a distribution is a well-studied problem in statistics. Motivated by the fact that this problem is highly non-robust (as small perturbations in the distributions can drastically affect the support size) and thus hard to estimate, Goldreich [ECCC 2019] studied the query complexity of estimating the $Ξ΅$-\emph{effective support size} $\text{Ess}_Ξ΅$ of a distribution ${P}$, which is equal to the smallest support size of a distribution that is $Ξ΅$-far in total variation distance from ${P}$. In his paper, he shows an algorithm in the dual access setting (where we may both receive random samples and query the sampling probability $p(x)$ for any $x$) for a bicriteria approximation, giving an answer in $[\text{Ess}_{(1+Ξ²)Ξ΅},(1+Ξ³) \text{Ess}_Ξ΅]$ for some values $Ξ², Ξ³> 0$. However, his algorithm has either super-constant query complexity in the support size or super-constant approximation ratio $1+Ξ³= Ο(1)$. He then asked if this is necessary, or if it is possible to get a constant-factor approximation in a number of queries independent of the support size. We answer his question by showing that not only is complexity independent of $n$ possible for $Ξ³>0$, but also for $Ξ³=0$, that is, that the bicriteria relaxation is not necessary. Specifically, we show an algorithm with query complexity $O(\frac{1}{Ξ²^3 Ξ΅^3})$. That is, for any $0 < Ξ΅, Ξ²< 1$, we output in this complexity a number $\tilde{n} \in [\text{Ess}_{(1+Ξ²)Ξ΅},\text{Ess}_Ξ΅]$. We also show that it is possible to solve the approximate version with approximation ratio $1+Ξ³$ in complexity $O\left(\frac{1}{Ξ²^2 Ξ΅} + \frac{1}{βΡγ^2}\right)$. Our algorithm is very simple, and has $4$ short lines of pseudocode.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
π Similar Papers
In the same crypt β Data Structures & Algorithms
π
π
The Cartographer
R.I.P.
π»
Ghosted
Route Planning in Transportation Networks
R.I.P.
π»
Ghosted
Near-linear time approximation algorithms for optimal transport via Sinkhorn iteration
R.I.P.
π»
Ghosted
Hierarchical Clustering: Objective Functions and Algorithms
R.I.P.
π»
Ghosted
Graph Isomorphism in Quasipolynomial Time
π
π
The Cartographer
Simulation optimization: A review of algorithms and applications
Died the same way β π» Ghosted
R.I.P.
π»
Ghosted
Federated Learning: Strategies for Improving Communication Efficiency
R.I.P.
π»
Ghosted
In-Datacenter Performance Analysis of a Tensor Processing Unit
R.I.P.
π»
Ghosted
Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning
R.I.P.
π»
Ghosted