{"id":10203,"date":"2025-12-28T13:08:41","date_gmt":"2025-12-28T13:08:41","guid":{"rendered":"https:\/\/techtrendfeed.com\/?p=10203"},"modified":"2025-12-28T13:08:41","modified_gmt":"2025-12-28T13:08:41","slug":"the-communication-complexity-of-distributed-estimation","status":"publish","type":"post","link":"https:\/\/techtrendfeed.com\/?p=10203","title":{"rendered":"The Communication Complexity of Distributed Estimation"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div>\n<p>We research an extension of the usual two-party communication mannequin by which Alice and Bob maintain likelihood distributions <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>p<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">p<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:0.625em;vertical-align:-0.1944em;\"\/><span class=\"mord mathnormal\">p<\/span><\/span><\/span><\/span> and <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>q<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">q<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:0.625em;vertical-align:-0.1944em;\"\/><span class=\"mord mathnormal\" style=\"margin-right:0.03588em;\">q<\/span><\/span><\/span><\/span> over domains <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>X<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">X<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:0.6833em;\"\/><span class=\"mord mathnormal\" style=\"margin-right:0.07847em;\">X<\/span><\/span><\/span><\/span> and <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>Y<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">Y<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:0.6833em;\"\/><span class=\"mord mathnormal\" style=\"margin-right:0.22222em;\">Y<\/span><\/span><\/span><\/span>, respectively. Their purpose is to estimate<\/p>\n<p><span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><msub><mi mathvariant=\"double-struck\">E<\/mi><mrow><mi>x<\/mi><mo>\u223c<\/mo><mi>p<\/mi><mo separator=\"true\">,<\/mo><mi>y<\/mi><mo>\u223c<\/mo><mi>q<\/mi><\/mrow><\/msub><mo stretchy=\"false\">[<\/mo><mi>f<\/mi><mo stretchy=\"false\">(<\/mo><mi>x<\/mi><mo separator=\"true\">,<\/mo><mi>y<\/mi><mo stretchy=\"false\">)<\/mo><mo stretchy=\"false\">]<\/mo><\/mrow><annotation encoding=\"application\/x-tex\">mathbb{E}_{x sim p, y sim q}[f(x, y)]<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:1.0361em;vertical-align:-0.2861em;\"\/><span class=\"mord\"><span class=\"mord mathbb\">E<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height:0.1514em;\"><span style=\"top:-2.55em;margin-left:0em;margin-right:0.05em;\"><span class=\"pstrut\" style=\"height:2.7em;\"\/><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord mathnormal mtight\">x<\/span><span class=\"mrel mtight\">\u223c<\/span><span class=\"mord mathnormal mtight\">p<\/span><span class=\"mpunct mtight\">,<\/span><span class=\"mord mathnormal mtight\" style=\"margin-right:0.03588em;\">y<\/span><span class=\"mrel mtight\">\u223c<\/span><span class=\"mord mathnormal mtight\" style=\"margin-right:0.03588em;\">q<\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><span class=\"vlist-r\"><span class=\"vlist\" style=\"height:0.2861em;\"><span\/><\/span><\/span><\/span><\/span><\/span><span class=\"mopen\">[<\/span><span class=\"mord mathnormal\" style=\"margin-right:0.10764em;\">f<\/span><span class=\"mopen\">(<\/span><span class=\"mord mathnormal\">x<\/span><span class=\"mpunct\">,<\/span><span class=\"mspace\" style=\"margin-right:0.1667em;\"\/><span class=\"mord mathnormal\" style=\"margin-right:0.03588em;\">y<\/span><span class=\"mclose\">)]<\/span><\/span><\/span><\/span><\/p>\n<p>to inside additive error <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>\u03b5<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">varepsilon<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:0.4306em;\"\/><span class=\"mord mathnormal\">\u03b5<\/span><\/span><\/span><\/span> for a bounded perform <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>f<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">f<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:0.8889em;vertical-align:-0.1944em;\"\/><span class=\"mord mathnormal\" style=\"margin-right:0.10764em;\">f<\/span><\/span><\/span><\/span>, identified to each events. We seek advice from this because the distributed estimation downside. Particular circumstances of this downside come up in quite a lot of areas together with sketching, databases and studying. Our purpose is to grasp how the required communication scales with the communication complexity of <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>f<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">f<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:0.8889em;vertical-align:-0.1944em;\"\/><span class=\"mord mathnormal\" style=\"margin-right:0.10764em;\">f<\/span><\/span><\/span><\/span> and the error parameter <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>\u03b5<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">varepsilon<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:0.4306em;\"\/><span class=\"mord mathnormal\">\u03b5<\/span><\/span><\/span><\/span>.<\/p>\n<p>The random sampling method \u2014 estimating the imply by averaging over <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>O<\/mi><mo stretchy=\"false\">(<\/mo><mn>1<\/mn><mi mathvariant=\"normal\">\/<\/mi><msup><mi>\u03b5<\/mi><mn>2<\/mn><\/msup><mo stretchy=\"false\">)<\/mo><\/mrow><annotation encoding=\"application\/x-tex\">O(1\/varepsilon^2)<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:1.0641em;vertical-align:-0.25em;\"\/><span class=\"mord mathnormal\" style=\"margin-right:0.02778em;\">O<\/span><span class=\"mopen\">(<\/span><span class=\"mord\">1\/<\/span><span class=\"mord\"><span class=\"mord mathnormal\">\u03b5<\/span><span class=\"msupsub\"><span class=\"vlist-t\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height:0.8141em;\"><span style=\"top:-3.063em;margin-right:0.05em;\"><span class=\"pstrut\" style=\"height:2.7em;\"\/><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\">2<\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mclose\">)<\/span><\/span><\/span><\/span> random samples \u2014 requires <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>O<\/mi><mo stretchy=\"false\">(<\/mo><mi>R<\/mi><mo stretchy=\"false\">(<\/mo><mi>f<\/mi><mo stretchy=\"false\">)<\/mo><mi mathvariant=\"normal\">\/<\/mi><msup><mi>\u03b5<\/mi><mn>2<\/mn><\/msup><mo stretchy=\"false\">)<\/mo><\/mrow><annotation encoding=\"application\/x-tex\">O(R(f)\/varepsilon^2)<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:1.0641em;vertical-align:-0.25em;\"\/><span class=\"mord mathnormal\" style=\"margin-right:0.02778em;\">O<\/span><span class=\"mopen\">(<\/span><span class=\"mord mathnormal\" style=\"margin-right:0.00773em;\">R<\/span><span class=\"mopen\">(<\/span><span class=\"mord mathnormal\" style=\"margin-right:0.10764em;\">f<\/span><span class=\"mclose\">)<\/span><span class=\"mord\">\/<\/span><span class=\"mord\"><span class=\"mord mathnormal\">\u03b5<\/span><span class=\"msupsub\"><span class=\"vlist-t\"><span class=\"vlist-r\"><span class=\"vlist\" style=\"height:0.8141em;\"><span style=\"top:-3.063em;margin-right:0.05em;\"><span class=\"pstrut\" style=\"height:2.7em;\"\/><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\">2<\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mclose\">)<\/span><\/span><\/span><\/span> complete communication, the place <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>R<\/mi><mo stretchy=\"false\">(<\/mo><mi>f<\/mi><mo stretchy=\"false\">)<\/mo><\/mrow><annotation encoding=\"application\/x-tex\">R(f)<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:1em;vertical-align:-0.25em;\"\/><span class=\"mord mathnormal\" style=\"margin-right:0.00773em;\">R<\/span><span class=\"mopen\">(<\/span><span class=\"mord mathnormal\" style=\"margin-right:0.10764em;\">f<\/span><span class=\"mclose\">)<\/span><\/span><\/span><\/span> is the randomized communication complexity of <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mi>f<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">f<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:0.8889em;vertical-align:-0.1944em;\"\/><span class=\"mord mathnormal\" style=\"margin-right:0.10764em;\">f<\/span><\/span><\/span><\/span>. We design a brand new debiasing protocol which improves the dependence on <span class=\"katex\"><span class=\"katex-mathml\"><math xmlns=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><semantics><mrow><mn>1<\/mn><mi mathvariant=\"normal\">\/<\/mi><mi>\u03b5<\/mi><\/mrow><annotation encoding=\"application\/x-tex\">1\/varepsilon<\/annotation><\/semantics><\/math><\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"strut\" style=\"height:1em;vertical-align:-0.25em;\"\/><span class=\"mord\">1\/<\/span><span class=\"mord mathnormal\">\u03b5<\/span><\/span><\/span><\/span> to be linear as an alternative of quadratic. Moreover we present higher higher bounds for a number of particular courses of capabilities, together with the Equality and Higher-than capabilities. We introduce decrease sure strategies primarily based on spectral strategies and discrepancy, and present the optimality of lots of our protocols: the debiasing protocol is tight for common capabilities, and that our protocols for the equality and greater-than capabilities are additionally optimum. Moreover, we present that amongst full-rank Boolean capabilities, Equality is basically the best.<\/p>\n<ul class=\"links-stacked\">\n<li>\u2020 College of California, Los Angeles<\/li>\n<li>\u2021 College of California, Berkeley<\/li>\n<li>\u00a7 Institute for Superior Research (IAS)<\/li>\n<\/ul>\n<\/div>\n\n","protected":false},"excerpt":{"rendered":"<p>We research an extension of the usual two-party communication mannequin by which Alice and Bob maintain likelihood distributions ppp and qqq over domains XXX and YYY, respectively. Their purpose is to estimate Ex\u223cp,y\u223cq[f(x,y)]mathbb{E}_{x sim p, y sim q}[f(x, y)]Ex\u223cp,y\u223cq\u200b[f(x,y)] to inside additive error \u03b5varepsilon\u03b5 for a bounded perform fff, identified to each events. We seek [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":10205,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[55],"tags":[2583,2158,741,3688],"class_list":["post-10203","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-machine-learning","tag-communication","tag-complexity","tag-distributed","tag-estimation"],"_links":{"self":[{"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/posts\/10203","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=10203"}],"version-history":[{"count":1,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/posts\/10203\/revisions"}],"predecessor-version":[{"id":10204,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/posts\/10203\/revisions\/10204"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/media\/10205"}],"wp:attachment":[{"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=10203"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=10203"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=10203"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}<!-- This website is optimized by Airlift. Learn more: https://airlift.net. Template:. Learn more: https://airlift.net. Template: 69d9690a190636c2e0989534. Config Timestamp: 2026-04-10 21:18:02 UTC, Cached Timestamp: 2026-05-06 18:33:12 UTC -->