{"id":974,"date":"2023-12-29T14:47:13","date_gmt":"2023-12-30T00:47:13","guid":{"rendered":"https:\/\/blogs.oregonstate.edu\/tpham\/?p=974"},"modified":"2024-03-19T00:58:55","modified_gmt":"2024-03-19T10:58:55","slug":"degenerate-scaling","status":"publish","type":"post","link":"https:\/\/blogs.oregonstate.edu\/tpham\/degenerate-scaling\/","title":{"rendered":"Degenerate scaling of random variables"},"content":{"rendered":"\n<p>There are well-known results about the scaling and centering laws of a sequence of <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BR%7D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{R}' title='\\mathbb{R}' class='latex' \/>-valued random variables. That is the problem of finding the right coefficients <img src='https:\/\/s0.wp.com\/latex.php?latex=a_n&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='a_n' title='a_n' class='latex' \/> and <img src='https:\/\/s0.wp.com\/latex.php?latex=b_n&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='b_n' title='b_n' class='latex' \/> such that the sequence <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cfrac%7BX_n-b_n%7D%7Ba_n%7D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\frac{X_n-b_n}{a_n}' title='\\frac{X_n-b_n}{a_n}' class='latex' \/> converges in law. See, for example, Section 14.8 of <a href=\"#gray\" data-type=\"internal\" data-id=\"#gray\">[1]<\/a>. Normally, one tries to avoid the degenerate type, which is when the limit distribution is a Dirac mass at 0. I recently ran into a problem where the degenerate type is desirable. More specifically:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote .my-justify-class {img.latex {margin-top:0px;}} is-layout-flow wp-block-quote-is-layout-flow\">\n<p>Let <img src='https:\/\/s0.wp.com\/latex.php?latex=%28X_n%29&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='(X_n)' title='(X_n)' class='latex' \/> be an i.i.d. sequence of <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BR%7D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{R}' title='\\mathbb{R}' class='latex' \/>-valued random variables. Let <img src='https:\/\/s0.wp.com\/latex.php?latex=%28a_n%29&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='(a_n)' title='(a_n)' class='latex' \/> be a positive sequence such that <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Clim+a_n%3D%5Cinfty&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\lim a_n=\\infty' title='\\lim a_n=\\infty' class='latex' \/>. Under what condition of <img src='https:\/\/s0.wp.com\/latex.php?latex=%28a_n%29&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='(a_n)' title='(a_n)' class='latex' \/> can one conclude that <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Clim%5Cfrac%7BX_n%7D%7Ba_n%7D%3D0&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\lim\\frac{X_n}{a_n}=0' title='\\lim\\frac{X_n}{a_n}=0' class='latex' \/> almost surely?<\/p>\n<\/blockquote>\n\n\n\n<p>This problem seems to be quite classic. If <img src='https:\/\/s0.wp.com\/latex.php?latex=X_1&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='X_1' title='X_1' class='latex' \/> has a bounded range, i.e. <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BP%7D%28X_1%5Cin%5Ba%2Cb%5D%29%3D1&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{P}(X_1\\in[a,b])=1' title='\\mathbb{P}(X_1\\in[a,b])=1' class='latex' \/> for some numbers <img src='https:\/\/s0.wp.com\/latex.php?latex=a&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='a' title='a' class='latex' \/> and <img src='https:\/\/s0.wp.com\/latex.php?latex=b&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='b' title='b' class='latex' \/>, then no additional condition of <img src='https:\/\/s0.wp.com\/latex.php?latex=%28a_n%29&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='(a_n)' title='(a_n)' class='latex' \/> is needed. How about the case <img src='https:\/\/s0.wp.com\/latex.php?latex=X_1&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='X_1' title='X_1' class='latex' \/> has an unbounded range? This is essentially Problem 51 on page 263 of <a href=\"#gray\">[1]<\/a>. The textbook does not ask for a full characterization of the sequence <img src='https:\/\/s0.wp.com\/latex.php?latex=a_n&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='a_n' title='a_n' class='latex' \/>. I find the problem quite interesting.<\/p>\n\n\n\n<p>The first observation is that the event <img src='https:\/\/s0.wp.com\/latex.php?latex=A%3D%5Cleft%5B%5Clim%5Cfrac%7BX_n%7D%7Ba_n%7D%3D0%5Cright%5D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='A=\\left[\\lim\\frac{X_n}{a_n}=0\\right]' title='A=\\left[\\lim\\frac{X_n}{a_n}=0\\right]' class='latex' \/> is a tail event. By <a href=\"https:\/\/en.wikipedia.org\/wiki\/Kolmogorov%27s_zero%E2%80%93one_law\" data-type=\"URL\" data-id=\"https:\/\/en.wikipedia.org\/wiki\/Kolmogorov%27s_zero%E2%80%93one_law\">Kolmogorov&#8217;s 0-1 Law<\/a>, either <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BP%7D%28A%29%3D0&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{P}(A)=0' title='\\mathbb{P}(A)=0' class='latex' \/> or <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BP%7D%28A%29%3D1&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{P}(A)=1' title='\\mathbb{P}(A)=1' class='latex' \/>. We just need to decide between the two. One may be tempted to think that <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cfrac%7BX_n%7D%7Ba_n%7D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\frac{X_n}{a_n}' title='\\frac{X_n}{a_n}' class='latex' \/> is essentially the same as <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cfrac%7BX_1%7D%7Ba_n%7D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\frac{X_1}{a_n}' title='\\frac{X_1}{a_n}' class='latex' \/>, so it should almost surely converge 0 as <img src='https:\/\/s0.wp.com\/latex.php?latex=n%5Cto%5Cinfty&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='n\\to\\infty' title='n\\to\\infty' class='latex' \/>. This argument is not correct because <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cfrac%7BX_n%7D%7Ba_n%7D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\frac{X_n}{a_n}' title='\\frac{X_n}{a_n}' class='latex' \/> only has the same distribution as <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cfrac%7BX_1%7D%7Ba_n%7D.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\frac{X_1}{a_n}.' title='\\frac{X_1}{a_n}.' class='latex' \/> If the range of values of <img src='https:\/\/s0.wp.com\/latex.php?latex=X_1&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='X_1' title='X_1' class='latex' \/> is unbounded, then so is the range of values of <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cfrac%7BX_1%7D%7Ba_n%7D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\frac{X_1}{a_n}' title='\\frac{X_1}{a_n}' class='latex' \/>. Let us consider two following cases, one of which gives <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BP%7D%28A%29%3D0&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{P}(A)=0' title='\\mathbb{P}(A)=0' class='latex' \/> and the other gives <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BP%7D%28A%29%3D1.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{P}(A)=1.' title='\\mathbb{P}(A)=1.' class='latex' \/> Let us denote the cumulative distribution function of <img src='https:\/\/s0.wp.com\/latex.php?latex=%7CX_1%7C&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='|X_1|' title='|X_1|' class='latex' \/> by <img src='https:\/\/s0.wp.com\/latex.php?latex=F%28x%29.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='F(x).' title='F(x).' class='latex' \/><\/p>\n\n\n\n<p><strong>Case 1:<\/strong> there exists a positive sequence <img src='https:\/\/s0.wp.com\/latex.php?latex=%28c_n%29&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='(c_n)' title='(c_n)' class='latex' \/> such that<\/p>\n\n\n\n<p align=\"center\"><img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cdisplaystyle+%5Clim%5Cfrac%7Bc_n%7D%7Ba_n%7D%3D0&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\displaystyle \\lim\\frac{c_n}{a_n}=0' title='\\displaystyle \\lim\\frac{c_n}{a_n}=0' class='latex' \/> and <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cdisplaystyle%5Csum%281-F%28c_n%29%29%3C%5Cinfty.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\displaystyle\\sum(1-F(c_n))&lt;\\infty.' title='\\displaystyle\\sum(1-F(c_n))&lt;\\infty.' class='latex' \/><\/p>\n\n\n\n<p>Let <img src='https:\/\/s0.wp.com\/latex.php?latex=E_n%3D%5B%7CX_n%7C%5Cle+c_n%5D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='E_n=[|X_n|\\le c_n]' title='E_n=[|X_n|\\le c_n]' class='latex' \/> and <img src='https:\/\/s0.wp.com\/latex.php?latex=E%3D%5Ccap_%7Bn%3D1%7D%5E%5Cinfty+E_n.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='E=\\cap_{n=1}^\\infty E_n.' title='E=\\cap_{n=1}^\\infty E_n.' class='latex' \/> Then <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BP%7D%28E_n%29%3DF%28c_n%29&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{P}(E_n)=F(c_n)' title='\\mathbb{P}(E_n)=F(c_n)' class='latex' \/> and<\/p>\n\n\n\n<p align=\"center\"><img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cdisplaystyle+%5Cmathbb%7BP%7D%28E%29%3D%5Cprod_%7Bn%3D1%7D%5E%5Cinfty+F%28c_n%29%3D%5Cprod_%7Bn%3D1%7D%5E%5Cinfty+%281-%281-F%28c_n%29%29&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\displaystyle \\mathbb{P}(E)=\\prod_{n=1}^\\infty F(c_n)=\\prod_{n=1}^\\infty (1-(1-F(c_n))' title='\\displaystyle \\mathbb{P}(E)=\\prod_{n=1}^\\infty F(c_n)=\\prod_{n=1}^\\infty (1-(1-F(c_n))' class='latex' \/><\/p>\n\n\n\n<p>which has a finite positive value because <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Csum%281-F%28c_n%29%29%3C%5Cinfty.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\sum(1-F(c_n))&lt;\\infty.' title='\\sum(1-F(c_n))&lt;\\infty.' class='latex' \/> It is easy to see that <img src='https:\/\/s0.wp.com\/latex.php?latex=E%5Csubset+A&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='E\\subset A' title='E\\subset A' class='latex' \/> and thus <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BP%7D%28A%29%3D1.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{P}(A)=1.' title='\\mathbb{P}(A)=1.' class='latex' \/><\/p>\n\n\n\n<p><strong>Case 2:<\/strong> there exists a positive sequence <img src='https:\/\/s0.wp.com\/latex.php?latex=%28c_n%29&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='(c_n)' title='(c_n)' class='latex' \/> such that<\/p>\n\n\n\n<p align=\"center\"><img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cdisplaystyle+%5Clim%5Cfrac%7Bc_n%7D%7Ba_n%7D%3E0&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\displaystyle \\lim\\frac{c_n}{a_n}&gt;0' title='\\displaystyle \\lim\\frac{c_n}{a_n}&gt;0' class='latex' \/> and <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cdisplaystyle%5Csum%281-F%28c_n%29%29%3D%5Cinfty.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\displaystyle\\sum(1-F(c_n))=\\infty.' title='\\displaystyle\\sum(1-F(c_n))=\\infty.' class='latex' \/><\/p>\n\n\n\n<p>Let <img src='https:\/\/s0.wp.com\/latex.php?latex=E_n%3D%5B%7CX_n%7C%3E+c_n%5D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='E_n=[|X_n|&gt; c_n]' title='E_n=[|X_n|&gt; c_n]' class='latex' \/> and <img src='https:\/\/s0.wp.com\/latex.php?latex=E%3D%5Climsup+E_n.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='E=\\limsup E_n.' title='E=\\limsup E_n.' class='latex' \/> The events <img src='https:\/\/s0.wp.com\/latex.php?latex=E_n&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='E_n' title='E_n' class='latex' \/> are independent and<\/p>\n\n\n\n<p align=\"center\"><img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cdisplaystyle+%5Csum+%5Cmathbb%7BP%7D%28E_n%29%3D%5Csum%281-F%28c_n%29%29%3D%5Cinfty.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\displaystyle \\sum \\mathbb{P}(E_n)=\\sum(1-F(c_n))=\\infty.' title='\\displaystyle \\sum \\mathbb{P}(E_n)=\\sum(1-F(c_n))=\\infty.' class='latex' \/>\n\n\n\n<p>By <a href=\"https:\/\/en.wikipedia.org\/wiki\/Borel%E2%80%93Cantelli_lemma#Converse_result\" data-type=\"URL\" data-id=\"https:\/\/en.wikipedia.org\/wiki\/Borel%E2%80%93Cantelli_lemma#Converse_result\">Borel-Cantelli&#8217;s Lemma<\/a>, <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BP%7D%28E%29%3D1&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{P}(E)=1' title='\\mathbb{P}(E)=1' class='latex' \/>. It is easy to see that <img src='https:\/\/s0.wp.com\/latex.php?latex=E%5Csubset+A%5Ec.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='E\\subset A^c.' title='E\\subset A^c.' class='latex' \/> Thus, <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BP%7D%28A%29%3D1-%5Cmathbb%7BP%7D%28A%5Ec%29%3D0.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{P}(A)=1-\\mathbb{P}(A^c)=0.' title='\\mathbb{P}(A)=1-\\mathbb{P}(A^c)=0.' class='latex' \/><\/p>\n\n\n\n<p><strong>Final thoughts:<\/strong> Cases 1 and 2 do not cover all possibilities. One can see this through the simple case <img src='https:\/\/s0.wp.com\/latex.php?latex=F%28x%29%3D1-e%5E%7B-x%7D&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='F(x)=1-e^{-x}' title='F(x)=1-e^{-x}' class='latex' \/> (the case when the random variables <img src='https:\/\/s0.wp.com\/latex.php?latex=X_n&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='X_n' title='X_n' class='latex' \/> are i.i.d. exponentials of mean one) and <img src='https:\/\/s0.wp.com\/latex.php?latex=a_n%3D2%5Cln+n.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='a_n=2\\ln n.' title='a_n=2\\ln n.' class='latex' \/> It would be interesting to see a full characterization of the sequence <img src='https:\/\/s0.wp.com\/latex.php?latex=%28a_n%29&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='(a_n)' title='(a_n)' class='latex' \/> for which one has <img src='https:\/\/s0.wp.com\/latex.php?latex=%5Cmathbb%7BP%7D%28A%29%3D1.&#038;bg=ffffff&#038;fg=000000&#038;s=0' alt='\\mathbb{P}(A)=1.' title='\\mathbb{P}(A)=1.' class='latex' \/> I think this should be known somewhere in the literature.<\/p>\n\n\n\n<p><a href=\"https:\/\/blogs.oregonstate.edu\/tpham\/characterization-degenerate-scaling\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.oregonstate.edu\/tpham\/characterization-degenerate-scaling\/\">Update 01\/01\/2024<\/a>: I have resolved the problem.<\/p>\n\n\n\n<h2>References:<\/h2>\n<ol class=\"small\">\n<li id=\"gray\"> &#8220;<em>A modern approach to Probability Theory<\/em>&#8221; (1997) by Friestedt and Gray.<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>Let $latex (X_n)$ be an i.i.d. sequence of $latex \\mathbb{R}$-valued random variables. Let $latex (a_n)$ be a positive sequence such that $latex \\lim a_n=\\infty$. Under what condition of $latex (a_n)$ can one conclude that $latex \\lim\\frac{X_n}{a_n}=0$ almost surely? <a href=\"https:\/\/blogs.oregonstate.edu\/tpham\/degenerate-scaling\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":12738,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[13],"tags":[14],"class_list":["post-974","post","type-post","status-publish","format-standard","hentry","category-math","tag-probability"],"_links":{"self":[{"href":"https:\/\/blogs.oregonstate.edu\/tpham\/wp-json\/wp\/v2\/posts\/974","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.oregonstate.edu\/tpham\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.oregonstate.edu\/tpham\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/tpham\/wp-json\/wp\/v2\/users\/12738"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/tpham\/wp-json\/wp\/v2\/comments?post=974"}],"version-history":[{"count":54,"href":"https:\/\/blogs.oregonstate.edu\/tpham\/wp-json\/wp\/v2\/posts\/974\/revisions"}],"predecessor-version":[{"id":1183,"href":"https:\/\/blogs.oregonstate.edu\/tpham\/wp-json\/wp\/v2\/posts\/974\/revisions\/1183"}],"wp:attachment":[{"href":"https:\/\/blogs.oregonstate.edu\/tpham\/wp-json\/wp\/v2\/media?parent=974"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/tpham\/wp-json\/wp\/v2\/categories?post=974"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/tpham\/wp-json\/wp\/v2\/tags?post=974"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}