10,904 Research products, page 1 of 1,091
Loading
- Publication . Preprint . 2020Open Access EnglishAuthors:Elisabeth Stelling; Melanie Ricke-Hoch; Sergej Erschow; Steve Hoffman; Anke K. Bergmann; Maren Heimerl; Stefan Pietzsch; Karin Battmer; Alexandra Haase; Britta Stapel; +4 moreElisabeth Stelling; Melanie Ricke-Hoch; Sergej Erschow; Steve Hoffman; Anke K. Bergmann; Maren Heimerl; Stefan Pietzsch; Karin Battmer; Alexandra Haase; Britta Stapel; Michaela Scherr; Ofer Binah; Jean-Luc Balligand; Denise Hilfiker-Kleiner;Publisher: Cold Spring Harbor Laboratory
AbstractCardiac levels of the signal transducer and activator of transcription factor-3 (STAT3) decline with age, and male but not female mice with a cardiomyocyte-specific STAT3 deficiency (CKO) display premature age-related heart failure associated with reduced cardiac capillary density. In the present study isolated male and female CKO-cardiomyocytes exhibit increased prostaglandin (PG)-generating cyclooxygenase-2 (COX-2) expression. The PG-degrading hydroxyprostaglandin-dehydrogenase-15 (HPGD) expression is only reduced in male cardiomyocytes, which is associated with increased PGD2 secretion from isolated male but not female CKO-cardiomyocytes. Reduced HPGD expression in male cardiomyocytes derive from impaired androgen-receptor-(AR)-signaling due to loss of its co-factor STAT3. Elevated PGD2 secretion in males is associated with increased white adipocyte accumulation in aged male but not female hearts. Adipocyte differentiation is enhanced in isolated SCA-1+-cardiac-progenitor-cells (CPC) from young male CKO-mice compared to the adipocyte differentiation of male wildtype (WT)-CPC and CPC isolated from female mice. Epigenetic analysis in freshly isolated male CKO-CPC display hypermethylation in pro-angiogenic genes (Fgfr2, Epas1) and hypomethylation in the white adipocyte differentiation gene Zfp423 associated with upregulated ZFP423 expression and a shift from endothelial to white adipocyte differentiation compared to WT-CPC. The expression of the histone-methyltransferase EZH2 is reduced in male CKO-CPC compared to male WT-CPC whereas no differences in the EZH2 expression in female CPC were observed. Clonally expanded CPC can differentiate into endothelial cells or into adipocytes depending on the differentiation conditions. ZFP423 overexpression is sufficient to induce white adipocyte differentiation of clonal CPC. In isolated WT-CPC, PGD2 stimulation reduces the expression of EZH2 thereby upregulating ZFP423 expression and promoting white adipocyte differentiation.Thus, cardiomyocyte STAT3-deficiency leads to age-related and sex-specific cardiac remodeling and failure in part due to sex-specific alterations in PGD2 secretion and subsequent epigenetic impairment of the differentiation potential of CPC. Causally involved is the impaired AR signaling in absence of STAT3, which reduces the expression of the PG degrading enzyme HPGD.
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Preprint . Article . 2017Open Access EnglishAuthors:Shalev-Shwartz, Shai; Shamir, Ohad; Shammah, Shaked;Shalev-Shwartz, Shai; Shamir, Ohad; Shammah, Shaked;
In recent years, Deep Learning has become the go-to solution for a broad range of applications, often outperforming state-of-the-art. However, it is important, for both theoreticians and practitioners, to gain a deeper understanding of the difficulties and limitations associated with common approaches and algorithms. We describe four types of simple problems, for which the gradient-based algorithms commonly used in deep learning either fail or suffer from significant difficulties. We illustrate the failures through practical experiments, and provide theoretical insights explaining their source, and how they might be remedied.
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2017Open Access EnglishAuthors:Vladimir Gol'dshtein; Valerii Pchelintsev; Alexander Ukhlov;Vladimir Gol'dshtein; Valerii Pchelintsev; Alexander Ukhlov;Country: Russian Federation
In this paper we apply estimates of the norms of Sobolev extension operators to the spectral estimates of of the first nontrivial Neumann eigenvalue of the Laplace operator in non-convex extension domains. As a consequence we obtain a connection between resonant frequencies of free membranes and the smallest-circle problem (initially proposed by J.~J.~Sylvester in 1857). 12 pages
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Conference object . Preprint . Article . 2020Open Access EnglishAuthors:Jingfei Du; Edouard Grave; Beliz Gunel; Vishrav Chaudhary; Onur Celebi; Michael Auli; Veselin Stoyanov; Alexis Conneau;Jingfei Du; Edouard Grave; Beliz Gunel; Vishrav Chaudhary; Onur Celebi; Michael Auli; Veselin Stoyanov; Alexis Conneau;
Unsupervised pre-training has led to much recent progress in natural language understanding. In this paper, we study self-training as another way to leverage unlabeled data through semi-supervised learning. To obtain additional data for a specific task, we introduce SentAugment, a data augmentation method which computes task-specific query embeddings from labeled data to retrieve sentences from a bank of billions of unlabeled sentences crawled from the web. Unlike previous semi-supervised methods, our approach does not require in-domain unlabeled data and is therefore more generally applicable. Experiments show that self-training is complementary to strong RoBERTa baselines on a variety of tasks. Our augmentation approach leads to scalable and effective self-training with improvements of up to 2.6% on standard text classification benchmarks. Finally, we also show strong gains on knowledge-distillation and few-shot learning. 8 pages
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2018Open Access EnglishAuthors:Alexander I. Bufetov; Boris Solomyak;Alexander I. Bufetov; Boris Solomyak;Publisher: HAL CCSDCountry: FranceProject: EC | IChaos (647133), NSF | Fractals and Ergodic Theo... (1361424)
We consider a direct product of a suspension flow over a substitution dynamical system and an arbitrary ergodic flow and give quantitative estimates for the speed of convergence for ergodic integrals of such systems. Our argument relies on new uniform estimates of the spectral measure for suspension flows over substitution dynamical systems. The paper answers a question by Jon Chaika. 14 pages, minor corrections, to appear in Bulletin de la SMF. arXiv admin note: text overlap with arXiv:1305.7373
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2017Open Access EnglishAuthors:Kyle Kawagoe; Greg Huber; Marc Pradas; Michael Wilkinson; Alain Pumir; Eli Ben-Naim;Kyle Kawagoe; Greg Huber; Marc Pradas; Michael Wilkinson; Alain Pumir; Eli Ben-Naim;
We investigate statistical properties of trails formed by a random process incorporating aggregation, fragmentation, and diffusion. In this stochastic process, which takes place in one spatial dimension, two neighboring trails may combine to form a larger one and also, one trail may split into two. In addition, trails move diffusively. The model is defined by two parameters which quantify the fragmentation rate and the fragment size. In the long-time limit, the system reaches a steady state, and our focus is the limiting distribution of trail weights. We find that the density of trail weight has power-law tail $P(w) \sim w^{-\gamma}$ for small weight $w$. We obtain the exponent $\gamma$ analytically, and find that it varies continuously with the two model parameters. The exponent $\gamma$ can be positive or negative, so that in one range of parameters small-weight tails are abundant, and in the complementary range, they are rare. Comment: 8 pages, 8 figures
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2013Open Access EnglishAuthors:Uriya A. First;Uriya A. First;Project: EC | EXPANDERS (226135)
We introduce and study categorical realizations of quivers. This construction generalizes comma categories and includes representations of quivers on categories, twisted representations of quivers and bilinear pairings as special cases. We prove a Krull-Schmidt Theorem in this general context, which results in a Krull-Schmidt Theorem for the special cases just mentioned. We also show that cancellation holds under milder assumptions. Using similar ideas we prove a version of Fitting's Lemma for natural transformations between functors. 12 pages
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2019Open Access EnglishAuthors:Wanli Wang; Alessandro Vezzani; Raffaella Burioni; Eli Barkai;Wanli Wang; Alessandro Vezzani; Raffaella Burioni; Eli Barkai;
In a growing number of strongly disordered and dense systems, the dynamics of a particle pulled by an external force field exhibits super-diffusion. In the context of glass forming systems, super cooled glasses and contamination spreading in porous medium it was suggested to model this behavior with a biased continuous time random walk. Here we analyze the plume of particles far lagging behind the mean, with the single big jump principle. Revealing the mechanism of the anomaly, we show how a single trapping time, the largest one, is responsible for the rare fluctuations in the system. These non typical fluctuations still control the behavior of the mean square displacement, which is the most basic quantifier of the dynamics in many experimental setups. We show how the initial conditions, describing either stationary state or non-equilibrium case, persist for ever in the sense that the rare fluctuations are sensitive to the initial preparation. To describe the fluctuations of the largest trapping time, we modify Fr\'{e}chet's law from extreme value statistics, taking into consideration the fact that the large fluctuations are very different from those observed for independent and identically distributed random variables. Comment: 14 pages, 9 figures
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2021Open Access EnglishAuthors:Tomer Berg; Ofer Shayevitz; Young-Han Kim; Lele Wang;Tomer Berg; Ofer Shayevitz; Young-Han Kim; Lele Wang;Project: NSERC , EC | InfoInt (639573)
We consider the problem of distributed source simulation with no communication, in which Alice and Bob observe sequences $U^{n}$ and $V^{n}$ respectively, drawn from a joint distribution $p_{UV}^ {\otimes n}$ , and wish to locally generate sequences $X^{n}$ and $Y^{n}$ respectively with a joint distribution that is close (in KL divergence) to $p_{XY}^ {\otimes n}$ . We provide a single-letter condition under which such a simulation is asymptotically possible with a vanishing KL divergence. Our condition is nontrivial only in the case where the Gacs-Korner (GK) common information between $U$ and $V$ is nonzero, and we conjecture that only scalar Markov chains $X-U-V-Y$ can be simulated otherwise. Motivated by this conjecture, we further examine the case where both $p_{UV}$ and $p_{XY}$ are doubly symmetric binary sources with parameters $p,q\leq 1/2$ respectively. While it is trivial that in this case $p\leq q$ is both necessary and sufficient, we use Fourier analytic tools to show that when $p$ is close to $q$ then any successful simulation is close to being scalar in the total variation sense.
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . Other literature type . 2013Open Access EnglishAuthors:Sarah E. Medland; Jaime Derringer; Jian Yang; Tõnu Esko; Nicolas W. Martin; Konstantin Shakhbazov; Abdel Abdellaoui; Arpana Agrawal; Eva Albrecht; Behrooz Z. Alizadeh; +173 moreSarah E. Medland; Jaime Derringer; Jian Yang; Tõnu Esko; Nicolas W. Martin; Konstantin Shakhbazov; Abdel Abdellaoui; Arpana Agrawal; Eva Albrecht; Behrooz Z. Alizadeh; Najaf Amin; John Barnard; Kelly S. Benke; Lawrence F. Bielak; Jeffrey A. Boatman; Patricia A. Boyle; Gail Davies; Christiaan de Leeuw; Niina Eklund; Daniel S. Evans; Rudolf Ferhmann; Krista Fischer; Christian Gieger; Håkon K. Gjessing; Sara Hägg; Jennifer R. Harris; Caroline Hayward; Christina Holzapfel; Erik Ingelsson; Bo Jacobsson; Peter K. Joshi; Astanand Jugessur; Marika Kaakinen; Stavroula Kanoni; Juha Karjalainen; Ivana Kolcic; Kati Kristiansson; Zoltán Kutalik; Jari Lahti; Sang Hong Lee; Peng Lin; Penelope A. Lind; Yongmei Liu; Kurt Lohman; Marisa Loitfelder; George McMahon; Pedro Marques Vidal; Osorio Meirelles; Lili Milani; Marja-Liisa Nuotio; Christopher Oldmeadow; Katja Petrovic; Wouter J. Peyrot; Ozren Polasek; Lydia Quaye; Eva Reinmaa; John P. Rice; Thais S. Rizzi; Helena Schmidt; Reinhold Schmidt; Albert V. Smith; Jennifer A. Smith; Toshiko Tanaka; Antonio Terracciano; Matthijs J. H. M. van der Loos; Veronique Vitart; Henry Völzke; Jürgen Wellmann; Lei Yu; Jüri Allik; Stefania Bandinelli; François Bastardot; Jonathan P. Beauchamp; David A. Bennett; Klaus Berger; Dorret I. Boomsma; Ute Bültmann; Harry Campbell; Christopher F. Chabris; Lynn Cherkas; Francesco Cucca; Mariza de Andrade; Philip L. De Jager; Ian J. Deary; George Dedoussis; Panos Deloukas; Maria Dimitriou; Martin F. Elderson; Johan G. Eriksson; David M. Evans; Jessica D. Faul; Luigi Ferrucci; Melissa E. Garcia; Henrik Grönberg; Vilmundur Guonason; Per Hall; Juliette Harris; Tamara B. Harris; Nicholas D. Hastie; Andrew C. Heath; Dena G. Hernandez; Wolfgang Hoffmann; Adriaan Hofman; Rolf Holle; Jouke-Jan Hottenga; William G. Iacono; Thomas Illig; Mika Kähönen; Jaakko Kaprio; Robert M. Kirkpatrick; Matthew Kowgier; Antti Latvala; Lenore J. Launer; Debbie A Lawlor; Terho Lehtimäki; Jingmei Li; Paul Lichtenstein; Peter Lichtner; David C. Liewald; Patrik K. E. Magnusson; Tomi E. Mäkinen; Marco Masala; Matt McGue; Andres Metspalu; Andreas Mielck; Grant W. Montgomery; Sutapa Mukherjee; Dale R. Nyholt; Ben A. Oostra; Lyle J. Palmer; Aarno Palotie; Markus Perola; Patricia A. Peyser; Martin Preisig; Katri Räikkönen; Olli T. Raitakari; Anu Realo; Susan M. Ring; Samuli Ripatti; Fernando Rivadeneira; Igor Rudan; Veikko Salomaa; Antti-Pekka Sarin; David Schlessinger; Rodney J. Scott; Harold Snieder; Beate St Pourcain; John M. Starr; Ida Surakka; Rauli Svento; Alexander Teumer; Henning Tiemeier; Frank J. A. van Rooij; David R. Van Wagoner; Erkki Vartiainen; Peter Vollenweider; Judith M. Vonk; Gérard Waeber; David R. Weir; H.-Erich Wichmann; Elisabeth Widen; Gonneke Willemsen; James F. Wilson; Alan F. Wright; George Davey-Smith; Lude Franke; Patrick J. F. Groenen; Albert Hofman; Magnus Johannesson; Sharon L.R. Kardia; Robert F. Krueger; David Laibson; Nicholas G. Martin; Michelle N. Meyer; Danielle Posthuma; Roy Thurik; Nicholas J. Timpson; André G. Uitterlinden; Cornelia M. van Duijn; Peter M. Visscher; Daniel J. Benjamin; David Cesarini; Philipp Koellinger;
pmc: PMC3751588
pmid: 23722424
handle: 1871.1/0963b7a9-27a9-4cbb-a429-bffdbd58c1fa , 1887/101982 , 2066/117012 , 11858/00-001M-0000-0029-4A56-B , 11858/00-001M-0000-0029-4A59-5 , 11858/00-001M-0000-0029-4A58-7 , 20.500.11820/0f76c4b9-f0ef-4512-a24c-ab2e8cb936ff , 1765/67851 , 11370/2e7ff532-5bad-44e5-b550-7d865be1c523 , 11245/1.410713 , 11541.2/131178
pmc: PMC3751588
pmid: 23722424
handle: 1871.1/0963b7a9-27a9-4cbb-a429-bffdbd58c1fa , 1887/101982 , 2066/117012 , 11858/00-001M-0000-0029-4A56-B , 11858/00-001M-0000-0029-4A59-5 , 11858/00-001M-0000-0029-4A58-7 , 20.500.11820/0f76c4b9-f0ef-4512-a24c-ab2e8cb936ff , 1765/67851 , 11370/2e7ff532-5bad-44e5-b550-7d865be1c523 , 11245/1.410713 , 11541.2/131178
Countries: Netherlands, United States, United Kingdom, Croatia, AustraliaProject: WT , NIH | FINANCIAL STATUS--RETIREM... (2P01AG005842-04), NIH | ECONOMICS OF AGING TRAINI... (5T32AG000186-10), EC | DEVHEALTH (269874), NSF | EAGER Proposal: Workshop ... (1064089), EC | GMI (230374), NIH | NBER Center for Aging and... (5P30AG012810-15)A genome-wide association study (GWAS) of educational attainment was conducted in a discovery sample of 101,069 individuals and a replication sample of 25,490. Three independent single-nucleotide polymorphisms (SNPs) are genome-wide significant (rs9320913, rs11584700, rs4851266), and all three replicate. Estimated effects sizes are small (coefficient of determination R2 ≈ 0.02%), approximately 1 month of schooling per allele. A linear polygenic score from all measured SNPs accounts for ≈2% of the variance in both educational attainment and cognitive function. Genes in the region of the loci have previously been associated with health, cognitive, and central nervous system phenotypes, and bioinformatics analyses suggest the involvement of the anterior caudate nucleus. These findings provide promising candidate SNPs for follow-up work, and our effect size estimates can anchor power analyses in social-science genetics. Economics
Substantial popularitySubstantial popularity In top 1%Substantial influencePopularity: Citation-based measure reflecting the current impact.Substantial influence In top 1%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product.
10,904 Research products, page 1 of 1,091
Loading
- Publication . Preprint . 2020Open Access EnglishAuthors:Elisabeth Stelling; Melanie Ricke-Hoch; Sergej Erschow; Steve Hoffman; Anke K. Bergmann; Maren Heimerl; Stefan Pietzsch; Karin Battmer; Alexandra Haase; Britta Stapel; +4 moreElisabeth Stelling; Melanie Ricke-Hoch; Sergej Erschow; Steve Hoffman; Anke K. Bergmann; Maren Heimerl; Stefan Pietzsch; Karin Battmer; Alexandra Haase; Britta Stapel; Michaela Scherr; Ofer Binah; Jean-Luc Balligand; Denise Hilfiker-Kleiner;Publisher: Cold Spring Harbor Laboratory
AbstractCardiac levels of the signal transducer and activator of transcription factor-3 (STAT3) decline with age, and male but not female mice with a cardiomyocyte-specific STAT3 deficiency (CKO) display premature age-related heart failure associated with reduced cardiac capillary density. In the present study isolated male and female CKO-cardiomyocytes exhibit increased prostaglandin (PG)-generating cyclooxygenase-2 (COX-2) expression. The PG-degrading hydroxyprostaglandin-dehydrogenase-15 (HPGD) expression is only reduced in male cardiomyocytes, which is associated with increased PGD2 secretion from isolated male but not female CKO-cardiomyocytes. Reduced HPGD expression in male cardiomyocytes derive from impaired androgen-receptor-(AR)-signaling due to loss of its co-factor STAT3. Elevated PGD2 secretion in males is associated with increased white adipocyte accumulation in aged male but not female hearts. Adipocyte differentiation is enhanced in isolated SCA-1+-cardiac-progenitor-cells (CPC) from young male CKO-mice compared to the adipocyte differentiation of male wildtype (WT)-CPC and CPC isolated from female mice. Epigenetic analysis in freshly isolated male CKO-CPC display hypermethylation in pro-angiogenic genes (Fgfr2, Epas1) and hypomethylation in the white adipocyte differentiation gene Zfp423 associated with upregulated ZFP423 expression and a shift from endothelial to white adipocyte differentiation compared to WT-CPC. The expression of the histone-methyltransferase EZH2 is reduced in male CKO-CPC compared to male WT-CPC whereas no differences in the EZH2 expression in female CPC were observed. Clonally expanded CPC can differentiate into endothelial cells or into adipocytes depending on the differentiation conditions. ZFP423 overexpression is sufficient to induce white adipocyte differentiation of clonal CPC. In isolated WT-CPC, PGD2 stimulation reduces the expression of EZH2 thereby upregulating ZFP423 expression and promoting white adipocyte differentiation.Thus, cardiomyocyte STAT3-deficiency leads to age-related and sex-specific cardiac remodeling and failure in part due to sex-specific alterations in PGD2 secretion and subsequent epigenetic impairment of the differentiation potential of CPC. Causally involved is the impaired AR signaling in absence of STAT3, which reduces the expression of the PG degrading enzyme HPGD.
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Preprint . Article . 2017Open Access EnglishAuthors:Shalev-Shwartz, Shai; Shamir, Ohad; Shammah, Shaked;Shalev-Shwartz, Shai; Shamir, Ohad; Shammah, Shaked;
In recent years, Deep Learning has become the go-to solution for a broad range of applications, often outperforming state-of-the-art. However, it is important, for both theoreticians and practitioners, to gain a deeper understanding of the difficulties and limitations associated with common approaches and algorithms. We describe four types of simple problems, for which the gradient-based algorithms commonly used in deep learning either fail or suffer from significant difficulties. We illustrate the failures through practical experiments, and provide theoretical insights explaining their source, and how they might be remedied.
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2017Open Access EnglishAuthors:Vladimir Gol'dshtein; Valerii Pchelintsev; Alexander Ukhlov;Vladimir Gol'dshtein; Valerii Pchelintsev; Alexander Ukhlov;Country: Russian Federation
In this paper we apply estimates of the norms of Sobolev extension operators to the spectral estimates of of the first nontrivial Neumann eigenvalue of the Laplace operator in non-convex extension domains. As a consequence we obtain a connection between resonant frequencies of free membranes and the smallest-circle problem (initially proposed by J.~J.~Sylvester in 1857). 12 pages
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Conference object . Preprint . Article . 2020Open Access EnglishAuthors:Jingfei Du; Edouard Grave; Beliz Gunel; Vishrav Chaudhary; Onur Celebi; Michael Auli; Veselin Stoyanov; Alexis Conneau;Jingfei Du; Edouard Grave; Beliz Gunel; Vishrav Chaudhary; Onur Celebi; Michael Auli; Veselin Stoyanov; Alexis Conneau;
Unsupervised pre-training has led to much recent progress in natural language understanding. In this paper, we study self-training as another way to leverage unlabeled data through semi-supervised learning. To obtain additional data for a specific task, we introduce SentAugment, a data augmentation method which computes task-specific query embeddings from labeled data to retrieve sentences from a bank of billions of unlabeled sentences crawled from the web. Unlike previous semi-supervised methods, our approach does not require in-domain unlabeled data and is therefore more generally applicable. Experiments show that self-training is complementary to strong RoBERTa baselines on a variety of tasks. Our augmentation approach leads to scalable and effective self-training with improvements of up to 2.6% on standard text classification benchmarks. Finally, we also show strong gains on knowledge-distillation and few-shot learning. 8 pages
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2018Open Access EnglishAuthors:Alexander I. Bufetov; Boris Solomyak;Alexander I. Bufetov; Boris Solomyak;Publisher: HAL CCSDCountry: FranceProject: EC | IChaos (647133), NSF | Fractals and Ergodic Theo... (1361424)
We consider a direct product of a suspension flow over a substitution dynamical system and an arbitrary ergodic flow and give quantitative estimates for the speed of convergence for ergodic integrals of such systems. Our argument relies on new uniform estimates of the spectral measure for suspension flows over substitution dynamical systems. The paper answers a question by Jon Chaika. 14 pages, minor corrections, to appear in Bulletin de la SMF. arXiv admin note: text overlap with arXiv:1305.7373
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2017Open Access EnglishAuthors:Kyle Kawagoe; Greg Huber; Marc Pradas; Michael Wilkinson; Alain Pumir; Eli Ben-Naim;Kyle Kawagoe; Greg Huber; Marc Pradas; Michael Wilkinson; Alain Pumir; Eli Ben-Naim;
We investigate statistical properties of trails formed by a random process incorporating aggregation, fragmentation, and diffusion. In this stochastic process, which takes place in one spatial dimension, two neighboring trails may combine to form a larger one and also, one trail may split into two. In addition, trails move diffusively. The model is defined by two parameters which quantify the fragmentation rate and the fragment size. In the long-time limit, the system reaches a steady state, and our focus is the limiting distribution of trail weights. We find that the density of trail weight has power-law tail $P(w) \sim w^{-\gamma}$ for small weight $w$. We obtain the exponent $\gamma$ analytically, and find that it varies continuously with the two model parameters. The exponent $\gamma$ can be positive or negative, so that in one range of parameters small-weight tails are abundant, and in the complementary range, they are rare. Comment: 8 pages, 8 figures
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2013Open Access EnglishAuthors:Uriya A. First;Uriya A. First;Project: EC | EXPANDERS (226135)
We introduce and study categorical realizations of quivers. This construction generalizes comma categories and includes representations of quivers on categories, twisted representations of quivers and bilinear pairings as special cases. We prove a Krull-Schmidt Theorem in this general context, which results in a Krull-Schmidt Theorem for the special cases just mentioned. We also show that cancellation holds under milder assumptions. Using similar ideas we prove a version of Fitting's Lemma for natural transformations between functors. 12 pages
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2019Open Access EnglishAuthors:Wanli Wang; Alessandro Vezzani; Raffaella Burioni; Eli Barkai;Wanli Wang; Alessandro Vezzani; Raffaella Burioni; Eli Barkai;
In a growing number of strongly disordered and dense systems, the dynamics of a particle pulled by an external force field exhibits super-diffusion. In the context of glass forming systems, super cooled glasses and contamination spreading in porous medium it was suggested to model this behavior with a biased continuous time random walk. Here we analyze the plume of particles far lagging behind the mean, with the single big jump principle. Revealing the mechanism of the anomaly, we show how a single trapping time, the largest one, is responsible for the rare fluctuations in the system. These non typical fluctuations still control the behavior of the mean square displacement, which is the most basic quantifier of the dynamics in many experimental setups. We show how the initial conditions, describing either stationary state or non-equilibrium case, persist for ever in the sense that the rare fluctuations are sensitive to the initial preparation. To describe the fluctuations of the largest trapping time, we modify Fr\'{e}chet's law from extreme value statistics, taking into consideration the fact that the large fluctuations are very different from those observed for independent and identically distributed random variables. Comment: 14 pages, 9 figures
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . 2021Open Access EnglishAuthors:Tomer Berg; Ofer Shayevitz; Young-Han Kim; Lele Wang;Tomer Berg; Ofer Shayevitz; Young-Han Kim; Lele Wang;Project: NSERC , EC | InfoInt (639573)
We consider the problem of distributed source simulation with no communication, in which Alice and Bob observe sequences $U^{n}$ and $V^{n}$ respectively, drawn from a joint distribution $p_{UV}^ {\otimes n}$ , and wish to locally generate sequences $X^{n}$ and $Y^{n}$ respectively with a joint distribution that is close (in KL divergence) to $p_{XY}^ {\otimes n}$ . We provide a single-letter condition under which such a simulation is asymptotically possible with a vanishing KL divergence. Our condition is nontrivial only in the case where the Gacs-Korner (GK) common information between $U$ and $V$ is nonzero, and we conjecture that only scalar Markov chains $X-U-V-Y$ can be simulated otherwise. Motivated by this conjecture, we further examine the case where both $p_{UV}$ and $p_{XY}$ are doubly symmetric binary sources with parameters $p,q\leq 1/2$ respectively. While it is trivial that in this case $p\leq q$ is both necessary and sufficient, we use Fourier analytic tools to show that when $p$ is close to $q$ then any successful simulation is close to being scalar in the total variation sense.
Average popularityAverage popularity In bottom 99%Average influencePopularity: Citation-based measure reflecting the current impact.Average influence In bottom 99%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product. - Publication . Article . Preprint . Other literature type . 2013Open Access EnglishAuthors:Sarah E. Medland; Jaime Derringer; Jian Yang; Tõnu Esko; Nicolas W. Martin; Konstantin Shakhbazov; Abdel Abdellaoui; Arpana Agrawal; Eva Albrecht; Behrooz Z. Alizadeh; +173 moreSarah E. Medland; Jaime Derringer; Jian Yang; Tõnu Esko; Nicolas W. Martin; Konstantin Shakhbazov; Abdel Abdellaoui; Arpana Agrawal; Eva Albrecht; Behrooz Z. Alizadeh; Najaf Amin; John Barnard; Kelly S. Benke; Lawrence F. Bielak; Jeffrey A. Boatman; Patricia A. Boyle; Gail Davies; Christiaan de Leeuw; Niina Eklund; Daniel S. Evans; Rudolf Ferhmann; Krista Fischer; Christian Gieger; Håkon K. Gjessing; Sara Hägg; Jennifer R. Harris; Caroline Hayward; Christina Holzapfel; Erik Ingelsson; Bo Jacobsson; Peter K. Joshi; Astanand Jugessur; Marika Kaakinen; Stavroula Kanoni; Juha Karjalainen; Ivana Kolcic; Kati Kristiansson; Zoltán Kutalik; Jari Lahti; Sang Hong Lee; Peng Lin; Penelope A. Lind; Yongmei Liu; Kurt Lohman; Marisa Loitfelder; George McMahon; Pedro Marques Vidal; Osorio Meirelles; Lili Milani; Marja-Liisa Nuotio; Christopher Oldmeadow; Katja Petrovic; Wouter J. Peyrot; Ozren Polasek; Lydia Quaye; Eva Reinmaa; John P. Rice; Thais S. Rizzi; Helena Schmidt; Reinhold Schmidt; Albert V. Smith; Jennifer A. Smith; Toshiko Tanaka; Antonio Terracciano; Matthijs J. H. M. van der Loos; Veronique Vitart; Henry Völzke; Jürgen Wellmann; Lei Yu; Jüri Allik; Stefania Bandinelli; François Bastardot; Jonathan P. Beauchamp; David A. Bennett; Klaus Berger; Dorret I. Boomsma; Ute Bültmann; Harry Campbell; Christopher F. Chabris; Lynn Cherkas; Francesco Cucca; Mariza de Andrade; Philip L. De Jager; Ian J. Deary; George Dedoussis; Panos Deloukas; Maria Dimitriou; Martin F. Elderson; Johan G. Eriksson; David M. Evans; Jessica D. Faul; Luigi Ferrucci; Melissa E. Garcia; Henrik Grönberg; Vilmundur Guonason; Per Hall; Juliette Harris; Tamara B. Harris; Nicholas D. Hastie; Andrew C. Heath; Dena G. Hernandez; Wolfgang Hoffmann; Adriaan Hofman; Rolf Holle; Jouke-Jan Hottenga; William G. Iacono; Thomas Illig; Mika Kähönen; Jaakko Kaprio; Robert M. Kirkpatrick; Matthew Kowgier; Antti Latvala; Lenore J. Launer; Debbie A Lawlor; Terho Lehtimäki; Jingmei Li; Paul Lichtenstein; Peter Lichtner; David C. Liewald; Patrik K. E. Magnusson; Tomi E. Mäkinen; Marco Masala; Matt McGue; Andres Metspalu; Andreas Mielck; Grant W. Montgomery; Sutapa Mukherjee; Dale R. Nyholt; Ben A. Oostra; Lyle J. Palmer; Aarno Palotie; Markus Perola; Patricia A. Peyser; Martin Preisig; Katri Räikkönen; Olli T. Raitakari; Anu Realo; Susan M. Ring; Samuli Ripatti; Fernando Rivadeneira; Igor Rudan; Veikko Salomaa; Antti-Pekka Sarin; David Schlessinger; Rodney J. Scott; Harold Snieder; Beate St Pourcain; John M. Starr; Ida Surakka; Rauli Svento; Alexander Teumer; Henning Tiemeier; Frank J. A. van Rooij; David R. Van Wagoner; Erkki Vartiainen; Peter Vollenweider; Judith M. Vonk; Gérard Waeber; David R. Weir; H.-Erich Wichmann; Elisabeth Widen; Gonneke Willemsen; James F. Wilson; Alan F. Wright; George Davey-Smith; Lude Franke; Patrick J. F. Groenen; Albert Hofman; Magnus Johannesson; Sharon L.R. Kardia; Robert F. Krueger; David Laibson; Nicholas G. Martin; Michelle N. Meyer; Danielle Posthuma; Roy Thurik; Nicholas J. Timpson; André G. Uitterlinden; Cornelia M. van Duijn; Peter M. Visscher; Daniel J. Benjamin; David Cesarini; Philipp Koellinger;
pmc: PMC3751588
pmid: 23722424
handle: 1871.1/0963b7a9-27a9-4cbb-a429-bffdbd58c1fa , 1887/101982 , 2066/117012 , 11858/00-001M-0000-0029-4A56-B , 11858/00-001M-0000-0029-4A59-5 , 11858/00-001M-0000-0029-4A58-7 , 20.500.11820/0f76c4b9-f0ef-4512-a24c-ab2e8cb936ff , 1765/67851 , 11370/2e7ff532-5bad-44e5-b550-7d865be1c523 , 11245/1.410713 , 11541.2/131178
pmc: PMC3751588
pmid: 23722424
handle: 1871.1/0963b7a9-27a9-4cbb-a429-bffdbd58c1fa , 1887/101982 , 2066/117012 , 11858/00-001M-0000-0029-4A56-B , 11858/00-001M-0000-0029-4A59-5 , 11858/00-001M-0000-0029-4A58-7 , 20.500.11820/0f76c4b9-f0ef-4512-a24c-ab2e8cb936ff , 1765/67851 , 11370/2e7ff532-5bad-44e5-b550-7d865be1c523 , 11245/1.410713 , 11541.2/131178
Countries: Netherlands, United States, United Kingdom, Croatia, AustraliaProject: WT , NIH | FINANCIAL STATUS--RETIREM... (2P01AG005842-04), NIH | ECONOMICS OF AGING TRAINI... (5T32AG000186-10), EC | DEVHEALTH (269874), NSF | EAGER Proposal: Workshop ... (1064089), EC | GMI (230374), NIH | NBER Center for Aging and... (5P30AG012810-15)A genome-wide association study (GWAS) of educational attainment was conducted in a discovery sample of 101,069 individuals and a replication sample of 25,490. Three independent single-nucleotide polymorphisms (SNPs) are genome-wide significant (rs9320913, rs11584700, rs4851266), and all three replicate. Estimated effects sizes are small (coefficient of determination R2 ≈ 0.02%), approximately 1 month of schooling per allele. A linear polygenic score from all measured SNPs accounts for ≈2% of the variance in both educational attainment and cognitive function. Genes in the region of the loci have previously been associated with health, cognitive, and central nervous system phenotypes, and bioinformatics analyses suggest the involvement of the anterior caudate nucleus. These findings provide promising candidate SNPs for follow-up work, and our effect size estimates can anchor power analyses in social-science genetics. Economics
Substantial popularitySubstantial popularity In top 1%Substantial influencePopularity: Citation-based measure reflecting the current impact.Substantial influence In top 1%Influence: Citation-based measure reflecting the total impact.add Add to ORCIDPlease grant OpenAIRE to access and update your ORCID works.This Research product is the result of merged Research products in OpenAIRE.
You have already added works in your ORCID record related to the merged Research product.