doi: 10.1017/nps.2021.4
AbstractThousands of Roma were killed in Ukraine by the Nazis and auxiliary police on the spot. There are more than 50,000 Roma in today’s Ukraine, represented by second and third generation decendants of the genocide survivors. The discussion on Roma identity cannot be isolated from the memory of the genocide, which makes the struggle over the past a reflexive landmark that mobilizes the Roma movement. About twenty Roma genocide memorials have been erected in Ukraine during last decade, and in 2016 the national memorial of the Roma genocide was opened in Babi Yar. However, scholars do not have a clear picture of memory narratives and memory practices of the Roma genocide in Ukraine. A comprehensive analysis of the contemporary situation is not possible without an examination of the history and memory of the Roma genocide before 1991.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.1017/nps.2021.4&type=result"></script>');
-->
</script>
Green | |
hybrid |
citations | 1 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.1017/nps.2021.4&type=result"></script>');
-->
</script>
Recently rediscovered photographs of the remains of thirteen individuals buried in the Sado Valley Mesolithic shell middens of Poças de S. Bento and Arapouco, excavated in 1960 and 1962, show the potential of revisiting excavation archives with new methods. The analysis, which applies the principles of archaeothanatology and is enriched by experimental taphonomic research, confirmed details concerning the treatment of the dead body and provided new insights into the use of burial spaces. Some bodies may have been mummified prior to burial, a phenomenon possibly linked to their curation and transport, highlighting the significance of both the body and the burial place in Mesolithic south-western Portugal.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.1017/eaa.2022.3&type=result"></script>');
-->
</script>
Green | |
hybrid |
citations | 2 | |
popularity | Average | |
influence | Top 10% | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.1017/eaa.2022.3&type=result"></script>');
-->
</script>
By examining the donations by the local nobility to the local church, this thesis aims to study the church as a public room. By analyzing the donations of the nobility in relation to Habermas concept of the public sphere and the concept of conspicuous consumption the donations to the churches can be viewed as manifestations of power. This thesis studies all donations to the churches that leaves material and visual remnants in the church room. The results shows that there was a conscious strategy for the nobility to use the church for manifestation and representation of power. The nobility used their donations to manifest their power and to represent the power towards the people. This was done by filling the church with their names and coats of arms. By donating liturgical objects, church silver, chapels and coats of arms used for funerals the nobility was able to symbolically place themselves in the religious rituals. The church as a room was a symbolically and hierarchical place, and by connecting themselves with this room by donations the nobility could manifest their position in society, both locally and nationally.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______361::fdf2b57f4b9e76bb0e0e5351bfb2e36e&type=result"></script>');
-->
</script>
Green | |
bronze |
citations | 0 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______361::fdf2b57f4b9e76bb0e0e5351bfb2e36e&type=result"></script>');
-->
</script>
Uppgifter för behandling av naturliga språk (NLP) har under de senaste åren visat sig vara särskilt effektiva när man använder förtränade språkmodeller som BERT. Det enorma kravet på datorresurser som krävs för att träna sådana modeller gör det dock svårt att använda dem i verkligheten. För att lösa detta problem har komprimeringsmetoder utvecklats. I det här projektet studeras, genomförs och testas några av dessa metoder för komprimering av neurala nätverk för textbearbetning. I vårt fall var den mest effektiva metoden Knowledge Distillation, som består i att överföra kunskap från ett stort neuralt nätverk, som kallas läraren, till ett litet neuralt nätverk, som kallas eleven. Det finns flera varianter av detta tillvägagångssätt, som skiljer sig åt i komplexitet. Vi kommer att titta på två av dem i det här projektet. Den första gör det möjligt att överföra kunskap mellan ett neuralt nätverk och en mindre dubbelriktad LSTM, genom att endast använda resultatet från den större modellen. Och en andra, mer komplex metod som uppmuntrar elevmodellen att också lära sig av lärarmodellens mellanliggande lager för att utvinna kunskap. Det slutliga målet med detta projekt är att ge företagets datavetare färdiga komprimeringsmetoder för framtida projekt som kräver användning av djupa neurala nätverk för NLP. Natural language processing (NLP) tasks have proven to be particularly effective when using pre-trained language models such as BERT. However, the enormous demand on computational resources required to train such models makes their use in the real world difficult. To overcome this problem, compression methods have emerged in recent years. In this project, some of these neural network compression approaches for text processing are studied, implemented and tested. In our case, the most efficient method was Knowledge Distillation, which consists in transmitting knowledge from a large neural network, called teacher, to a small neural network, called student. There are several variants of this approach, which differ in their complexity. We will see two of them in this project, the first one which allows a knowledge transfer between any neural network and another smaller bidirectional LSTM, using only the output of the larger model. And a second, more complex approach that encourages the student model to also learn from the intermediate layers of the teacher model for incremental knowledge extraction. The ultimate goal of this project is to provide the company’s data scientists with ready-to-use compression methods for their future projects requiring the use of deep neural networks for NLP.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______681::69a26608626358792e2c6512ad59ecb4&type=result"></script>');
-->
</script>
Green | |
bronze |
citations | 0 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______681::69a26608626358792e2c6512ad59ecb4&type=result"></script>');
-->
</script>
Iron ore mining in the Norrbotten region of Sweden began in the early years of the twentieth century as a commercially uncertain and even dangerous proposition. But even before it began to generate profits, public debate began over the appropriate role of the state and of private capital (including foreign investors). This included whether iron ore should be exported for profit or retained for future processing in Sweden—even though the technology and infrastructure for such domestic industry did not exist. Tracing the evolution of this debate in the Swedish news media through to the First World War, this paper argues that the revenue generated by exports became more attractive than the promise of future domestic industry because that revenue could underwrite pressing political objectives. Although domestic iron ore processing remained linked to visions of future industrial prosperity, uncertain visions of future prosperity lost appeal as the capacity for export revenues to generate prosperity in the present became more potent.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.36368/jns.v13i1.941&type=result"></script>');
-->
</script>
Green | |
bronze |
citations | 0 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.36368/jns.v13i1.941&type=result"></script>');
-->
</script>
School in the shadow: Private education in Stockholm 1735. During the early eighteenth century, private education was a more significant sector of the educational market than was public education, regarding the number of students and teachers, the presence of female students and teachers, the social background of the students, and the introduction of a more diverse and modern curriculum. Hitherto, little has been known of the actual scope or general conditions of private education, which has been over-shadowed by studies of public education. The article maps private education through the Stockholm Church Consistory’s (Stockholms stads konsistorium) thorough inventory of private teachers in the capital of Sweden during 1734–36, providing information of both suppliers and consumers within the private sector of the educational market, as well as of the practice and functions of private education in early modern time.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.36368/njedh.v7i1.168&type=result"></script>');
-->
</script>
Green | |
gold |
citations | 0 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.36368/njedh.v7i1.168&type=result"></script>');
-->
</script>
Denna uppsats är en studie av Blåsmarks bönhusförenings nedläggning och överlåtelsen avbönhuset till Blåsmarks DUF år 1947. Studien är begränsad till tidsperioden 1945–1948 föratt undersöka föreningarna innan och efter den händelse som är i fokus i uppsatsen och ärbaserad på de mötesprotokoll bägge föreningar förde under tidsperioden 1945-1948. Iuppsatsen undersöks föreningarnas arbete innan bönhusföreningens nedläggning 1947 samtorsakerna bakom dess nedläggning och vilka följder det fick för Blåsmarks DUF. Skeendetundersöks ur ett processperspektiv och följer den analytiskt-rationella modellen. Studiensresultat visade att bönhusföreningens nedläggning och överlåtelse av bönhus till BlåsmarksDUF var ett beslut taget främst på grund av att båda föreningarna bestod av samma medlemmar och arbetet med bönhuset redan till stor del utfördes av Blåsmarks DUF. Vidarevisade även studien att arbetet för Blåsmarks DUF föreföll sig detsamma efter övertagandetav bönhuset men att det utökades till att omfatta frågor gällande skötseln av bönhuset. Detframkom även i studien hur Blåsmarks DUF glädjes av att få ett eget bönhus och att beslutetfrån båda föreningar varit enhälligt och utan opposition. This thesis offers a study of the closure of the Blåsmarks bönhusförenings and the transfer ofthe prayer house to Blåsmarks DUF in 1947. The study is limited to the period 1945-1948 toexamine the associations before and after the events in question and is based on the protocolswritten during both associations’ meetings between 1945-1948. The essay examines theassociations’ work before Blåsmarks bönhusförenings closure in 1947, the reasons behind itsclosure and what consequences it had for Blåsmarks DUF. The event is examined from a process perspective and follows the analytical-rational model. The results of the study showedthat Blåsmarks bönhusförenings closure and the transfer of the prayer house was a decisionmade mainly because both associations consisted of the same members and the work with theprayer house was already largely carried out by Blåsmarks DUF. Furthermore, the study alsoshowed that the work for Blåsmarks DUF is pleased to have its own prayer house and that thedecision to transfer it to them was unanimous and without opposition.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______142::96bc3b2953410b84dec6e6200fe1fe0c&type=result"></script>');
-->
</script>
Green | |
bronze |
citations | 0 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______142::96bc3b2953410b84dec6e6200fe1fe0c&type=result"></script>');
-->
</script>
The intent of this examination is to study anatomical jewelry design, withreproductions of the clitoris and uterus, its feminist connection and symbolism.Three Swedish female designers represent the foundation for this study, wheretheir specific jewelry is analyzed. Choice of designers are Clit co,Feministsmeden and Statement by Lann, a presentation of them can be found inthe second part on page 15. The main question in this study is; How come thewoman's body and genitals have become jewelry and how are these symbolslinked to feminism? Are these anatomical images inclusive or exclusive from agender perspective? The method in this survey focuses on semiotics and imageanalysis with inspiration from discourse analysis and hermeneutics, with atheory rooted in gender, feminism and exposition of the female body. Byfocusing on signification and intention, the study reaches a hypotheticalconclusion about the connection between anatomical jewelry and feminism. Syftet med denna undersökning är att studera anatomisk smyckesdesign, med återgivningenav klitoris och livmodern, dess feministiska anknytning och symbolik. Tre svenska kvinnligadesigners står som material för studien, där deras specifika smycken analyseras. I del två avarbetet presenteras de utvalda kreatörerna Clit co, Feministsmeden och Statement by Lann.Huvudfrågan i denna studie är; Hur kommer det sig att kvinnans kropp och könsorgan harblivit smycken och hur är dessa symboler kopplade till feminism? Är dessa anatomiskaskildringar inkluderande eller exkluderande ur ett genusperspektiv? Metoden i studienfokuserar på semiotisk bildanalys med inspiration ur diskursanalys och hermeneutik, medteori förankrad i genus, feminism och kroppspolitik. Genom att fokusera på budskap ochintention når studien en hypotetisk slutsats kring sambandet mellan anatomiska smycken ochfeminism.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______681::52a246833df91efe5ed76690c5fbd923&type=result"></script>');
-->
</script>
Green | |
bronze |
citations | 0 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______681::52a246833df91efe5ed76690c5fbd923&type=result"></script>');
-->
</script>
This essay examines the disability movement in Värmland from 1956 to 1962, through a case study of the association RBU Värmland. Focusing on the starting point of the association, it explores whether their initial purpose and ambitions were fulfilled. RBU Värmland's main purpose was to promote the improved care and treatment of children with Cerebral Palsy, as well as to provide information and support to their parents. The association meant to work with these particular issues because of the disadvantages that these children and their families faced in the society of this time. For example, the healthcare in Sweden did not have the resources to provide satisfactory treatment for the children, and parents had to struggle to take care of them. During the association’s first ten years, it succeeded in improving both these aspects of the lives of children with Cerebral Palsy and their families. They carried out treatment periods where these children received much needed care, while their parents acquired knowledge and support through courses, amongst other things. In the essay, the interpretation of these actions draws on both Michel Foucault's perspective on power, as well as feminist theory. In light of Foucault’s ideas, the association is interpreted as a tool of power, where everyone involved were exercising power on various occasions. Sometimes the motif was to help the children in different ways, and sometimes the purpose was a different one, but either way power was exercised and redistributed. Denna uppsats undersöker handikapprörelsen i Värmland från 1952 till 1962, genom en fallstudie av föreningen RBU Värmland. I fokus ligger föreningens startpunkt, och om deras initiala syfte och ambitioner blev uppfyllda. RBU Värmland hade som sitt huvudsakliga syfte att verka för CP-skadade barns förbättrade vård och behandling, samt att stötta och ge upplysning till deras föräldrar. Föreningen menade att arbeta för just dessa frågor eftersom de var eftersatta i den tidens samhälle, då vården saknade resurser för att bereda en tillfredsställande vård för barnen, samtidigt som föräldrarna fick slita mycket hårt för sina barns omsorg. Föreningen lyckades under sina första tio år att förbättra båda dessa aspekter av de CP-skadade barnens samt deras anhörigas liv, då de bland annat genomförde behandlingsperioder där barnen fick välbehövlig vård, samtidigt som föräldrarna fick hjälp genom kurser, ekonomiskt stöd och dylikt. Dessa gärningar tolkas i uppsatsen både utifrån Michel Foucaults maktperspektiv, samt feministiska teoribildningar. I ljus av Foucaults idéer tolkas föreningen som ett maktredskap, där samtliga aktörer vid olika tillfällen utövade makt. Ibland var motivet att på olika sätt hjälpa de CP-skadade barnen, och ibland var motivet något annat, men oavsett utövades och omfördelades makt.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______681::9b2a63abb1ebef3f0e1c5ff693824a9a&type=result"></script>');
-->
</script>
Green | |
bronze |
citations | 0 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______681::9b2a63abb1ebef3f0e1c5ff693824a9a&type=result"></script>');
-->
</script>
This dissertation investigates the role played by Dutch experts in various enterprises and organisations managed or administered by the early modern Swedish state. The work demonstrates how and why Dutch experts were introduced to Sweden, in what manner they were employed by the Swedish state and how their knowledge was utilised in state-controlled organisations. The overall results challenge the impression of an uncomplicated introduction, steered by the state. Instead, the research suggests that the development was multifaceted, where the role and function of state structures, international politics, networks, as well as concepts, including opportunism and pragmatism all played a part in the process which led to the employment of Dutch experts and use of Dutch knowledge. Underlying analytical tools used to demonstrate this include concepts such as collective knowledge, institutional memory, change agents, as well as strategies to minimise uncertainties and knowledge asymmetries in the recruitment process. The investigation consists of four empirical chapters. The first chapter focuses on some of the key Dutch individuals who settled in Sweden during the second half of the sixteenth century. It shows why a Dutch settlement took place, but also how a specific interest in Dutch trade expertise was developed by the Swedish political leadership. The chapter concludes with an analysis of how Dutch expertise was utilised to develop advanced long-distance trade. The second chapter follows the use of Dutch experts in the naval shipbuilding organisation in the first half of the seventeenth century. It shows how an almost complete reliance on Dutch experts and technical knowledge was established during this period. The chapter details how the Dutch introduction and utilisation evolved, when the naval organisation changed from being single-handedly steered by the king, to a situation where it was administered by an independent Admiralty Board. The third chapter investigates the use of Dutch experts in the foreign administration as well as in the administration and management of trade and commercial undertakings. It details how agents and diplomatic networks facilitated exchange and brought knowledge and experts to Sweden. The chapter also challenges an established notion that many of the trade enterprises that were established in Sweden up until the mid-1630s were failures. The results instead demonstrate how successive proposals to develop commercial ventures by Dutch experts created a necessary knowledge base in Swedish society, which in the long run led to the successful formation of advanced commercial enterprises. The final chapter focuses on the establishment of commercial fishing operations. It follows the introduction and growth of a Dutch model for how to develop advanced fishing, and explains why the model only led to a functioning enterprise towards the very end of the period of investigation.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______681::0c130e9ec0b4e50936bcb1de0985ef8b&type=result"></script>');
-->
</script>
Green | |
bronze |
citations | 0 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______681::0c130e9ec0b4e50936bcb1de0985ef8b&type=result"></script>');
-->
</script>
doi: 10.1017/nps.2021.4
AbstractThousands of Roma were killed in Ukraine by the Nazis and auxiliary police on the spot. There are more than 50,000 Roma in today’s Ukraine, represented by second and third generation decendants of the genocide survivors. The discussion on Roma identity cannot be isolated from the memory of the genocide, which makes the struggle over the past a reflexive landmark that mobilizes the Roma movement. About twenty Roma genocide memorials have been erected in Ukraine during last decade, and in 2016 the national memorial of the Roma genocide was opened in Babi Yar. However, scholars do not have a clear picture of memory narratives and memory practices of the Roma genocide in Ukraine. A comprehensive analysis of the contemporary situation is not possible without an examination of the history and memory of the Roma genocide before 1991.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.1017/nps.2021.4&type=result"></script>');
-->
</script>
Green | |
hybrid |
citations | 1 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.1017/nps.2021.4&type=result"></script>');
-->
</script>
Recently rediscovered photographs of the remains of thirteen individuals buried in the Sado Valley Mesolithic shell middens of Poças de S. Bento and Arapouco, excavated in 1960 and 1962, show the potential of revisiting excavation archives with new methods. The analysis, which applies the principles of archaeothanatology and is enriched by experimental taphonomic research, confirmed details concerning the treatment of the dead body and provided new insights into the use of burial spaces. Some bodies may have been mummified prior to burial, a phenomenon possibly linked to their curation and transport, highlighting the significance of both the body and the burial place in Mesolithic south-western Portugal.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.1017/eaa.2022.3&type=result"></script>');
-->
</script>
Green | |
hybrid |
citations | 2 | |
popularity | Average | |
influence | Top 10% | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=10.1017/eaa.2022.3&type=result"></script>');
-->
</script>
By examining the donations by the local nobility to the local church, this thesis aims to study the church as a public room. By analyzing the donations of the nobility in relation to Habermas concept of the public sphere and the concept of conspicuous consumption the donations to the churches can be viewed as manifestations of power. This thesis studies all donations to the churches that leaves material and visual remnants in the church room. The results shows that there was a conscious strategy for the nobility to use the church for manifestation and representation of power. The nobility used their donations to manifest their power and to represent the power towards the people. This was done by filling the church with their names and coats of arms. By donating liturgical objects, church silver, chapels and coats of arms used for funerals the nobility was able to symbolically place themselves in the religious rituals. The church as a room was a symbolically and hierarchical place, and by connecting themselves with this room by donations the nobility could manifest their position in society, both locally and nationally.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______361::fdf2b57f4b9e76bb0e0e5351bfb2e36e&type=result"></script>');
-->
</script>
Green | |
bronze |
citations | 0 | |
popularity | Average | |
influence | Average | |
impulse | Average |
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______361::fdf2b57f4b9e76bb0e0e5351bfb2e36e&type=result"></script>');
-->
</script>
Uppgifter för behandling av naturliga språk (NLP) har under de senaste åren visat sig vara särskilt effektiva när man använder förtränade språkmodeller som BERT. Det enorma kravet på datorresurser som krävs för att träna sådana modeller gör det dock svårt att använda dem i verkligheten. För att lösa detta problem har komprimeringsmetoder utvecklats. I det här projektet studeras, genomförs och testas några av dessa metoder för komprimering av neurala nätverk för textbearbetning. I vårt fall var den mest effektiva metoden Knowledge Distillation, som består i att överföra kunskap från ett stort neuralt nätverk, som kallas läraren, till ett litet neuralt nätverk, som kallas eleven. Det finns flera varianter av detta tillvägagångssätt, som skiljer sig åt i komplexitet. Vi kommer att titta på två av dem i det här projektet. Den första gör det möjligt att överföra kunskap mellan ett neuralt nätverk och en mindre dubbelriktad LSTM, genom att endast använda resultatet från den större modellen. Och en andra, mer komplex metod som uppmuntrar elevmodellen att också lära sig av lärarmodellens mellanliggande lager för att utvinna kunskap. Det slutliga målet med detta projekt är att ge företagets datavetare färdiga komprimeringsmetoder för framtida projekt som kräver användning av djupa neurala nätverk för NLP. Natural language processing (NLP) tasks have proven to be particularly effective when using pre-trained language models such as BERT. However, the enormous demand on computational resources required to train such models makes their use in the real world difficult. To overcome this problem, compression methods have emerged in recent years. In this project, some of these neural network compression approaches for text processing are studied, implemented and tested. In our case, the most efficient method was Knowledge Distillation, which consists in transmitting knowledge from a large neural network, called teacher, to a small neural network, called student. There are several variants of this approach, which differ in their complexity. We will see two of them in this project, the first one which allows a knowledge transfer between any neural network and another smaller bidirectional LSTM, using only the output of the larger model. And a second, more complex approach that encourages the student model to also learn from the intermediate layers of the teacher model for incremental knowledge extraction. The ultimate goal of this project is to provide the company’s data scientists with ready-to-use compression methods for their future projects requiring the use of deep neural networks for NLP.
<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=od_______681::69a26608626358792e2c6512ad59ecb4&type=result"></script>');
-->
</script>
Green | |
bronze |
citations | 0 | |
popularity | Average | |
influence | Average | |
impulse | Average |