vix.ing · top · new · best · stats · spec

Analyze the Effects of Weighting Functions on Cost Function in the Glove Model

2020/09/10 by Trieu Hai Nguyen, Nguyen, Trieu Hai
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Handwritten Text Recognition Techniques

paper · pdf · doi:10.48550/arxiv.2009.04732

openalex publication_date 2020/09/10 · openalex created_date 2020/09/14 · openalex updated_date 2026/07/28

Abstract

When dealing with the large vocabulary size and corpus size, the run-time for training Glove model is long, it can even be up to several dozen hours for data, which is approximately 500MB in size. As a result, finding and selecting the optimal parameters for the weighting function create many difficulties for weak hardware. Of course, to get the best results, we need to test benchmarks many times. In order to solve this problem, we derive a weighting function, which can save time for choosing parameters and making benchmarks. It also allows one to obtain nearly similar accuracy at the same given time without concern for experimentation.

Citations

Related