• Journal of Internet Computing and Services
    ISSN 2287 - 1136 (Online) / ISSN 1598 - 0170 (Print)
    https://jics.or.kr/

Step-size Normalization of Information Theoretic Learning Methods based on Random Symbols


Namyong Kim, Journal of Internet Computing and Services, Vol. 21, No. 2, pp. 49-55, Apr. 2020
10.7472/jksii.2020.21.2.49, Full Text:
Keywords: Distribution distance, random symbol, step-size, information potential, Impulsive noise.

Abstract

Information theoretic learning (ITL) methods based on random symbols (RS) use a set of random symbols generated according to a target distribution and are designed nonparametrically to minimize the cost function of the Euclidian distance between the target distribution and the input distribution. One drawback of the learning method is that it can not utilize the input power statistics by employing a constant stepsize for updating the algorithm. In this paper, it is revealed that firstly, information potential input (IPI) plays a role of input in the cost function-derivative related with information potential output (IPO) and secondly, input itself does in the derivative related with information potential error (IPE). Based on these observations, it is proposed to normalize the step-size with the statistically varying power of the two different inputs, IPI and input itself. The proposed algorithm in an communication environment of impulsive noise and multipath fading shows that the performance of mean squared error (MSE) is lower by 4dB, and convergence speed is 2 times faster than the conventional methods without step-size normalization.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from November 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[APA Style]
Kim, N. (2020). Step-size Normalization of Information Theoretic Learning Methods based on Random Symbols. Journal of Internet Computing and Services, 21(2), 49-55. DOI: 10.7472/jksii.2020.21.2.49.

[IEEE Style]
N. Kim, "Step-size Normalization of Information Theoretic Learning Methods based on Random Symbols," Journal of Internet Computing and Services, vol. 21, no. 2, pp. 49-55, 2020. DOI: 10.7472/jksii.2020.21.2.49.

[ACM Style]
Namyong Kim. 2020. Step-size Normalization of Information Theoretic Learning Methods based on Random Symbols. Journal of Internet Computing and Services, 21, 2, (2020), 49-55. DOI: 10.7472/jksii.2020.21.2.49.