• Journal of Internet Computing and Services
    ISSN 2287 - 1136 (Online) / ISSN 1598 - 0170 (Print)
    https://jics.or.kr/

An Empirical Study on Ethicality Evaluation of LLM Response


Jun Sang Jo, Shin Namgung, Won Sang Lee, Journal of Internet Computing and Services, Vol. 27, No. 1, pp. 213-220, Feb. 2026
10.7472/jksii.2026.27.1.213, Full Text:  HTML
Keywords: LLM, AI ethics, trolley dilemma, Logistic Regression

Abstract

LLM has had a significant influence on human decision-making, raising societal concerns about potential ethical risks. This paper analyzes the ethical response tendencies of major LLM services (Claude, Gemini, ChatGPT, Perplexity, and Grok). Five “trolley dilemma–type” questions were designed based on AI ethics principles, and each model was queried ten times for each question to observe if it favored an ethical choice or a goal-oriented (utilitarian) choice. Logistic regression shows that Grok demonstrates a significantly stronger tendency toward ethical choices compared to the baseline model (Gemini). ChatGPT and Perplexity do not differ significantly from Gemini, while Claude exhibits a moderately higher ethical tendency, although the difference is not statistically significant. Although question-level effects were generally modest, certain items displayed meaningful differences across models. This study proposes a practical framework for evaluating the ethical behavior of LLM, and findings could contribute to the establishment of guidelines on ethical aspects of LLM.


Statistics
Show / Hide Statistics

Statistics (Past 3 Years)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[APA Style]
Jo, J., Namgung, S., & Lee, W. (2026). An Empirical Study on Ethicality Evaluation of LLM Response. Journal of Internet Computing and Services, 27(1), 213-220. DOI: 10.7472/jksii.2026.27.1.213.

[IEEE Style]
J. S. Jo, S. Namgung, W. S. Lee, "An Empirical Study on Ethicality Evaluation of LLM Response," Journal of Internet Computing and Services, vol. 27, no. 1, pp. 213-220, 2026. DOI: 10.7472/jksii.2026.27.1.213.

[ACM Style]
Jun Sang Jo, Shin Namgung, and Won Sang Lee. 2026. An Empirical Study on Ethicality Evaluation of LLM Response. Journal of Internet Computing and Services, 27, 1, (2026), 213-220. DOI: 10.7472/jksii.2026.27.1.213.