Analysis Large Language Model (LLM) for Digital Transformation in a Ministry
DOI:
https://doi.org/10.56127/ijst.v4i2.2194Keywords:
LLM, AI, Python, MinistryAbstract
Digital transformation in government requires the use of cutting-edge technology to improve efficiency and accuracy in decision-making. Ministries are strategic institutions that manage large-scale data and information, particularly related to regional government administration and population affairs. This article examines the application of Large Language Models (LLM) as an artificial intelligence (AI)-based solution to assist document processing, information extraction, and policy analysis. The study presents a relevant legal framework, LLM model recommendations, a schematic diagram of LLM implementation from end-to-end, and Python code examples for technical simulations. This approach is expected to strengthen the Ministry's digital system in accordance with the guidelines of the Electronic-Based Government System (SPBE) and One Data Indonesia.
References
BigScience Workshop. (2022). BLOOM: A 176B-parameter open-access multilingual language model. Hugging Face. https://huggingface.co/bigscience/bloom
Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., ... & Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901. https://doi.org/10.48550/arXiv.2005.14165
Cahyawijaya, S., Winata, G. I., Wilie, B., Vincentio, K. A., Li, Z., Fung, P., & Purwarianti, A. (2021). IndoBERT: A pretrained language model for Indonesian. In Findings of the Association for Computational Linguistics: EMNLP 2021 (pp. 1032–1038). https://aclanthology.org/2021.findings-emnlp.89/
Chollet, F. (2021). Deep learning with Python (2nd ed.). Manning Publications.
Hugging Face. (2024). Transformers documentation. https://huggingface.co/docs/transformers/index
Indonesia Digital Government. (2023). Guidelines for SPBE implementation in ministries/institutions and regional governments. https://spbe.go.id
Law No. 11 of 2008 concerning Electronic Information and Transactions (ITE). (2008). Republic of Indonesia.
Law No. 23 of 2014 concerning Regional Government. (2014). Republic of Indonesia.
Minister of Home Affairs Regulation No. 70 of 2019 concerning the Regional Government Information System (SIPD). (2019). Ministry of Home Affairs of the Republic of Indonesia.
OpenAI. (2023). GPT-4 technical report. https://openai.com/research/gpt-4
Presidential Regulation of the Republic of Indonesia Number 39 of 2019 concerning One Data Indonesia. (2019). https://satudata.go.id
Presidential Regulation of the Republic of Indonesia Number 95 of 2018 concerning the Electronic-Based Government System (SPBE). (2018). https://jdih.setneg.go.id
Raschka, S., & Mirjalili, V. (2022). Machine learning with PyTorch and Scikit-Learn: Develop machine learning and deep learning models with Python. Packt Publishing.
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M. A., Lacroix, T., ... & Scao, T. L. (2023). LLaMA: Open and efficient foundation language models. Meta AI Research. https://arxiv.org/abs/2302.13971
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Andre Pratama Adiwijaya
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
