Search for collections on Pradita Repository

Accelerating the TOGAF Preliminary Phase: An Empirical Evaluation of LLM-Generated Artifacts in Banking

Syahalam, Izaaz Azaam and Yohannis, Ryano Alfa and Mantoro, Teddy Accelerating the TOGAF Preliminary Phase: An Empirical Evaluation of LLM-Generated Artifacts in Banking. IEEE.

[thumbnail of Izaaz.pdf] Text
Izaaz.pdf

Download (251kB)

Abstract

Enterprise
Architecture
Alfa Ryano Yohannis2
Department of Information Technology
Pradita University
Tangerang, Indonesia
alfa.ryano@pradita.ac.id
(EA)
facilitates
alignment between business strategy and IT governance, yet the
TOGAF Preliminary Phase remains resource-intensive and
time-consuming. This study empirically evaluates GPT-4’s
capability to generate TOGAF Preliminary Phase artifacts
within a real banking environment. Using a mixed-methods
approach, three certified EA experts assessed five artifacts
across clarity, completeness, relevance, accuracy, and usability
dimensions using a 25 item ISO/IEC 25010 based instrument.
Results indicate high perceived quality (mean = 4.26/5.0; α =
0.86) and efficiency gains of up to 97 % compared to manual
development. Despite a Gunning Fog Index (GFI) of 25.03,
experts rated clarity highly (4.33/5.0), revealing a Complexity
Appropriate Paradox linguistic complexity does not reduce
comprehension among expert audiences. Qualitative findings
emphasize efficiency and structure as key strengths and
contextual understanding as the main limitation. The results
highlight LLMs as accelerators rather than replacements in EA
processes, advancing a Human AI collaboration framework for
architecture governance.

Keywords-Enterprise Architecture, TOGAF, Large Language
Models (LLM), Preliminary Phase, Banking Industry.

Item Type: Article
Subjects: -|- SUBJEK PRADITA -|- > Fakultas Sains dan Teknologi > Magister Teknologi Informasi
Divisions: Fakultas Sains dan Teknologi > Magister Teknologi Informasi
Depositing User: Pradita Librarian
Date Deposited: 15 Oct 2026 03:02
Last Modified: 15 Oct 2026 03:02
URI: https://repository.pradita.ac.id/id/eprint/743

Actions (login required)

View Item
View Item