PPT SEMINAR PROPOSAL NI KOMANG CINDY PRAMASTA

Data Analysis

Research Method

Meeting 1

A

B

Research Instruments

1

Normality Test

This Research uses an Quantitative Approach and Experimental Research Design with Counter Balancing Method.

Meeting 2

B

A

Research method

2

Homogenity Test

Testing Argumentative Text

Reliability test

Test Validity

Data Collection ?

Research Setting?

Research Variable ?

A test is said to be reliable if the test can provide consistent results on the same subject. To test whether the instrument is reliable or not, the KR-20 formula is used:

To test the validity of this research instrument, the product moment correlation formula is used. The product moment correlation formula is:

3

Hypothesis test

Population and Sample?

3

2

3

1

4

Independent variable

generative AI

(Chat GPT and Perplexity)

The Test of Written English (TWE) is a test that measures a person's English writing skills.

Based on the book of H.Douglas Brown 2004:238) states that The TWE is in the category of a timed impromptu test in that test-takers are under a 30 minute time limit and are not able to prepare ahead of time for the topic that will appear.

Topics are prepared by a panel of experts following specifications for topics that represent commonly used discourse and thought patterns at the university level.

2

a. Test

b. Interview

c. Documentation

1

Information:

r 11 = test reliability coefficient

n = number of questions

1 = fixed number

St = total variance

p = the proportion who answered correctly on the item in question

q = the proportion who answered incorrectly on the item in question, or qi = 1- Pi

Place :

State University of Hindus I Gusti Bagus Sugriwa which located at Ratna St., No 51, Tonja, North Denpasar District, Denpasar City, Bali 80237

Time :

This research is held for 4 months. Starting from the research proposal to completing the research, starting from December 2023 to March 2024.

Third semester students of State University of Hindus I Gusti Bagus Sugriwa who are taking Academic Writing courses

Cluster Sampling

(Class PBI IIIC Denpasar 30 Students in total)

The quality of students' writing.

Dependent variable

Keterangan :

rxy = correlation coefficient between variables x and y

N = number of samples

∑xy = the average score of X and Y

X = total score of X items

Y = total score (items)

The rxy calculation results are compared with the critical r product moment table with a significance level of 5%. If rcount > rtable then the item is valid.

Using Analytic Scoring Rubric by McDonough et. al 2018

Hindu Negeri University of I Gusti Bagus Sugriwa

The Effect of Generative AI On Student's Writing Quality

Ni Komang Cindy Pramasta (2011171037) VIIC English Education Denpasar

Hypothesis

Hypothesis is a temporary assumption from a problem formulation whose validity will be tested. A hypothesis is also said to be a tentative statement regarding the relationship between two or more variables

(Sujarweni & Wiratma, 2014).

Theoretical Review

INTRODUCTION

Ha= there is a difference between student’s writing quality using Chat GPT or Perplexity

Writing Skill

The challenge of generative AI on students' writing abilities

According to (Dhapa, 2021) writing is a skill that requires good language skills. Meanwhile, according to (Jumari, 2021) writing is a means used to express thoughts, feelings and even things you dream about.

H0= there is no difference between student’s writing quality using Chat GPT and Perplexity

An innovative approach to language education is an important step to solve existing educational problems (Syamsi Julianto & Ratumanan, 2023).

Background Study :

The use of artificial intelligence (AI)-based writing tools in English as a foreign language (EFL) Classrooms are growing rapidly.

Artificial Intelligence (AI)

Literature Review

What is it?

According to (Andriyanti et al., 2023) artificial intelligence is a field of science and the latest results that reach its peak in computers, machines and others.

students' perceptions of the pros and cons of AWE (i.e. Grammarly) by Miranty and Widiati (2021)

Genres of Writing

Perplexity

One type of AI, known as Large Language Models (LLM) can produce text that resembles human writing.

Perplexity is an artificial intelligence system that can provide combined capabilities for processing language (Akhyar et al., 2023).

Genres of writing based on H. Douglas Brown (2004:2019) : a. Academic writing

Papers and general subject reports essays, compositions academically focused journals short-answer test responses technical reports (e.g., lab reports) theses, dissertations.

RESEARCH GAP

It remains unclear how AI writing tools affect quality of student's writing. Therefore, this study has been meticulously designed to fill existing knowledge gaps

Chat GPT

‘chatbot’ the most well-known being ChatGPT Eager, B., & Brunton, R. (2023)

Research Questions ?

Research goals

This study aims to explore the diversity of AI writing tools and evaluate their impact on students.

Do student’s writing with Chat GPT produce better Writing Quality then those using Perplexity?

ChatGPT was first launched on November 30, 2022 and has succeeded in gathering more than one million subscribers (Rahimi & Abadi, 2023).

Conseptual

Framework

Empirical Review

1. Marzuki, Utami Widiati, Diyenti Rusdin, Darwin & Inda Indrawati (2023). The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’perspective

Qualitative approach with case study method The initial findings of this research highlight the diversity of AI such as QuilBot, Jenni, ChatGPT, WordTune, Copy.ai, Paperpal and Essay Writer. The teachers who participated in this research agreed that generative tools provide a positive role in improving thinking and writing abilities. however, there are concerns that students may become too dependent on AI to do their work

2. Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education.

Participants thought that ChatGPT was effective for increasing the chances of success in the field of education on various topics. participants have also acknowledged that ChatGPT can help provide a comprehensive understanding of a variety of topics.