Comparing Teaching Metacognitive Strategies on IELTS Candidates in Online and Face-to-Face Classes

Document Type : Original Article

Authors

1 MA in Applied Linguistics, Department of Linguistics and Foreign Languages, Faculty of Humanities, Payame Noor University, Tehran, Iran

2 Assistant Professor of Applied Linguistics, Department of Linguistics and Foreign Languages, Faculty of Humanities, Payame Noor University, Tehran, Iran

Abstract

The purpose of this study was to examine teaching metacognitive strategies in online and face-to face classes, in IELTS writing task 2. The participants were 25 students chosen from 50 students in English Techno Science Institute (ETI) studying IELTS in both online and face-to-face classes. As a treatment, writing metacognitive strategies in the same length of time, same methods and same materials were taught to all participants in online and face-to-face classes and then through a questionnaire their attitudes were collected and finally with a post-test, the results were analyzed. The findings showed that the IELTS candidates in the online and face-to-face classes had totally the same rate of success in applying the strategies and got higher scores than their pre-test. The findings of this study can be highly useful for all IELTS candidates, trainers, and EFL writing learners.

Keywords

1. Introduction

Nowadays, learning English is valued around the world and mastering English language in general and productive skills in particular is required by many EFL learners. In the meantime, writing, as a productive skill, is learned when the English foreign language (EFL) learners start learning to communicate through written form. However, it is assumed that writing is the most difficult skill to master for EFL learners and writing is more complicated than the other language skills (Erkan & Saban2011). Even a native speaker of the English language may experience difficulty during writing (Johnstone et al.2002). The writing skill requires a well-structured way of presenting thoughts in an organized and planned way (Javed et al.2013). Advanced writing skill such IELTS is also one of the basic requirements for better academic performance and academic success (Kellogg2008). Therefore, finding ways of assisting the EFL learners to improve their IELTS writing performance is of great importance. Teaching metacognitive strategies has been suggested as an alternative way to improve learners’ writing skill. 

 Flavell (1979), for the first time, introduced the term metacognition as a knowledge related to anyone’s cognitive procedures. According to Piaget (1847), metacognition is intentional, conscious, foresighted, and useful. Kentridge and Heywood (2000) mentioned that the use of metacognitive strategies should be encouraged in mastering language skills. A lot of studies have stated that once EFL learners’ awareness of writing strategies improves, their writing performance also improves (Panahandeh & Asl2014). Metacognitive awareness in writing skills helps students decide which strategies can be used and how they should be used (Pitenoee et al.2017). Metacognitive learning strategies make students get as independent, alerted, and motivated as possible in the whole process of learning, especially in writing (Al-Jarrah et al.2018). In writing skill, as it is prerequisite, weak students are mostly weak in thinking skills like writing as one of the hardest skills in language learning proficiency, which demands a great deal of thinking skills (Surat et al.2014). Hence, the presence of metacognitive strategies as declarative, conditional, and procedural knowledge in writing tasks can be dynamically helpful. 

2. Review of Literature

There are many studies that emphasize the application of metacognitive strategies in all learning skills. In a qualitative survey, Aripin and Rahmat (2019) used think-aloud protocol as the primary method in their data collecting and found out that both male and female students used different metacognitive writing strategies in their writing. Teng et al. (2020) illustrated the predictive influences of different metacognitive strategies on EFL learners’ academic writing performance. Using metacognitive strategies is considered as a constructive method which improves students’ ability to make a creative writing piece (Liu2015Tufekci & Sapar2011Zhan2016). Anthonysamy (2021) confirmed the relationship between the implementation of metacognitive strategies and applying them in online learning. Likewise, Azizi et al. (2017)Bouirane (2015)Fitrianti and Susanti (2021), Razı (2012), Mutar and Nimehchisalem (2017) stated the correlation between learners’ metacognitive strategies and the quality of their writing. In the cross-disciplinary construct, these strategies comprise the elements such as planning, monitoring, evaluating, and problem-solving (Zhanget al2021). Hosseini (2021) also demonstrated the effects of these strategies on Iranian EFL learners’ writing skill. Teaching metacognitive strategies can also improve EFL students’ communication skills, grammar knowledge, lexical, and enhance their awareness of the relationship between culture and language (Tufekci & Sapar2011).   

      Flavell (1979) mentioned metacognitive structures such as self-questioning, meditation, reflection, awareness of strengths and weaknesses, awareness of learning styles, mnemonic aids, thinking aloud, graphic organizers, regulation checklists, planning ahead, and final thoughts. Papleontiou-louca (2003) implemented various categorization of metacognitive writing strategies through planning, monitoring and evaluating taxonomies. Adams et al. (2015) summarizes six levels of Bloom’s (1956) taxonomy of cognitive learning objectives as knowledge, comprehension, application, analysis, synthesis and evaluation. According to Anthonysamy (2021), learners are unconscious of the way to look inward to check how they learn and to measure which methods are influential especially facing new types of learning online since they lack metacognitive skills which are too vital to their talent.

 The researches mentioned above highlighted the confirmed correlation between metacognitive strategies and writing performance which can be applied in EFL writing settings. Although such views can strongly highlight academic writing strategies and implementation, none debated and explored metacognitive writing strategies in IELTS writing task 2. As such in order to fill the gap, this study is going to answer the following research questions:

 (1) What are the IELTS candidates’ attitudes toward the use of metacognitive strategies in writing task two? 

(2) To what extent does the performance of face-to-face and online candidates differ in applying metacognitive strategies in IELTS writing task?

3. Methodology

3.1. Research Design

The whole population was the EFL students in English Techno-science Institute (ETI), studying IELTS exam. This was a quasi-experimental study to investigate applying metacognitive strategies on IELTS task 2 writing in both online and face-to-face learning classes. 

3.2. Population and Sample

50 students were chosen in age range between 20 to 34 years old with the background of upper intermediate to the advanced levels.

3.3. Instruments

The instruments applied in this study were a homogenizing test, a pre-test, a questionnaire, and a post-test.

 3.3.1. Homogenizing Test

The test chosen to homogenize the students was selected from ETC TOEIC– as a high scale examination through which the students were asked to write a single paragraph (Appendix A).     The time given to them, both in traditional and online contexts, was 30 minutes. Two other raters rated the scores.

3.3.2. Pre-test

The pre-test of writing was chosen from the IELTS Cambridge (Appendix B). The time given to them, both in traditional and online contexts, was 40 minutes. Two raters rated the papers according to IELTS wring descriptors.

3.3.3. Questionnaire

 A self-report questionnaire (Appendix D) was used to check the attitudes of students after using metacognitive strategies taught in IELTS writing task 2. The questionnaire enjoyed a reliability index of .973

 3.3.4. Post-test

The post-test was chosen from the IELTS Cambridge Test (Appendix C). Two raters according to IELTS writing band descriptors, rated the participants’ papers. The time for the test was again 40 minutes as in the IELTS exam. 

3.4. Procedure

In this study, the researcher attempted to directly and accurately teach the metacognitive strategies; namely, planning, monitoring, evaluating, and problem-solving to both online and face-to-face students.

A sample paragraph was given to 50 the online and face-to- face students, to be homogenized, and then 25 of them were selected as the advanced level owning the required ability in writing. Then an IELTS writing task 2 topic was given to the selected participants as the pre-test to write on WhatsApp for the online students and on paper for the traditional ones. The papers were given to two other colleagues as IELTS trainers. After the treatment sessions, a post-test was given to finalize the output of the implementation of the metacognitive strategies. Finally, a questionnaire was designed to analyze the participants’ attitudes toward the effects of applying metacognitive strategies on IELTS writing task 2.  

3.4.1. Online Context

In the online sessions, during the teaching-learning process, the lecturer employed WhatsApp to do teaching metacognitive strategies, and explaining and arguing writing materials, in IELTS task 2. The participants were taught how to plan for their writing, gather and organize their ideas about the topic, monitor their mistakes, evaluate their writing based on the IELTS writing rubrics and then revise their writing before turning it in.

3.4.2. Face-to-face Context

Similarly, the process of teaching metacognitive strategies was like the online context. The participants of the face-to-face class were taught how to plan, monitor, and evaluate their writing.

3.5. Data Collection Techniques

The first and the second research questions were to analyze the frequency counts and percentages and one-way analysis of covariance, respectively. Before discussing the results, the process of subject selection and reliability of the instruments will be reported.

To select the two groups of homogenous students to participate in the main study there was a topic of the IELTS writing task 2 for 50 students. The students were selected on the base of the mean of 68.62 plus and minus 22.86. The 25 selected students were divided into two groups of online (n = 12) and face-to-face (n = 13).

 

Table 1

Descriptive Statistics; Pretest of IELTS Writing Task 2 (Subject Selection)

N

Minimum

Maximum

Mean

Std. Deviation

Variance

50

22

96

68.62

22.863

522.730

3.6. Reliability of the Instruments 

There was the computing of Cronbach’s alpha reliability index for the attitude questionnaire. As displayed in Table 2, the questionnaire enjoyed a reliability index of .973. The reliability index of .973 is considered appropriate. A rule of thumb that applies to most situations is; .9 = excellent,.8 = good, .7 = acceptable, .6 = questionable, .5 = poor and .5 = unacceptable”. Based on these criteria, the attitude questionnaire enjoyed an excellent reliability index.

Table 2

Cronbach’s Alpha Reliability of Attitude Questionnaire

Cronbach's Alpha

N of Items

.973

23

 Two raters rated the pretest and posttest of IELTS writing task 2. Table 3 displays the results of the Pearson correlations computed to estimate the inter-rater reliability of the two raters who rated the participants’ performance on the pretest and posttest of IELTS writing task 2. Based on these results it can be concluded that there were significant agreements between the two raters on;

 Pretest of IELTS writing task 2 (r (23) = .682, representing a large effect size[1], p = .000), and 

 Posttest of IELTS writing task 2 (r (23) = .595, representing a large effect size, p = .000).

Table 3

Pearson Correlations; Inter-Rater Reliability of Pretest and Posttest of IELTS Writing Task 2  

 

Pre-Rater2

Post-Rater2

Pre-Rater1

Pearson Correlation

.682**

 

Sig. (2-tailed)

.000

 

N

25

 

Post-Rater1

Pearson Correlation

 

.595**

Sig. (2-tailed)

 

.000

N

 

25

**. Correlation is significant at the 0.01 level (2-tailed).

Table 4

Descriptive Statistics; Testing Normality of Pretest and Posttest of IELTS Writing Task 2 

 

Group

N

Skewness

Kurtosis

Statistic

Statistic

Std. Error

Ratio

Statistic

Std. Error

Ratio

Face-to-Face

Pretest

13

.102

.616

0.17

.051

1.191

0.04

Posttest

13

-1.068

.616

-1.73

.357

1.191

0.30

Online

Pretest

12

1.147

.637

1.80

1.291

1.232

1.05

Posttest

12

-.591

.637

-0.93

-1.858

1.232

-1.51

                       

4. Results

4.1. Answering the First Research Question

What are the IELTS candidates` attitudes towards learning metacognitive strategies in writing task two?

Table 5 displays the frequencies, percentages and standardized residuals (Std. Residuals) for the IELTS candidates’ attitude towards learning metacognitive strategies in IELTS writing performance. The results indicated that the online group (8.3 %, Std. Residual = -1.2), more than face-to-face group (4.7 %, Std. Residual = 1.2), strongly disagreed with the idea that they got through learning metacognitive strategies in IELTS writing performance. None of the Std. Residuals were higher than +/- 1.96. That is to say, none of the two groups showed significant disagreement. 

Table 5

Frequencies, Percentages and Standardized Residuals; Attitude towards Learning Metacognitive Strategies in IELTS Writing Performance

 

Choices

Total

Strongly disagree

Disagree

Slightly disagree

Partly agree

Agree

Strongly agree

 

Face-to-Face

Count

14

39

74

96

66

10

299

%

4.7%

13.0%

24.7%

32.1%

22.1%

3.3%

100.0%

Std. Residual

-1.2

3.1

-.7

-.5

2.5

-3.2

 

Online

Count

23

7

80

98

27

41

276

%

8.3%

2.5%

29.0%

35.5%

9.8%

14.9%

100.0%

Std. Residual

1.2

-3.2

.7

.5

-2.6

3.3

 

Total

Count

37

46

154

194

93

51

575

%

6.4%

8.0%

26.8%

33.7%

16.2%

8.9%

100.0%

       On the other hand; the face-to-face group (13 %, Std. Residual = 3.1), more than online group (2.5 %, Std. Residual = -3.2) significantly disagreed with the idea that they got through learning metacognitive strategies in IELTS writing performance. Although none of the Std. Residuals were higher than +/- 1.96, the online group (29 %, Std. Residual = .7), more than face-to-face group (24.7 %, Std. Residual = -.7), slightly disagreed with the idea that they got through learning metacognitive strategies in IELTS writing performance. The online group (35 %, Std. Residual = .5), more than face-to-face group (32.1 %, Std. Residual = -.5), partly agreed with the idea that they got through learning metacognitive strategies in IELTS writing performance. None of the Std. Residuals were higher than +/- 1.96.

       The face-to-face group (22.1 %, Std. Residual = 2.5) significantly more than the online group (9.8 %, Std. Residual = -2.6) believed that they got through learning metacognitive strategies in IELTS writing performance. And finally; the online group (14.9 %, Std. Residual = 33) significantly more than the face-to-face group (3.3 %, Std. Residual = -3.2) strongly agreed with the idea that they got through learning metacognitive strategies in IELTS writing performance. Figure 4.1 displays the percentages discussed above.

4.2. Answering the Second Research Question

To what extent does the performance of face-to-face and online candidates differ in applying metacognitive strategies in IELTS writing task?

There was a one-way analysis of covariance (ANCOVA) to compare the face-to-face and online groups’ means on posttest of IELTS writing task 2 performance after controlling for the effect of pretest to probe the second research question.

The significant results of Levene’s test (Table 6) indicated that the homogeneity of variances was not retained on the posttest of writing test (F (1, 23) = 4.61, p < .05). 

Table 6

Levene's Test of Equality of Error Variances; Posttest of IELTS Writing Task 2

F

df1

df2

Sig.

4.611

1

23

.043

Table 7 displays the results of the linearity test. The significant results of the linearity test; i.e. (F (1, 15) = 27.80, p < .05, η2 = .809 representing a large effect size[2]) indicated that there was a linear relationship between the pretest and posttest of IELTS writing task 2.

Table 7

Testing Linearity of Relationship between Pretest and Posttest of IELTS Writing Task 2

 

Sum of Squares

df

Mean Square

F

Sig.

Posttest * Pretest

Between Groups

(Combined)

49.646

9

5.516

7.063

.001

Linearity

21.715

1

21.715

27.806

.000

Deviation from Linearity

27.930

8

3.491

4.471

.006

Within Groups

11.714

15

.781

 

 

Total

61.360

24

 

 

 

Eta Squared

 

.809

 

 

 

 

       The non-significant interaction (Table 8) between covariate (pretest) and independent variable (types of treatment), i.e. (F (1, 21) = .410, p > .05, Partial η2 = .019 representing a weak effect size) indicated that there were linear relationships between the pretest and posttest of IELTS writing task 2 across the two groups.

Table 8

Testing Homogeneity of Regression Slopes; Posttest of IELTS Writing Task 2

Source

Type III Sum of Squares

df

Mean Square

F

Sig.

Partial Eta Squared

Group

.794

1

.794

.435

.517

.020

Pretest

15.948

1

15.948

8.736

.008

.294

Group * Pretest

.748

1

.748

.410

.529

.019

Error

38.337

21

1.826

 

 

 

Total

234511.000

25

 

 

 

 

       Table 9 displays the descriptive statistics for the face-to-face and online groups on the posttest of IELTS writing task 2 after controlling for the effect of pretest. The results showed that the online group (M = 97.00, SE = .392) had a slightly higher mean than the face-to-face group (M = 96.69, SE = .376) after controlling for the effect of the pretest.

 Table 9

Descriptive Statistics; Posttest of IELTS Writing Task 2 by Groups with Pretest

Group

Mean

Std. Error

95% Confidence Interval

Lower Bound

Upper Bound

Face-to-Face

96.691a

.376

95.910

97.472

Online

97.002a

.392

96.188

97.815

a. Covariates appearing in the model are evaluated at the following values: Pretest = 87.12.

   Table 10 displays the main results of one-way ANCOVA. The results (F (1, 22) = .315, p < .01, partial η2 = .014 representing a weak effect size) indicated that there was not any significant difference between online and face-to-face groups’ means on posttest of IELTS writing task 2 after controlling for the effect of the pretest. 

Table 10

Tests of Between-Subjects Effects; Posttest of IELTS Writing Task 2 by Groups with Pretest

Source

Type III Sum of Squares

df

Mean Square

F

Sig.

Partial Eta Squared

Pretest

18.395

1

18.395

10.354

.004

.320

Group

.559

1

.559

.315

.581

.014

Error

39.086

22

1.777

 

 

 

Total

234511.000

25

 

 

 

 

5. Discussion

This study tried to compare teaching metacognitive strategies in two environments, face-to-face and online classes. After teaching essential metacognitive strategies such as planning, monitoring, evaluating, and problem-solving, a questionnaire was also presented to the participants. Regarding the first research question, the results showed a dramatic change in the attitudes of the both groups of students using metacognitive strategies. The online group more than the face-to-face group strongly agreed with the idea that they got through learning metacognitive strategies in IELTS writing performance.

       Regarding the second research question, the results indicated that there was not any significant difference between the online and face-to-face groups’ means on the posttest of IELTS writing task 2. Both groups used the writing strategies in a very similar way in their writing tasks which is in line with the results of Mutar and Nimehchisalem (2017) who confirmed that high and low- proficiency level learners use the same kind of writing strategies. The research showed that both groups improved their writing after learning metacognitive strategies witch is in line with Azizi et al. (2017), Adams et al. (2015), Bouirane (2015), and Razı (2012) who mentioned that metacognitive strategies help EFL learners in their writing tasks and there is a positive correlation between learners’ use of metacognitive writing strategies and their grades. These findings are confirmed by the results of Razı (2012), Bai et al. (2014), and Zhanget al (2021), whose participants used metacognitive strategies such as planning, monitoring, evaluating, and problem-solving at a high frequency in their tasks. The findings were in line with Anthonysamy (2021), Zhan (2016) and Liu (2015) who confirmed that the use of writing strategies help learners to be more successful than those who do not.

6. Conclusion and Suggestions for Further Research

This study examined the influence of applying metacognitive strategies on two different groups of IELTS students, in IELTS writing task 2. The findings indicated that both online and face-to-face classes had fully positive attitudes towards the implication of metacognitive writing strategies in writing skill, here IELTS writing task 2. Although the environment was completely different, but in the presence of the same deep teaching metacognitive strategies, similar successful results was achieved in writing performance. 

       Further studies can be done to evaluate other metacognitive strategies or other related points in writing skill. Besides, the same strategies can be applied in online classes, the same as face-to-face ones, without any worry, as the Corona Virus proved online learning has to be there forever and it must be in the center of attention and improvement.  Also, since the attitudes of the students are of paramount importance for evaluating the score of writing, the ways of rising this score in high scale exams like IELTS can be taught, in the presence of strategies like metacognitive ones. Future studies in this domain are recommended to IELTS candidates, not only in writing but also in reading, listening and speaking.


 

 

Adams, C. M., Larkin, S. L., Hoagland, P., & Sancewich, B. (2018). Assessing the economic        consequences of harmful algal blooms: a summary of existing literature, research     method, data, and information gaps. Harmful Algal Blooms: A Compendium Desk     Reference, 337-354.
Al-Jarrah, T. M., Mansor, N., Rashid, R. A., Bashir, I., & Al-Jarrah, J. M. (2018). EFL           Students' Attitude toward Using Metacognitive Strategies in Writing. English  Language Teaching, 11(10), 162-171.
Anthonysamy, L. (2021). The use of metacognitive strategies for undisrupted online learning:           Preparing university students in the age of pandemic. Education and Information     Technologies, 1-19.
Aripin, N., & Rahmat, N. H. (2019). Exploring Metacognitive Writing Strategies in the           Writing Process using Think Aloud Protocol: A Study across Gender. American  Journal of Social Sciences and Humanities, 4(1), 178-187.
Azizi, M., Nemati, A., & Estahbanati, N. (2017). Meta-cognitive awareness of writing strategy use among Iranian EFL learners and its impact on their writing performance. International Journal of English Language & Translation Studies, 5(1), 42-51.
Bai, R., Hu, G., & Gu, P. Y. (2014). The relationship between use of writing strategies and    English proficiency in Singapore primary schools. The Asia-Pacific Education  Researcher, 23(3), 355-365. 
Bloom, B. S. (1956). Taxonomy of Educational Objectives, David McKay, New York,NY.
Bouirane, A. (2015). Metacognitive language learning strategies use, gender, and learning achievement: A correlation study. International Journal of English Language and Translation Studies, 3(2), 119-132.
Fitrianti, N. A., & Susanti, A. (2021). EFL students’ metacognitive strategies in online-based  learning: in relation to other writing quality. Paramasastra: Jurnal Ilmiah Bahasa        Sastra dan Pembelajarannya, 8(1),      1-19.
Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive-         developmental inquiry. American Psychologist, 34(10), 906-911.
Erkan, D. Y., & Saban, A. I. (2011). Writing performance relative to writing apprehension, self-efficacy in writing, and attitudes towards writing: A correlational study in Turkish tertiary-level EFL. Asian EFL Journal, 12(1), 164-192.
Hosseini, M. S. (2021). Analyzing the Effect of Using Meta-cognitive Strategies on Iranian    EFL Learners’ Writing Skill. Journal of Language and Translation, 11(5), 199-219.
Javed, M., Juan, W. X., & Nazli, S. (2013). A Study of Students' Assessment in Writing Skills of the English Language. Online Submission, 6(2), 129-   144.
Johnstone, K. M., Ashbaugh, H., & Warfield, T. D. (2002). Effects of repeated Practice and contextual-writing experiences on college students' writing      Skills. Journal of Educational Psychology, 94 (2), 305-326. 
Kellogg, R. T. (2008). Training writing skills: A cognitive developmental        Perspective. Journal of writing research, 1 (1), 1-26.
Kentridge, R. W., & Heywood, C. A. (2000). Metacognition and awareness. Consciousness    and cognition, 9(2), 308-312.
Liu, G. (2015). Investigating the English writing strategies used by Chinese senior high school            students. Theory and Practice in Language Studies, 5(4), 844-850.
Mutar, Q. M., & Nimehchisalem, V. (2017). The effect of gender and proficiency level on writing strategy use among Iraqi high school students. Arab World English Journal, 8 (2), 171-182.
Panahandeh, E., & Asl, S. E. (2014). The effect of planning and monitoring as metacognitive             strategies on Iranian EFL learners’ argumentative writing accuracy. Procedia-Social      and Behavioral Sciences, 98, 1409-1416.
Papleontiou-Louca, E. (2003). The concept and instruction of metacognition. Teacher           development, 7(1), 9-30.
Piaget, M. (1847).Electro planning. In Minutes of the Proceedings of the Institution of Civil    Engineers (Vol. 6, No. 1847, p. 355). Thomas Telford-ICE Virtual Library.
Pitenoee, M. R., Modaberi, A., & Ardestani, E. M. (2017). The effect of cognitive and           metacognitive writing strategies on content of the Iranian intermediate EFL learners’       writing. Journal of Language Teaching and Research, 8(3), 594-600.
Razı, Ö. (2012). An Investigation into the metacognitive writing strategies of Turkish Cypriot             University students. Retrieved from     http://web.aou.edu.lb/files/lebanon/An%20Investigation%20into%20the%20        Metacognitive.pdf
Surat, S., Rahman, S., Mahamod, Z., & Kummin, S. (2014). The Use of Metacognitive           Knowledge in Essay Writing among High School Students. International Education      Studies, 7(13), 212-218.
Teng, F. (2020). Tertiary-level students’ English writing performance and metacognitive        awareness: A group metacognitive support perspective. Scandinavian Journal of         Educational Research, 64(4), 551-568.
Tufekci, D., & Sapar, V. (2011). Social constructivist approach: Transformation of “Little     Red Riding Hood” for writing course. E-Journal of New World Sciences         Academy, 6(2), 1-23.
Zhan, R. (2016). An investigation into the metacognitive strategy use in ESL writing: A case study. DEStech Transactions on Social Science, Education and Human Science. https://doi. org/10.12783/dtssehs/hsc2016/3485.
Zhang, W., Zhang, D., & Zhang, L. J. (2021). Metacognitive Instruction for Sustainable         Learning: Learners’ Perceptions of Task Difficulty and Use of Metacognitive   Strategies in Completing Integrated Speaking Tasks. Sustainability, 13(11), 1-21.