Needs Analysis of Development of Critical Thinking Skills Assessment Instruments on Vocational School English Subjects

Ryzka Cahyaningrum, Wahyu Lestari, Supriyadi Supriyadi


This study aimed to analyze the needs for developing critical thinking skills technology-based assessment instruments in English subjects for vocational school and find out the factors that can support and inhibit developing and implementing critical thinking skills technology-based assessment instruments. This study used the qualitative research method with a case study design. The subject of study was 5 teachers and 15 eleventh-grade vocational school students at Tangerang. Observations, interviews, and documentation were conducted to collect the data. After collecting the data, the researcher used triangulation to confirm the data. The data collected were analyzed to answer the research questions using several stages, namely condensation, display, and verification. The results showed that the development of technology-based assessment instruments of critical thinking skills on vocational school English subjects needs to be developed. The schools have facilitation for conducting a technology-based assessment. Students have never taken on critical thinking skills assessment. Teachers and schools did not have the development of assessment instruments of critical thinking skills so teachers have never conducted critical thinking skills assessments on English subjects. Moreover, the students still have some obstacles in English learning such as vocabulary, pronunciation, and grammar. Therefore, the teachers should help to improve students’ vocabulary, pronunciation, and grammar before conducting a critical thinking skills assessment.


critical thinking skills, development of assessment instruments, English learning, needs analysis

Full Text:



Abida, F. I. N. (2016). Critical Thinking Skills To Literary Works: a Method of Teaching Language Through Literature. Journal of English Educators Society, 1(4), 11–18.

Affandi, M. H. (2021). Introvert Senior High School Students’ Critical Thinking in Writing Analytical Exposition Text. SALEE: Study of Applied Linguistics and English Education, 2(1), 77–86.

Ajisoko, P. (2020). The Use of Duolingo Apps to Improve English Vocabulary Learning. International Journal of Emerging Technologies in Learning, 15(7), 149–155.

Akmalun, N. Z. Z., & Suciati. (2018). Improving Student’s Pronunciation by Using U Dictionary Application In TBI- C’18 IAIN Kudus M. Akmalun Ni’a m Zam Zami 1 , Suciati 2. Britania, 7(2), 73–84.

Al Arif, T. Z. Z. (2019). the Use of Social Media for English Language Learning: an Exploratory Study of Efl University Students. Metathesis: Journal of English Language, Literature, and Teaching, 3(2), 224–233.

Albashtawi, A. H., & Al Bataineh, K. B. (2020). The Effectiveness of Google Classroom Among EFL Students in Jordan: An Innovative Teaching and Learning Online Platform. International Journal of Emerging Technologies in Learning, 15(11), 78–88.

Alqahtani, M. (2015). The Importance of Vocabulary in Language Learning and How to be Taught. International Journal of Teaching and Education, III(3), 21–34.

Anderson, L. W., Krathwol, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M. C. (2001). a Taxonomy for Learning, Teaching, and Assessing: a revision of Bloom’s taxonomy of educational objectives. In Journal of the American Statistical Association. Longman.

Arikunto, S. (2018). Dasar-dasar Evaluasi Pendidikan. Bumi Aksara.

Badan Pusat Statistik (BPS). (2021). Keadaan Ketenagakerjaan Indonesia Februari 2021. In Bps.Go.Id.

Badruddin, D., & Zainuddin, M. (2016). the Correlation Between Student’S Habit in Watching English Movie and Vocabulary Mastery At the Second Year of SMAN 1 Anggeraja. ETERNAL (English, Teaching, Learning and Research Journal), 2(1), 110–121.

Baird, J. A., Andrich, D., Hopfenbeck, T. N., & Stobart, G. (2017). Assessment and Learning: Fields Apart? Assessment in Education: Principles, Policy and Practice, 24(3), 317–350.

Banditvilai, C., & Cullen, R. (2018). Problems and Obstacles in Learning English as a Foreign Language. International Journal of Social Science and Humanity, 8(12), 289–294.

Baron, R. (2020). Students’ Perception on Online Application in Speaking Skill. VELES Voices of English Language Education Society, 4(2), 213–221.

Bashith, A., & Amin, S. (2017). The Effect of Problem Based Learning on EFL Students’ Critical Thinking Skill and Learning Outcome. Al-Ta Lim Journal, 24(2), 93–102.

Bassham, G., Irwin, W., Nardone, H., & Wallace, J. M. (2011). Critical Thinking: A Student’s Introduction. Fourth Edition. McGraw-Hill.

Berry, R., & Adamsaon, B. (2011). Assessment Reform in Education: Policy and Practice. In Assessment in Education: Principles, Policy & Practice (Vol. 20, Issue 3). Springer.

Black, P., & Wiliam, D. (2018). Classroom Assessment and Pedagogy. Assessment in Education: Principles, Policy and Practice, 25(6), 1–25.

Bohlin, L., Durwin, C. C., & Reese-Weber, M. (2012). EdPsych Modules: second edition. McGraw-Hill.

Brooks, G., Clenton, J., & Fraser, S. (2021). Exploring the Importance of Vocabulary for English as an Additional Language Learners’ Reading Comprehension. Studies in Second Language Learning and Teaching, 11(3), 351–376.

Brydon, S. R., & Scott, M. D. (2011). Between One and Many: The Art and Science of Public Speaking. McGraw-Hill.

Changwong, K., Sukkamart, A., & Sisan, B. (2018). Critical Thinking Skill Development: Analysis of a New Learning Management Model for Thai High Schools. Journal of International Studies, 11(2), 37–48.

Chason, L., Loyet, D., Sorenson, L., & Stoops, A. (2017). An Approach for Embedding Critical Thinking in Second Language Paragraph Writing. TESOL Journal, 8(3), 582–612.

Dewi, R., & Zuniati, M. (2021). Speaking Students’ Worksheet Based on E-Book. Journal of English Development, 21(1), 35–44.

Elder, L., & Paul, R. (2013). 30 Days to Better Thinking and Better Living Through Critical Thinking: A Guide for Improving Every Aspect of Your Life. Pearson Education.

Elekaei, A., Faramarzi, S., & Tabrizi, H. H. (2016). Autonomy, critical thinking and listening comprehension ability of iranian EFL learners. International Journal of Applied Linguistics and English Literature, 5(2), 40–48.

Fahim, M., & Sa’eepour, M. (2011). The Impact of Teaching Critical Thinking Skills on Reading Comprehension of Iranian EFL Learners. Journal of Language Teaching and Research, 2(4), 867–874.

Feng, Z. (2013). Functional Grammar and its Implications for English Teaching and Learning. English Language Teaching, 6(10), 86–94.

Fleer, M. (2015). Developing an Assessment Pedagogy: the Tensions and Struggles in Re-Theorising Assessment from a Cultural–Historical Perspective. Assessment in Education: Principles, Policy and Practice, 22(2), 224–246.

Fuad, J., Ardana, I. W., Sulton, & Kuswandi, D. (2016). Increasing Critical Thinking Skill Through Class Debate. Proceedings of the 1st UPI International Conference on Sociology Education (UPI ICSE 2015), 38–42.

Gandimathi, A., & Zarei, N. (2018). The Impact of Critical Thinking on Learning English Language. Asian Journal of Social Science Research, 1(2).

Ghaemi, F., & Mirsaeed, S. J. G. (2017). The Impact of Inquiry-based Learning approach on Critical Thinking Skill of EFL Students. Efl Journal, 2(2), 89–102.

Golkova, D., & Hubackova, S. (2014). Productive Skills in Second Language Learning. Procedia - Social and Behavioral Sciences, 143, 477–481.

Haerazi, Utama, I. M. P., & Hidayatullah, H. (2020). Mobile Applications to Improve English Writing Skills Viewed from Critical Thinking Ability for Pre-Service Teachers. International Journal of Interactive Mobile Technologies, 14(7), 58–72.

Halpern, D. F. (2014). Thought and Knowledge: an Introduction to Critical Thinking. Psychology Press.

Handayani, F., Hartono, & Lestari, W. (2019). Need Analysis in The Development of HOTS-Oriented Study Project Assesment Instrument in Android-Based Science Learning. Journal of Educational Research and Evaluation, 8(1), 57–64.

Haryati, S., & Hidayati, D. N. (2017). Hoax News: Promoting the Students’ Critical Thinking in Critical Reading Class. Register Journal, 10(2), 122–139.

Hidayat, N. (2016). Improving Students’ Vocabulary Achievement through Word Game. JEES (Journal of English Educators Society), 1(2), 95–104.

Hidayatullah, M. S. (2018). Improving Students’ Pronunciation Through Western Movie Media. Al-Lisan, 3(1), 93–111.

Holmes, K. A., & Prieto-Rodriguez, E. (2018). Student and Staff Perceptions of a Learning Management System for Blended Learning in Teacher Education. Australian Journal of Teacher Education, 43(3), 21–34.

Hunter, D. A. (2014). A Practical Guide to Critical Thinking: Deciding What to Do and Believe. Wiley.

Husna, N. (2019). Developing Students’ Critical Thinking Through an Integrated Extensive Reading Program. Teflin Journal, 30(2), 212–230.

Hysaj, A., & Hamam, D. (2021). Understanding the Development of Critical Thinking through Classroom Debates and Online Discussion Forums: A Case of Higher Education in the UAE. Journal of Asia TEFL, 18(1), 373–379.

Imai, M., Kanero, J., & Masuda, T. (2016). The Relation between Language, Culture, and Thought. Current Opinion in Psychology, 8, 70–77.

Jiang, Y.-L. B., García, G. E., & Willis, A. I. (2014). Code-Mixing as a Bilingual Instructional Strategy. Bilingual Research Journal, 37(3), 311–326.

Jones, J. M. (2014). Discussion Group Effectiveness is Related to Critical Thinking Through Interest and Engagement. Psychology Learning and Teaching, 13(1), 12–24.

K. Fountzoulas, G., I. Koutsouba, M., & Nikolaki, E. (2019). Critical Thinking and Its Assessment: A Literature Review with Special Reference in Greece and Cyprus. Journal of Education & Social Policy, 6(2), 69–80.

Kallet, M. (2014). Think Smarter: Critical Thinking to Improve Problem-Solving and Decision-Making Skills. Wiley.

Khonamri, F., Amirdehi, M., Pavlikova, M., & Tkacova, H. (2021). EFL Teachers’ Perceptions of Implementing Critical Thinking in Teaching Reading: Focus on the Possible Hindrances. Education & Self Development, 16(4), 48–63.

Kim, S., Raza, M., & Seidman, E. (2019). Improving 21st-Century Teaching Skills: The Key to Effective 21st-Century Learners. Research in Comparative and International Education, 14(1), 99–117.

Kiptiyah, B. M. (2019). Critical and Creative Thinking in the Writing of the Exposition Text. ISLLAC : Journal of Intensive Studies on Language, Literature, Art, and Culture, 3(1), 19–25.

Kusuma, M. D., Rosidin, U., Abdurrahman, A., & Suyatna, A. (2017). The Development of Higher Order Thinking Skill (HOTS) Instrument Assessment In Physics Study. IOSR Journal of Research & Method in Education (IOSRJRME), 07(01), 26–32.

Lau, J. Y. F. (2011). An Introduction to Critical Thinking and Creativity: Think More, Think Better. Wiley.

Lestari, R. C. (2018). The Use of English Subtitle in Movie to Improve Students ’ Vocabulary: An Exprimental Study in Grade IX of SMPN 1 Gunungsari Academic Year 2015/2016. Academic Journal of Educational Sciences, 1(1), 31–36.

Lestari, W., Muljanto, S., & Lestari, L. (2020). Grammatical Error Analysis in EFL Speaking Performance. English Education and Applied Linguistics (EEAL) Journal, 3(2), 43–47.

Li, Q., Li, Y., & Shen, Y. (2020). Impacts of debate instruction on students’ critical thinking skills in College EFL Classes: An empirical investigation. Journal of Physics: Conference Series, 1629(1).

Liu, J., & Zhang, J. (2018). The Effects of Extensive Reading on English Vocabulary Learning: A Meta-analysis. English Language Teaching, 11(6), 1–15.

Machete, P., & Turpin, M. (2020). The Use of Critical Thinking to Identify Fake News: A Systematic Literature Review. In M. Hattingh, M. Matthee, H. Smuts, I. Pappas, Y. K. Dwivedi, & M. Mäntymäki (Eds.), Responsible Design, Implementation and Use of Information and Communication Technology (Vol. 13E, Issue 12067, pp. 235–246). IFIP International Federation for Information Processing.

Manihuruk, D. H. (2020). The Correlation Between EFL Students’ Vocabulary Knowledge and Reading Comprehension: A Case Study at the English Education Department of Universitas Kristen Indonesia. Journal of English Teaching, 6(1), 86–95.

Mbato, C. L. (2019). Indonesian EFL Learners’ Critical Thinking in Reading: Bridging the Gap between Declarative, Procedural and Conditional Knowledge. Jurnal Humaniora, 31(1), 92–101.

Menggo, S., Suastra, I. M., Budiarsa, M., & Padmadewi, N. N. (2019). Needs Analysis of Academic-English Speaking Material in Promoting 21st Century Skills. International Journal of Instruction, 12(2), 739–754.

Miles, M. B., Huberman, A. M., & Saldaña, J. (2014). Qualitative Data Analysis: A Methods Sourcebook. SAGE Publications.

Mohammad, R. (2018). The Use of Technogy in English Language Learning: A Literature Review. International Journal of Research in English Education (IJREE), 3(2), 115–125.

Natsir, M., & Sanjaya, D. (2014). Grammar Translation Method (GTM) Versus Communicative Language Teaching (CLT); A Review of Literature. International Journal of Education and Literacy Studies, 2(1), 58–62.

Nejmaoui, N. (2018). Improving EFL Learners’ Critical Thinking Skills in Argumentative Writing. English Language Teaching, 12(1), 98–109.

Nikou, F. R., Bonyadi, A., & Amirikar, N. (2015). Investigating the Relationship between Critical Thinking Skills and the Quality of Iranian Intermediate TEFL Students ’ Writing. Advances in Language and Literary Studies, 6(2), 57–64.

Nold, H. (2017). Using Critical Thinking Teaching Methods to Increase Student Success: An Action Research Project. International Journal of Teaching and Learning in Higher Education, 29(1), 17–32.

OECD. (2019). Programme for international student assessment (PISA) results from PISA 2018. Oecd, 1–10.

Paolini, A. (2015). Enhancing Teaching Effectiveness and Student Learning Outcomes. The Journal of Effective Teaching, 15(1), 20–33.

Pavita, M. D. A., & Nirmala, D. N. (2021). Merdeka Belajar in Pandemic: Using Quizizz Game Based Learning To Improve Students’ Vocabulary Mastery. Language Literacy: Journal of Linguistics, Literature, and Language Teaching, 5(1), 221–227.

Permendikbud. (2018). Permendikbud No. 34/2018 tentang Standar Nasional Pendidikan SMK/MAK.

Pham, A. T., Hong, H. T., Chau, T. T., Le, N. V. A., Tran, P. T. T., & Nguyen, M. N. N. (2021). the Relationships Between Students’ Self-Confidence and Their English-Speaking Performance: a Case Study of English-Majored Students At a Private University in Vietnam. European Journal of Education Studies, 8(9), 18–35.

Pratama, Y. A., Sopandi, W., & Hidayah, Y. (2019). RADEC Learning Model (Read-Answer-Discuss-Explain And Create): the Importance of Building Critical Thinking Skills in Indonesian Context. International Journal for Educational and Vocational Studies, 1(2), 109–115.

Purba, C. N. (2018). The Pronunciation Problems of the English Department Students in the University of HKBP Nommensen. Journal of English Teaching as a Foreign Language, 4(1), 57–67.

Purba, D., Mustaji, Janah, M., & Arianto, F. (2020). The Impact of Problem Based Learning Model on Critical Thinking Ability in Vocational Education. International Journal of Education and Research, 8(12), 33–40.

Pusmenjar. (2020). AKM dan Implikasinya pada Pembelajaran. In Pusat Asesmen Dan Pembelajaran.

Ramezani, R., Larsari, E. E., & Kiasi, M. A. (2016). The Relationship between Critical Thinking and EFL Learners’ Speaking Ability. English Language Teaching, 9(6), 189.

Rashtchi, M., & Khoshnevisan, B. (2020). Lessons From Critical Thinking: How To Promote Thinking Skills in EFL Writing Classes. European Journal of Foreign Language Teaching, 5(1), 34–47.

Rathakrishnan, M., Ahmad, R., & Suan, C. L. (2017). Online Discussion: Enhancing Students’ Critical Thinking Skills. AIP Conference Proceedings, 1891.

Reynders, G., Lantz, J., Ruder, S. M., Stanford, C. L., & Cole, R. S. (2020). Rubrics to Assess Critical Thinking and Information Processing in Undergraduate STEM Courses. International Journal of STEM Education, 7(1).

Rochmahwati, P. (2015). Fostering Students’ Critical Thinking By Project-Based Learning. Journal on English as a Foreign Language, 5(1), 37–44.

Rohayati, D. (2017). Students’ Critical Thinking in Writing an English Exposition Text. Advances in Social Science, Education and Humanities Research (ASSEHR), 82.

Rohmawati, D., & Suwartono, T. (2019). Lyrics Videos to Ease the Pronunciation Problem of Indonesian EFL Learner. ELLITE: Journal of English Language, Literature, and Teaching, 4(1), 1.

Rossa, R. (2017). The Effect of Teaching Critical Thinking Skill Through Problem Solving Technique Toward Students’ Writing Skill in STKIP Adzkia Padang. Jurnal Handayani, 7(2), 24–32.

Royani, S., & Sadiah, S. (2019). an Analysis of Grammatical Errors in Students’ Writing Descriptive Text. PROJECT (Professional Journal of English Education), 2(6), 764–770.

Ruggiero, V. R. (2012). Beyond Feelings: A Guide to Critical Thinking. McGraw-Hill.

Rumapea, E. P., & Wennyta. (2020). The Correlation Between Self-Confidence and Speaking Ability of Second Semester Students of English Education Study Program at Batanghari University Jambi. JELT: Journal of English Language Teaching, 4(2), 104–111.

Sabri, M. M. Z., Pratolo, B. W., & Basopi, P. (2019). How Daily Code Mixing Becomes a New Strategy for Teaching Vocabulary Mastery. Journal of Education and Learning (EduLearn), 13(4), 534–542.

Sadilah, R., & Gaol, R. R. L. (2021). Improving Students’ English Pronunciation Through Listening To English Songs at the Second Grade Students of SMP Swasta Harvard Martubung. MELT (Medium for English Language Teaching), 6(1), 15–30.

Saleh, S. E. (2019). Citical Thinking as a 21st Century Skill: Conceptions, Implementation and Challenges in the EFL Classroom. European Journal of Foreign Language Teaching, 4(1), 1–16.

Sari, D. M. M., & Prasetyo, Y. (2021). Project-Based-Learning on Critical Reading Course to Enhance Critical Thinking Skills. Studies in English Language and Education, 8(2), 442–456.

Sari, R. A. (2018). Students’ Grammatical Error Analysis in Speaking. Edukasi: Jurnal Pendidikan Dan Pengajaran, 5(2), 127–137.

Setiawan, C. (2019). Improving Students’ Vocabulary Mastery Through Listening Song. PROJECT (Professional Journal of English Education), 2(3), 392–397.

Setiawan, D. (2016). English Code Switching in Indonesian Language. Universal Journal of Educational Research, 4(7), 1545–1552.

Setiyawan, A., & Fathir, A. (2019). Improving Grammar Mastery through Movie Segment for the Fourth Semester of English Students Academic Year 2018/2019 at Madura Islamic University. Lingual: Journal of Language and Culture, 8(2), 33–38.

Sharadgah, T. A., Sa’di, R. A., & Ahmad, H. H. (2019). Promoting and Assessing EFL College Students’ Critical Thinking Skills through Argumentative Essay Writing. Arab World English Journal, 10(4), 133–150.

Silalahi, R. M. P. (2016). Pronunciation Problems of Indonesian EFL Learners: An Error Analysis. Journal of English Language and Culture, 6(2), 163–176.

Singh, B. K. A., Hameed, B. S., Md Yunus, M., Hashim, H., & Hashim, H. U. (2021). Instawrite: Instagram as a Platform of Improving ESL Vocabulary among Learners in International School. International Journal of Academic Research in Business and Social Sciences, 11(12), 249–259.

Sitorus, C. Y., Simanjuntak, M., & Sinaga, S. L. (2021). An Analysis of Vocabulary Mastery of Eight Grade Students at SMP Amalyatul Huda Medan. PROJECT (Professional Journal of English Education), 4(1), 139–147.

Solihat, D., & Utami, P. L. (2014). Improving Students’ Listening Skills by Using English Songs. ENGLISH REVIEW: Journal of English Education, 3(1), 81–90.

Subramaniam, S., & Zainal, Z. (2016). The Effect of Extensive Reading on Vocabulary Acquisition. LSP International Journal, 3(1), 63–82.

Subroto, I., & Rosalinah, Y. (2017). Grammar and Critical Thinking Effects Towards Students’s Writing Skill at SMK Ksatrya in Central Jakarta. PROGRESSIVE, XII(2), 65–72.

Suharti, D. S., Sutikno, E. U., & Santi, H. D. A. (2020). Prewriting Activities Using Assisted-Technology in Efl Journalism: a Needs Analysis. PROJECT (Professional Journal of English Education), 3(6), 795.

Syakur, A., Sugirin, & Widiarni. (2020). The Effectiveness of English Learning Media through Google Classroom in Higher Education. Britain International of Linguistics Arts and Education (BIoLAE) Journal, 2(1), 475–483.

Tittle, P. (2011). Critical Thinking: An Appeal to Reason. Routledge.

Tseng, A. S. (2018). Students and Evaluation of Web-Based Misinformation About Vaccination: Critical Reading or Passive Acceptance of Claims? International Journal of Science Education, Part B, 8(3), 250–265.

Ünaldı, İ., & Yüce, E. (2021). The Relationship Among Vocabulary Size, Grammar Proficiency, and Critical Thinking Skills of Adult Language Learners. Adult Learning, 32(2), 70–78.

van der Zanden, P. J. A. C., Denessen, E., Cillessen, A. H. N., & Meijer, P. C. (2020). Fostering Critical Thinking Skills in Secondary Education to Prepare Students for University: Teacher Perceptions and Practices. Research in Post-Compulsory Education, 25(4), 394–419.

Villacís Villacís, W. G., & Hidalgo Camacho, C. S. (2016). Planning Lessons for Critical Thinking: a Way To Improve Learning Outcomes in the English As a Foreign Language Classroom. Investigación y Desarrollo, 11(1), 49–57.

Wale, B. D., & Bishaw, K. S. (2020). Effects of Using Inquiry-Based Learning on EFL Students’ Critical Thinking Skills. Asian-Pacific Journal of Second and Foreign Language Education, 5(9), 1–14.

Widodo, M. R., & Gunawan, A. (2019). Investigating The Effect of Using Podcast. LINGUA Jurnal Pendidikan Bahasa, 15(1), 35–42.

Winarti, N., Yundayani, A., Susilawati, & Alghadari, F. (2021). Critical Thinking Skills on Argumentative Text Writing Skills: Does It Have Any Effect? Elite Journal, 8(2), 1–12.

Wongsuriya, P. (2020). Improving the Thai Students’ Ability in English Pronunciation through Mobile Application. Educational Research and Reviews, 15(4), 175–185.

Yildirim, S., & Söylemez, Y. (2018). The Effect of Performing Reading Activities with Critical Reading Questions on Critical Thinking and Reading Skills. Asian Journal of Education and Training, 4(4), 326–335.

Yusriati, & Hasibuan, S. H. (2019). The Analysis of English Pronunciation Errors by English Education Students of FKIP UMSU. Journal of English Education and Teaching, 3(2), 230–448.

Zainnuri, H. (2014). The Effectiveness of Using Tell Me More to Assist Teaching Pronunciation of English Viewed from Students’ Self-Confidence. The 61st TEFLIN International Conference, 942–945.

Zare, M., Behjat, F., Abdollrahimzadeh, S. J., & Izadi, M. (2013). Critical Thinking and Iranian EFL Students’ Listening Comprehension. International Journal of Linguistics, 5(6), 12.



  • There are currently no refbacks.

JELTL (Journal of English Language Teaching and Linguistics); Web:; Email:[email protected]

Creative Commons License
JELTL by is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License

Indexed and Abstracted BY: