Scholarly article on topic 'Programme Outcomes Assessment for Civil & Structural Engineering Courses at Universiti Kebangsaan Malaysia'

Programme Outcomes Assessment for Civil & Structural Engineering Courses at Universiti Kebangsaan Malaysia Academic research paper on "Educational sciences"

CC BY-NC-ND
0
0
Share paper
OECD Field of science
Keywords
{"Outcome-Based Education (OBE)" / "Programme Outcomes (PO)" / "Assessment using examination" / "Student evaluation: high quality graduates" / "Three categories of students"}

Abstract of research paper on Educational sciences, author of scientific article — Ishak Arshad, Siti Fatin Mohd Razali, Zawawi Samba Mohamed

Abstract Programme Outcomes (PO) is the expected achievement of the level of knowledge, skills and abilities essential to each student after their graduation. The Department of Civil & Structural Engineering, Faculty of Engineering and Built Environment, UKM has established 10 POs, PO1 to PO10 for all undergraduate courses from Year 1 to Year 4. Measurements of the POs are made through several assessments such as tutorials, quizzes, laboratory works, projects, mid-semester examinations and final examinations. This study presents the results from calculations based on the POs of the final examinations for two semesters (semester 1 and semester 2) of session 2010/2011 Civil & Structural and Civil & Environmental Engineering undergraduate programmes. It was made using the average marks for the sample of five excellent students, five moderate students and five weak students for all courses which have final examinations. The results showed an average overall marks for the PO4 is the highest around 78% followed by PO3 and PO10 which are about 68% and 63% respectively, while PO1 and PO2 have the lowest values which are around 56%-59%.

Academic research paper on topic "Programme Outcomes Assessment for Civil & Structural Engineering Courses at Universiti Kebangsaan Malaysia"

Available online at www.sciencedirect.com

SciVerse ScienceDirect

Procedía - Social and Behavioral Sciences 60 (2012) 98 - 102

UKM Teaching and Learning Congress 2011

Programme Outcomes Assessment for Civil & Structural Engineering Courses at Universiti Kebangsaan Malaysia

Ishak Arshada'b'*, Siti Fatin Mohd Razalia,b, Zawawi Samba Mohameda,b

a Centre for Engineering Education Research, Faculty of Engineering and Built Environment,Universiti Kebangsaan Malaysia bDepartment of Civil and Structural Egineering, Faculty of Engineering and Built Environment,Universiti Kebangsaan Malaysia

Abstract

Programme Outcomes (PO) is the expected achievement of the level of knowledge, skills and abilities essential to each student after their graduation. The Department of Civil & Structural Engineering, Faculty of Engineering and Built Environment, UKM has established 10 POs, PO1 to POlO for all undergraduate courses from Year 1 to Year 4. Measurements of the POs are made through several assessments such as tutorials, quizzes, laboratory works, projects, mid-semester examinations and final examinations. This study presents the results from calculations based on the POs of the final examinations for two semesters (semester 1 and semester 2) of session 2010/2011 Civil & Structural and Civil & Environmental Engineering undergraduate programmes. It was made using the average marks for the sample of five excellent students, five moderate students and five weak students for all courses which have final examinations. The results showed an average overall marks for the PO4 is the highest around 78% followed by PO3 and PO10 which are about 68% and 63% respectively, while PO1 and PO2 have the lowest values which are around 56%-59%.

© 2011PublishedbyElsevierLtd. Selection and/orpeer reviewedunderresponsibilityofthe UKMTeachingand LearningCongress 2011

Keywords: Outcome-Based Education (OBE); Programme Outcomes (PO); assessment using examination; student evaluation: high quality graduates; three categories of students

1. Introduction

Faculty of Engineering and Built Environment UKM has started using the concept of Outcome-Based Education (OBE) since 2005. This concept is in line with the requirements for all engineering programmes in implementing OBE curriculum at public higher education institutions (Shahrir et al., 2008). OBE is a teaching method that emphasizes what students can actually do after they completed their training or their courses (Faizah, 2008). OBE implementation is to ensure the academic programmes, the delivery systems and methods of valuation will produce capable and high quality graduates. There are three main objectives needed to be achieved in the implementation of the OBE. The objectives are the results of the Course Outcomes (CO), the Programme Outcomes (PO) and the

* Corresponding author. Tel +6-03-8921-7024; fax:+6-03-8921-6147 E-mail address: ishar@eng.ukm.my.

1877-0428 © 2011 Published by Elsevier Ltd. Selection and/or peer reviewed under responsibility of the UKM Teaching and Learning Congress 2011 doi:10.1016/j.sbspro.2012.09.353

Programme Educational Objectives (PEO). The objectives should be measured to determine the level of knowledge, skills and abilities of all students after completing their courses.

The basis for the assessment of PO is to use the marks of final exams, mid-semester exams, tests, quizzes, laboratory works, course works and projects. The accounted final exam marks are between 40% and 70% of the overall course marks and it is the largest component. However, the examination can only be used to assess the performance of PO1, 2, 3, 4 and 10. The rest of the POs can be evaluated using other methods as mentioned above. Table 1 shows the list of PO1 to POIO used by the Civil & Structural and Civil & Environmental Engineering undergraduate programmes for the 2010/2011 session.

Table 1. List of Programme Outcomes (PO) (Universiti Kebangsaan Malaysia, 2010)

PO Knowledge Components

Has adequate background knowledge and able to apply it.

Has the ability to undertake engineering problem identification and provide solutions.

Has the ability to design a Civil and Structural or Environmental Engineering project within social and environmental.

Is able to behave professionally and practice moral ethics.

Has the ability to design and conduct experiments, as well as to analyze and interpret data.

Has the ability to use the techniques, skills and modern engineering tools necessary for civil engineering practice.

Has the ability to convey spoken or written ideas not only with engineers but also the community.

Has the ability to function effectively as individuals and in groups with capacity to be a leader or manager as well effective team member.

Recognizes the needs of life-long learning.

Has the ability to adopt elements of the construction project management, asset management, public policy, administration, business and entrepreneurship.

2. Methodology

This study has analyzed the information related to the achievement of PO using 15 samples of students' final exam answer sheets for each course of the programmes. PO matrix of the final examination forms for each course show marks of the tested POs. Marks obtained show the achievement of POs by 15 students representing three different categories for each course. PO results for all courses were then averaged to indicate overall performance of PO. PO values for each category of the excellent, moderate and weak students were also evaluated. A total of 37 courses of Civil & Structural Engineering and the Civil & Environmental Engineering were offered for the 2010/2011 session. However, only 22 courses were involved in the evaluation of these POs while the other 15 courses could not be assessed due to lack of data, or did not have final examinations. List of courses involved in this study is given in Table 2.

PO1 PO2

PO8 PO9 POIO

Table 2. List of courses

No. Course Code Course Name No. Course Code Course Name

1. KH1044 Static and Dynamic 12. KH4033 River Engineering

2. KH1124 Engineering Survey 13. KH4073 Engineering of Water Supply and

Sewerage system

3. KH2124 Strength of Materials 14. KH4193 Project Management

4. KH2134 Fluid Mechanic for Civil Engineering 15. KH4223 Geotechnical Engineering Practice

5. KH2174 Introduction to Environmental 16. KH4283 Sustainable Town Planning

Engineering

6. KH2254 Geotechnics I 17. KH4323 Structural Design II

7. KH2264 Material Technology 18. KH4573 Structure Stabilisation and Dynamic

8. KH3224 Structural Analysis 19. KW1104 Principle of Chemical Processes

9. KH3234 Engineering Hydrology 20. KW3214 Chemical and Biological Processes

10. KH3244 Road Engineering 21. KW4023 Pollution Control

11. KH4023 Advanced Structural Analysis 22. KW4113 Bioreactor System

3. PO evaluation

Ratings are based on the PO matrix set by lecturers during preparation of final exam questions. In this study only PO1, PO2, PO3, PO4 and PO10 can be evaluated while the other POs cannot be assessed through final examination. Figure 1 (a) and (b) below shows the achievement of PO1, PO2, PO3, PO4 and PO10 for both undergraduate programmes during 2010/2011 session. Evaluation shows that the average percentage of each PO is at satisfactory level (more than 60%) especially PO3, PO4 and PO10. The average for both PO1 and PO2 are above 56%. There are several courses such as KH2124 and KH4023 that show very poor achievement of both PO1 and PO2 where the values are less than 40%. These courses affect the total average of both POs. For KH4573, KW3214 and KW4113, PO2 values are less than 40%. Therefore it is recommended that respective lecturers of these courses should pay more attention on PO1 and PO2 because they involved fundamental knowledge of the taught courses.

Values of PO1, PO2, PO3, PO4 and PO10 for the three categories of the excellent, moderate and weak students are displayed in Figure 2. The three categories are determined using the final exam marks where five highest marks were chosen to represent excellent category, five middle marks in moderate category and five lowest marks in weak category. Results show that all POs for excellent students have the highest values (76-94%), followed by moderate students (57-73%) and weak students (37-65%). All categories of students show the highest values in PO3 and PO4. Comparing the overall values of all POs, this study found that PO2 has the lowest value followed by PO1, with value between 37% and 77%. It was found that the differences in all the POs between excellent and moderate students were within 13%-20%. However, the differences in all the POs between excellent and weak students were within 28%-40%. The largest percentage difference of POs between excellent and weak students is PO2 (40%), followed by PO3 (38%) and PO1 (37%). This result indicated that most of weak students could not achieve PO1 and PO2 targets. It is recommended for PO1, that the academic staff should focus on improving the ability of students to acquire and use fundamental knowledge of mathematics, science and engineering. As for PO2, the lecturers should give more exercises to enhance student ability in identifying and solving engineering problems, in their respective courses. However, the overall percentages of POs are at satisfactory level.

(aj Average Marks of P01 and P02

диви

KH3M4 KH1124 KH2124 KH2134 КП2174 KH2254 KH22M KHS224 KH3234 KHÎ244 KH4023 KH4033 KK4073 KK4223 KH42SJ KH4323 KH4573 KWHM KW3214 KW40Î3 KW4113

■ РШ 67.2 54.4 2.9 49.0 68.9 79.7 55.9 57.6 68.2 66.4 39.1 69.9 71.3 64.0 S5.7 63.5 42.3 48.8 58.6 53.3 65. S

■ PO! 59.1 46.4 38.2 73.2 57.3 ТЫ 60.9 57.7 57.7 29.0 75.1 47.9 80.4 78.2 39.0 58.3 36.0 68.2 39.7

Course Code

» Average Marks of P03, PCH and POlO

DO SO £ 70 S ЬО £ 50 S 40 S ÏU Dt ?0

KH4 m 14?

Kh K1

3 141ЧЗ Kh

0 Kl 74 1407.1 к ИЛИ

■ РОЗ HI.ft 71.fi SÏÏ Si.5

■ P04 71 î ai 7

■ РОЮ .Mi 7U

Course Code

Figure 1. Evaluation of PO1, PO2, PO3, PO4 and P010 for Civil & Structural and Civil & Environmental Undergraduate Programmes during the 2010/2011 Session

Figure 2. Evaluation of PO for three categories of students and overall marks of PO for all categories.

4. Conclusions

Evaluation of PO1, PO2, PO3, PO4 and P010 using the final exam marks showed that all the five POs are at satisfactory level. Values of PO3 and PO4 are at the highest level followed by POIO. This result demonstrates achievement of PO3 with assess the ability to design related civil, structural and environmental engineering projects. Achievement of PO4 the ability to behave in professional and ethical responsibilities is very good. The achievement of PO1 and PO2 which are at lower values compare to other POs indicated more emphasis must be given on these two POs. Lecturers are advised to put in more effort in enhancing students' understanding of the basic knowledge and to apply them in solving engineering problems. Among the improvements that can be done is to give students more problem solving on the engineering applications. This can be applied particularly for courses which are considered critical in the evaluation of PO1 and PO2.

5. Recommendations and Improvement

This study should be done from time to time so that the department can evaluate the students' level of knowledge, skills and abilities based on all the POs, in order the teaching and learning aspects can be continuously improved. To achieve better and comprehensive results for the study, it is proposed that the calculation is made for all students and for all courses using final examination marks. It is recommended that the scoring matrix for each PO of all students is prepared to enable a more accurate assessment.

Acknowledgement

We would like to thank UKM for providing the research grant (PTS-2011-016). References

Deng Z.T, Oviedo R.R and Qian X. (2002). Developing Assessment Tools for Outcome Based Engineering Courses. Proceedings of the 2002

American Society for Engineering Education Annual Conference & Exposition. Faizah A.M. (2008). The use of Reflective Journals in Outcome Based Education during the Teaching Practicum, Malaysian Journal of ELT Research.

Faouzi, B., Lansari, A., Al-Rawi, A., & Abonamah, A. (2003). A novel outcome-based education model and its effect on student learning,

curriculum development, and assessment. Journal of Information Technology Education. Shahrir Abdullah, Riza Atiq Abdullah Ok Rahmat, Azami Zaharim, Norhamidi Muhamad, Baba Md Deros, Noorhisham Tan Kofli, Mardina Abdullah, Mazlan Tahir, Andanastuti Muchtar and Che Husna Azhari. (2008). Implementing Continual Review of Programme Educational Objectives and Outcomes for OBE Curriculum Based on Stakeholders' Input, Proceedings of the 7th WSEAS International Conference on Education & Educational Technology (EDU'08) Venice, Italy 21-23 November 2008, (pp. 218-223). Universiti Kebangsaan Malaysia. (2010). Guidelines for Undergraduates. Engineering and Built Environment Faculty, Academic Session 20102011.