Integrating Learning Management System with Facebook Function: The Effect on Perception Towards Online Project Based Collaborative Learning

— This study evaluates the effect on Perception towards Online Project Based Collaborative Learning (OPBCL). OPBCL was developed by integrating Moodle forum with Facebook function and using project based learning approach. A quasi-experiment was conducted with two classes of polytechnic students for three weeks which involved 54 students. Data were obtained using Perception of Online Collaborative Learning Questionnaire (POCLQ). The study was conducted to evaluate students’ perceptions toward CIDOS and OPBCL platform based on Learning Environment (LE), Learning Design (LD), Learning Interaction (LI) and Soft Skills (SS) construct. All collected data were analysed using SPSS 19.0 software. Overall, the findings revealed that perception score in OPBCL platform is higher than CIDOS platform. Evaluation based on constructs showed that except for LD construct, other constructs have shown that score in OPBCL platform is higher than CIDOS platform. OPBCL has shown to be a better online learning platform that can promote students’ interaction in project based learning approach.


I. INTRODUCTION
A learning management system (LMS) which is also known as Course Management System (CMS) or Virtual Learning Environment (VLE) is a software application or Web-based technology that is used to plan, implement, and assess a specific learning process [1]. Typically, an LMS provides an instructor with a way to create and deliver content, monitor student participation, and assess student performance. It integrates a range of functions for teaching and learning activities. LMS makes the interaction between learner-instructor and learner-learner more convenient. HEIs empower LMS to support a high-quality education [2], [3]. LMS can be used to provide students and educators a set of tools for improving the learning processes and managing them [4]. It also provides a platform on the web, and a lot of pedagogical activities can be performed on it [5].
Nowadays most educational institutions adopt LMS via the used of open sources such as Moodle and Sakai or commercials such as Blackboard to centralise contents, learning and assessment activities in a specific learning environment [6], [7]. LMS provides a variety of communication tools such as a forum, chat, discussion board and video or audio conferencing [8], [9]. Learners can use these features to facilitate their communication and collaborative work in this learning environment [10]. LMS improves the quality of teaching and learning by enabling educators to monitor [11] and evaluate [12] the students' involvement. Moreover, LMS offers opportunities for increased collaboration through the interaction function [13]. Currently, Moodle (Modular Object Oriented Dynamic Learning Environment) is the most popular LMS because it is a free open source [14]- [17]. Moodle was developed by Dougiamas (1998) based on social constructivism pedagogical philosophy [18]. Therefore, it has been widely adopted by institutions. Furthermore, Polytechnics have designed and developed their own LMS using Moodle platform called CIDOS (Curriculum Information Document Online System). Therefore, OPBCL will be developed using Moodle platform.
Even the advantages of LMS are commonly known, and it is a well-known fact that without appropriate pedagogical support, the effectiveness of online learning cannot be produced. Concerns arise among educators about the use of learning theory in online learning [5], [19], [20]. The studies have been reported that most online learnings do not incorporate any learning theory or pedagogy. Witte et. al; Kivunja; and Al-Ansari et. al [12], [21], [22] emphasised the use of appropriate learning theory in online learning to increase learning effectiveness. Furthermore, previous studies have highlighted that LMS has not been fully utilised by educators. LMS provides many types of tools [8] such as communication, productivity, assessment and course management features [23]. However, educators have been found to use only the productivity feature such uploading and sharing notes or handouts while ignoring other features ( [24]. Besides, the study also reported that HEIs are still using LMS in teaching due to the course content facilities. Therefore, the frequency in the use of LMS by the HEIs is very low and has become unpopular among educators ( [25].
Besides that, the drawback of LMS is that uninteresting interfaces may result in decreased students' motivation [26]. Based on students' perspectives, educators must use an attractive layout that students familiar with in order to facilitate OCL [27]. In addition, Gleadow et.al [28] report that LMS face challenges in terms of engagement and accessibility. Previous literature has discussed on the communicational features of LMS which are poorly utilised in most institutions. This is because LMS do not provide supportive environments that can support interaction and communication [16], [26]. Due to the incapability and limitations of LMS, such as networking and communications [29], lecturers sought for other applications as a replacement for the built-in discussion forum in LMS [16], [30]. Martins et. al [31] also suggest on replacing traditional LMS with Social Networking Sites.
Social Networking Sites (SNSs) are online services, platforms, or sites that focus on facilitating the building of social networks or social relations among people who, for example, share interests, activities, backgrounds, or real-life connections. SNSs are a part of Web 2.0 tools that have become the most of the crucial communication tools nowadays. There is no specific definition of Social Networking Sites [32]. However, it's the core features of are to facilitate interaction and collaboration among users. Since their introduction, SNSs such as Myspace, Facebook, and Twitter have attracted millions of users, many of whom have integrated these sites into their daily practices. SNSs provide users a platform to share information, exchange views and support interaction [33]. Moreover, SNSs supported constructivist approach in learning in order to increase students' knowledge construction and to promote interaction [34]. Zaidieh [35] was described these networks as social because it allows communication and strengthen the ties between members on the Internet.
Learning through SNSs is a trending topic nowadays, especially since many studies report that students spend more time online in SNSs [30]. Recently, SNSs were adapted by more educators to be merged with education [32], [36]. Brown [37] determined ubiquitous access, ease of use, functionality, and flexibility of social technologies as a driven factor to adapt SNSs in learning. According to Zaidieh [35], SNSs offer (i) flexibility, (ii) repeatability and (iii) convenience and accessibility. The flexibility believed to be the most attractive elements that can motivate students to learn in a social network. Flexibility expands the learning option on what, when, where and how students learn. Repeatability element offers the student the opportunity to retrieve previous information immediately or later, which is not possible in traditional learning. Furthermore, it provides easy access anytime and anywhere thus helping to increase students' satisfaction.
Various studies have been conducted to examine SNS's usages in education [26]. These studies showed that SNSs enable interaction, collaboration, resource sharing, active participation, and critical thinking in educational activities [38]- [42]. Wheeler et.al, Rifkin et.al and Zourou [43]- [45] suggested that SNSs could be used to enhance the relationship, improve motivation, offer personalized material and develop collaborative skills. According to Smith [46], SNSs are capable of promoting the development of online community and extend learning beyond the classroom. Meanwhile, studies by Barbour and Plough; Zakaria; and Ventura and Martin-Monje [42], [47], [48] argued that the incorporation of social media into blended learning course can enhance the learning experiences. Moreover, Silius et. al [49] found that SNSs could improve collaborative learning and social interaction by attracting and motivating the student to participate in the learning process.
SNSs are also able to enhance connection through ease of use and easy access [50], [51]. In addition, Hamid et.al [52] indicated that SNSs could be used to improve engagement, enhance motivation, offer personalised course material and develop collaborative skills. SNSs help introvert students who feel shy to interact actively in face-to-face activities and to voice out their opinions. The study believed that introvert students had many good ideas compare to the extrovert student. Furthermore, Ractham et. al [53] have found that SNSs could build a relationship between educators and learners; promote interaction and exchange knowledge among leaners. Other previous studies that also reported the advantages of SNSs had been summarised in Table 1. The capability of SNSs to attract, motivate and engage students in meaningful communicative practice, content exchange and collaboration have been proven by many previous researchers [54]. SNSs has also benefited education through "supporting social learning, constructivist teaching practices, authentic instruction, student centred learning, and on-demand access to learning" [55]. Furthermore, SNSs enhanced the effectiveness of collaborative learning through the integration of motivation with learning outcomes [56]. Even though, Nguyen et. al [26] exacerbate that SNSs have been originally designed for social purposes rather than education, however, the rapid development of technology makes room for the SNSs used to support pedagogy in higher education [57]. Therefore, Bower et. al [58] emphasised that educators should consider content and pedagogical aspects when design Web 2.0 learning activities. Without proper instructional design, SNSs will not be able to produce effective learning [59].
Even though earlier evidence have indicated the effectiveness of SNSs, some argue that SNSs distract learners where students spend less time in their studies thus resulting in lower knowledge performance [60]- [64]. Conversely, Pasek et. al [65] replicated study that investigated the relationship between Facebook use and which had grade reported opposite. A similar result was reported by Wang et.al [50] study which reported that SNSs do not academically improve the learning process. Although several studies have indicated that SNS enable interaction, collaboration, resource sharing, active participation, and critical thinking in educational activities [38]- [41], but it simply cannot be successful in meeting the students' needs. It can only be used as a supplement in the teaching and learning process [29]. Earlier, previous researchers have suggested on replacing LMS with SNSs due to its potential in enhancing communications, community building, and engagement, however, a study by Buzzetto-more [55] reported opposite where student do not want SNSs to replace LMS.
Based on previous studies, there are different views on LMS and SNSs. Educators cannot simply incorporate technology into learning and need to ensure that the chosen technology can support the learning objectives [66]. Even though many researchers in the field of education have looked into the potential of adapting SNSs in their teaching and learning process [25], [67], [68], various studies have focused on the integration of conventional LMS such as Moodle with SNSs.
Embi [3] recommended integrating LMS with SNSs function due to lack of communication in LMS. This was supported by Simsek [69] where the emergence of web 2.0 tools such as SNSs and blogs, has opened a space for student-centred learning such as collaborative learning. Ali et. al [70] believed that the integration of the LMS with SNSs could improve the abilities of each technology. Moreover, Holcomb and Kruger-Ross [71] found that the integration of web tools with Web 2.0 technologies such as SNSs can enhance collaboration and social presence. Recently, Nguyen et. al [26] also suggested combining a traditional LMS with the social networking environment to enhance collaborative performance, thus promoting active learning.
This has left a gap in the body of knowledge on how SNSs can be integrated into LMS platform to facilitate Online Collaborative Learning (OCL). According to Witte et. al [12], educators need to provide an online platform that is accessible, flexible and user-friendly to facilitate collaborative learning. It is essential to choose appropriate online learning tools that can foster collaboration and communication Abrami et. al [72] and avoid distraction with non-related activities Said et. al [27]. A good platform as such can increase students' interaction thereby enhancing the soft skills of students. Therefore, with the availability problem as stated, then the study to propose effective online learning environment that can facilitate Collaborative Learning is significant. This study proposed Online Project Based Collaborative Learning (OPBCL) by integrating LMS forum with Facebook function and using project-based learning approach. Therefore, this study aims to evaluate the effect on perception towards Online Project Based Collaborative Learning.

A. Design of Study
This study has been divided into three phases which are (i) Analysis; (ii) Design and Development; and (iii) Implementation and Evaluation. In the analysis phase, research problems have been identified based on the analysis of previous studies that have been conducted within and outside the country. Interviews with the head of the program were carried out to view the main factor that results in graduates are unemployed. A preliminary study was conducted to obtain feedback on the use of Collaborative Learning, CIDOS and Social Networking Sites in the context of Malaysian Polytechnics. Then, a qualitative approach was used throughout this phase in order to determine the factors and elements of OCL. Azman [73] stated that factors and elements could be identified using two approaches, which are document review and expert verification. According to Sallabas; and Best and Khan [74], [75], the document review method is the most appropriate tool to collect information in a qualitative study. Steward [76] defines materials and resources that can be used as documents to carry out the analysis and interpretation of which are (i) journals and books, (ii) research literature, and (iii) reports from scholarly research papers and materials. Analysis of theory and model related to Online Collaborative Learning (OCL) was determined through document analysis. All factors and elements that were determined from document analysis were then validated by experts to make sure that meets the objectives of the study [77], [78]. At the end of this phases, an OCL model was proposed [79].
In the design and development phase, OPBCL was designed and developed based on the proposed model [80]. In order to achieve the research goal, the prototype will be designed and developed using the ADDIE development model that consists of five phases; analysis phase, design phase, development phase, implementation phase and evaluation phase ( [81], [82]. Need analysis was conducted to determine SNSs and CL based on lecturer and student preferences by distributing two set of questionnaire. Based on findings in the need analysis phase, Online Project Based Collaborative Learning was designed and develop by integrating Moodle with Facebook function and using project-based learning approach. In the implementation phase, OPBCL was set up properly, and training was given to ensure it can be used in the pilot test. Finally, in the evaluation phase, OPBCL was validated by experts and a pilot test was conducted to ensure that OPBCL functionality and readiness for the real test. Besides the OPBCL, Perception of Online Collaborative Learning Questionnaire (POCLQ) was developed to assess the effectiveness of the developed prototype. POCLQ was verified by experts, and a pilot test was conducted to ensure all instruments are reliable and valid for the real test. In the implementation and evaluation phase, a pilot study was conducted in order to ensure instruments are valid and reliable.
In implementation and evaluation phase, a procedure in the form of training and guiding the facilitators and the learners had to be developed. The facilitators' training should cover the course curriculum, learning outcomes, a method of delivery and testing procedures. Preparation of the learners includes training them on new tools (software or hardware) and student's registration. Training was given to both the treatment groups for two weeks (W12 and W13) to avoid differences in the ability to use the system. Detailed procedures for the training will be discussed in the procedure section.

B. Instrument
The instrument was developed based on the OCL construct of (i) learning environment, (ii) learning design, (iii) learning interaction and (iv) soft skills. The development of items was adapted and modified from [83]- [87]. The items also have been agreed upon by experts based on literature through the theories related to construction and dimensional constructs. This instrument is divided into two sections: 1) Section A: Section A is related to the background of the respondents. This section contains nine items related to gender, age, residence, computer literacy, CIDOS experience, CIDOS forum experience, SNSs experience, Facebook account and PBL experience.
2) Section B: Section B consists of items that are designed to assess student's perception toward the proposed prototype. The section contains 37 items developed based on factors and elements that have been identified before in [77]. Table 2 shows the content of the questionnaire and the number of items included in this section. The respondents answered the questionnaire using a Likert scale. According to Likert in 1974, the rate or level of agreement on a question can be obtained using a Likert scale. This study used a 6 Likert scale to avoid students from choosing a midpoint answer in 5 Likert scale. According to Chomeya [25], using a 6 Likert scale can reduce the deviation of personal decision making. Furthermore, a 6 Likert scale was chosen when the respondents were needed to answer either the positive or negative perception. A 5 Likert scale is not suitable for use in this study because the respondents had prior experience using the developed prototype. A 5 Likert scale is used only if there is concern that the respondents are not familiar with the environment being studied. The scale used was (1) strongly disagree, (2) disagree, (3) somewhat disagree, (4) somewhat agree, (5) agree and (6) strongly agree as illustrated in Table 3. Rasch model approach was implemented to check the reliability and validity of the instruments used. In recent years, Rasch models also referred as item-response theory (IRT) or latent trait models, have provided an alternative framework for understanding measurement and alternative strategies for judging the quality of a measuring instrument [88], [89]. Applications of Rasch model can produce an instrument that is reliable and valid [90].The test was performed by 32 respondents from Politeknik Ibrahim Sultan at the user's site. Data obtained was analysed using WINSTEP version 3.68 software.
The finding showed that POCLQ instruments had high reliability with five categories of difficulties items. So, it can be concluded that POCLQ instrument is reliable and strongly accepted. The findings on items polarity also indicated that the instrument could measure any item to be measured, and its move parallel with other items that measure the construct. However, based on the analysis of item fit, six items were found to be out of 0.6-1.4 range. Moreover, from the analysis on standard residual correlations, five items were found to be overlapping. However, all the items that needed to be dropped based on the analysis of result had been refined and retained for the purpose of the study and based on expert's view.

C. Respondents
In this study, sample selection could not be done randomly because it could interfere with the students' schedules. The respondents are students who were takers of the Nutrition subject in the December 2014 session from Polytechnic Merlimau Melaka. A total of 54 students were involved in this study. It involves the use of intact groups of subjects in an experiment rather than assigning subjects at random to experimental treatments [91], [92]. There were two classes namely control (21 students) and treatment (33 students) class. Students involved in this study may be different in some aspects. These differences may affect the behaviour during the treatment given. In subject selection, any pre-existing differences between the experimental and control groups (which may have resulted from a non-random sampling procedure) must be identified; otherwise, differences between them can affect the research findings [93]. Therefore, a pre-test was conducted to control the preexisting differences between the intact groups.

D. Procedure
All respondents completed a pre-test before the intervention at the same time. Training was given to both the treatment groups for two weeks (W12 and W13) to avoid differences in the ability to use the system. The duration of the intervention lasted for 3 weeks (W14 -W16) based on lecturer lesson plan and program syllabus. Each group received an equivalent amount of instructional time. For the control group, students started do the project through CIDOS platform; meanwhile, treatment group started their project through OPBCL platform.

III. RESULTS AND DISCUSSION
The effect on perception towards Online Project Based Collaborative Learning was obtained using Perception of Online Collaborative Learning Questionnaire (POCLQ). The data obtained from POCLQ were analysed inferentially by including the Learning Environment (LE), Learning Design (LD), Learning Interaction (LI) and Soft Skills (SS) construct. Accordingly, when comparing students' perception between Control and Treatment groups, it was decided that the Mann Whitney Test is used. Table 4 shows that a significant difference exists among students' perception towards the platform they used between Control and Treatment group [U = 96.00, z = -4.45, p < .05]. Based on this information, it is revealed that the Treatment group which participated using OPBCL platform (Mean Rank = 35.09) had a higher perception score than Control group which participated using CIDOS platform (Mean Rank = 15.57). In addition, analysing each construct in the students' perception questionnaire based on construct of each group might be beneficial in determining the effects in terms of the performed activities. Table 5 shows that significant difference exists in the Learning Environment (U = 224.50, z = -2.41, p < .05), Learning Interaction (U = 217.00, z = -2.44, p < .05) and soft skills (U = 169.00, z = -3.36, p < .05) construct between Control and Treatment group. Meanwhile, no significant difference exists in the Learning Design (U = 273.00, z = -1.60, p > .05) construct between Control and Treatment group.
Based on this information, it has been revealed that the perception towards Learning Environment constructed from Treatment group which participated using OPBCL platform (Mean Rank = 31.20) had a higher mean rank than Control group which participated using CIDOS platform (Mean Rank = 21.69). In learning interaction construct, it has been indicated that the perception of Treatment group which participated using OPBCL platform (Mean Rank = 31.42) is higher than Control group which participated using CIDOS platform (Mean Rank = 21.30). The result also showed that the perception of Treatment group which participated using OPBCL platform (Mean Rank = 32.88) is higher than Control group which participated using CIDOS platform (Mean Rank = 19.05) based on soft skills construct. Therefore, it can be concluded that except for Learning Design construct, other constructs have shown a different perception between Control and Treatment groups where Treatment obtained higher scores in comparison to Control. The study was conducted to evaluate students' perceptions toward CIDOS and OPBCL platform based on Learning Environment (LE), Learning Design (LD), Learning Interaction (LI) and Soft Skills (SS) construct. Accordingly, when comparing students' perception between Control and Treatment groups, it was decided that the Mann Whitney Test is used. Overall, the findings revealed that perception score in Treatment group is higher than Control group. It shows that OPBCL had provided a better online platform compared to CIDOS. In addition, analysing each construct in the students' perception questionnaire based on the construct of each group might be beneficial in determining the effect in terms of the performed activities.
The findings clearly showed that there is a significant difference in the Learning Environment (LE), Learning Interaction (LI) and Soft Skills (SS) construct which the Treatment portrayed better perception of the OPBCL platform than CIDOS platform. Meanwhile, there is no significant difference in the Learning Design (LD) construct. This is caused by both groups who use the same learning design. The learning design in both groups has been standardized in terms of content, time, process and evaluation. Both groups agreed the learning design encourage them to participate actively in group work project. According to Ngusa (2014) [94], the learning activities must be properly designed so that learning can be effective. Proper learning design can bring success than failure [95].
In learning environment construct, it was clearly shown that the students' perception in Treatment group was higher that Control. It is also evident that OPBCL platform is better in terms of usability, stability, and accessibility. The learning environment provided by OPBCL encourages students to participate actively in group work. The supportive learning environment can encourage student participations [96]. This finding supports the findings of research question 6 where the total number of postings in OPBCL platform is higher than CIDOS platform. This proves that OPBCL can provide a better online learning environment. The active participation of students can directly enhance the soft skills of students.
As for learning interaction construct, the same results were evident whereby the perception of Treatment group was higher than Control. It confirms that OPBCL platform provided better learning interaction in terms of learnerlearner interaction and learner-instructor interaction. The better learning environment can provide better learning interaction. [96], [97] believed that supportive learning environments could encourage student's participation and increase their interaction. The finding proves that OPBCL provides a better learning environment that can encourage the student to actively participate in group work, thus increase student's interaction. With that, it can enhance students' soft skills.
Soft skills construct also reflects that the perception of Treatment group is higher than Control group. The students in Treatment group believed that OPBCL provides an effective learning platform that can enhance their critical thinking and problem-solving skills, collaboration skills, and communication skills. Hence, this study emphasises the use of OPBCL platform to enhance students' soft skills.

IV. CONCLUSIONS
This study attempted to evaluate the effect on perception towards Online Project Based Collaborative Learning. The difference in the perception scores between Control and Treatment groups is caused by the integration of SNSs function, meaning Facebook in OPBCL platform which facilitated OCL. These findings are also consistent with the studies by Hern'dez et. al; and Ozmen and Atici [30], [98] who have stated that the current LMS is insufficient to support social interaction, resulting in low student participation when using the LMS platform. Hewit [99] believed that the way a forum is facilitated would affect the students' active participation. Therefore, previous studies have recommended that current LMS are integrated with SNSs function [3], [100]- [104]. The integration of LMS with Facebook function in OPBCL platform provides a better learning environment in terms of usability, stability, and accessibility. OPBCL has proven to be a better learning platform that can promote students' interaction in terms of easy access and instant notification. The educator can use OPBCL platform to monitor and evaluate students' contribution in CL process. The evaluation process can also promote students' interaction.
Apparently, there are constraints and drawbacks in every technology, and thus, online learning is no exception. This study has certain limitations that should be considered for further research. The study was conducted using only a relatively small sample, it is suggested that further research is undertaken for a larger sample, and therefore findings can be generalized. Therefore, it is suggested that further research is undertaken for a larger sample, and therefore findings can be generalized. However, this study does not intend to generalize these results to a wider population. Besides, the study was conducted quantitatively on students' perception towards OPBCL. It is recommended that a qualitative study should be done to obtain more precise information. Finally, this study was conducted by integrating Learning Management System with Facebook function. Therefore, a similar study should be conducted by integrating Learning Management System with other Social Networking Sites such WhatsApp but the selection must be based on respondent preferences.