Archives
Current issue
About
About us
Aims and Scope
Abstracting and Indexing
Editorial Office
Open Access Policy
Publication Ethics
Journal History
Publisher
Follow us: Twitter
Contact
For Authors
Editorial Policy
Peer Review Policy
Manuscript Preparation Guidelines
Copyright & Licencing
Publication Fees
Fee Waiver Policy for Doctoral Students
EJMSTE Language Editing Service
More
Statistics
Special Issues
Special Issue Announcements
Published Special Issues
RESEARCH PAPER
Adapting the science teaching efficacy beliefs instrument to assess engineering teaching efficacy beliefs of pre-service elementary teachers: Rasch model and confirmatory factor analysis
1
Weber State University, Ogden, UT, USA
2
George Mason University, Fairfax, VA, USA
3
University of Nevada Las Vegas, Las Vegas, NV, USA
Online publication date: 2024-07-25
Publication date: 2024-07-30
EURASIA J. Math., Sci Tech. Ed 2024;20(8):em2487
KEYWORDS
ABSTRACT
Background:
The next generation science standards (NGSS) (NGSS Lead States, 2013) place a particular emphasis on the integration of engineering into the science curriculum. Consequently, the NGSS calls on teachers to engage students in engineering practices to facilitate their experience with the engineering design process similar to engineers and develop a more contemporary view of engineering as a discipline. Since engineering education research in K-12 is still in its infancy, there is limited empirical evidence related to how teachers integrate engineering concepts into their classrooms. To assess the quality of teachers’ engineering teaching practices, teaching self-efficacy can be used as an indicator of their instructional practices because teaching efficacy beliefs are often associated with greater use of student-oriented instructional practices, increased teacher effort, and other positive instructional behaviors.
Purpose:
The main aim of this study was to validate an engineering teaching efficacy beliefs instrument (ETEBI) to measure pre-service elementary teachers’ engineering teaching efficacy beliefs
Design/method:
The science teaching efficacy beliefs instrument version B was modified to develop the ETEBI. The instrument was administered to 561 pre-service elementary teachers. A Rasch model analysis and confirmatory factor analysis (CFA) were conducted on the data obtained from 561 pre-service elementary teachers to provide evidence supporting the validity of the instrument.
Results:
The Rasch model and CFA suggested a two-factor solution: personal engineering teaching efficacy and engineering teaching outcome expectancy. Also, Cronbach’s coefficient alphas for each subscale were measured to assess the internal consistency of the subscales. Based on the analyses, the study provided evidence supporting the reliability and validity of the ETEBI to assess pre-service elementary teachers’ engineering teaching efficacy.
Conclusions:
The ETEBI can be confidently utilized to assess pre-service elementary teachers’ engineering teaching efficacy beliefs. It is effective in gauging the current status of their beliefs and/or determining changes in their beliefs as a result of any teacher training and professional development effort.
The next generation science standards (NGSS) (NGSS Lead States, 2013) place a particular emphasis on the integration of engineering into the science curriculum. Consequently, the NGSS calls on teachers to engage students in engineering practices to facilitate their experience with the engineering design process similar to engineers and develop a more contemporary view of engineering as a discipline. Since engineering education research in K-12 is still in its infancy, there is limited empirical evidence related to how teachers integrate engineering concepts into their classrooms. To assess the quality of teachers’ engineering teaching practices, teaching self-efficacy can be used as an indicator of their instructional practices because teaching efficacy beliefs are often associated with greater use of student-oriented instructional practices, increased teacher effort, and other positive instructional behaviors.
Purpose:
The main aim of this study was to validate an engineering teaching efficacy beliefs instrument (ETEBI) to measure pre-service elementary teachers’ engineering teaching efficacy beliefs
Design/method:
The science teaching efficacy beliefs instrument version B was modified to develop the ETEBI. The instrument was administered to 561 pre-service elementary teachers. A Rasch model analysis and confirmatory factor analysis (CFA) were conducted on the data obtained from 561 pre-service elementary teachers to provide evidence supporting the validity of the instrument.
Results:
The Rasch model and CFA suggested a two-factor solution: personal engineering teaching efficacy and engineering teaching outcome expectancy. Also, Cronbach’s coefficient alphas for each subscale were measured to assess the internal consistency of the subscales. Based on the analyses, the study provided evidence supporting the reliability and validity of the ETEBI to assess pre-service elementary teachers’ engineering teaching efficacy.
Conclusions:
The ETEBI can be confidently utilized to assess pre-service elementary teachers’ engineering teaching efficacy beliefs. It is effective in gauging the current status of their beliefs and/or determining changes in their beliefs as a result of any teacher training and professional development effort.
REFERENCES (91)
1.
AERA, APA, & NCME. (2014). Standards for educational and psychological testing. Oxford University Press.
2.
Albion, P. R., & Spence, K. G. (2013). Primary connections in a provincial Queensland school system: Relationships to science teaching self-efficacy and practices. International Journal of Environmental and Science Education, 8(3), 501-520.
3.
American Association for the Advancement of Science. (1993). Benchmarks for science literacy. Oxford University Press. https://doi.org/10.5860/choice....
4.
Ashton, P. T., & Webb, R. B. (1986). Teachers’ sense of efficacy, classroom behavior, and student achievement. In P. T. Ashton, & R. B. Webb (Eds.), Teachers’ sense of efficacy and student achievement (pp. 125-144). Longman.
5.
Ashton, P. T., Buhr, D., & Crocker, L. (1984). Teachers’ sense of efficacy: A self- or norm-referenced construct? Florida Journal of Educational Research, 26(1), 29-41.
6.
Ashton, P. T., Olejnik, S., Crocker, L., & McAuliffe, M. (1982, April). Measurement problems in the study of teachers’ sense of efficacy [Paper presentation]. The 1982 Annual Meeting of the American Educational Research Association., New York.
7.
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191-215. https://doi.org/10.1037//0033-....
9.
Banilower, E. R., Smith, P. S., Malzahn, K. A., Plumley, C. L., Gordon, E. M., & Hayes, M. L. (2018). Report of the 2018 national survey of science and mathematics education+. Horizon Research, Inc. Retrieved July 20, 2024, from https://horizon-research.com/N....
10.
Banilower, E. R., Smith, P. S., Weiss, I. R., Malzahn, K. A., Campbell, K. M., & Weis, A. M. (2013). Report of the 2012 national survey of science and mathematics education. Horizon Research, Inc. Retrieved July 16, 2024, from https://eric.ed.gov/?id=ED5417....
11.
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), Article 238. https://doi.org/10.1037//0033-....
12.
Bleicher, R. E. (2004). Revisiting the STEBI‐B: Measuring self‐efficacy in preservice elementary teachers. School Science and Mathematics, 104(8), 383-391. https://doi.org/10.1111/j.1949....
13.
Bond, T. G., & Fox, C. M. (2013). Applying the Rasch model: Fundamental measurement in the human sciences. Psychology Press.
14.
Boone, W., & Rogan, J. (2005). Rigour in quantitative analysis: The promise of Rasch analysis techniques. African Journal of Research in Mathematics, Science and Technology Education, 9(1), 25-38. https://doi.org/10.1080/102884....
15.
Boz, Y., & Cetin-Dindar, A. (2021). Teaching concerns, self-efficacy beliefs and constructivist learning environment of pre-service science teachers: A modelling study. European Journal of Teacher Education, 46(2), 274-292. https://doi.org/10.1080/026197....
16.
Burić, I., & Kim, L. E. (2020). Teacher self-efficacy, instructional quality, and student motivational beliefs: An analysis using multilevel structural equation modeling. Learning and Instruction, 66, Article 101302. https://doi.org/10.1016/j.lear....
17.
Calkins, L., Wiens, P., Parker, J., & Tschinkel, R. (2023). Teacher motivation and self-efficacy: How do specific motivations for entering teaching relate to teacher self-efficacy? Journal of Education, 204(2), 427-438. https://doi.org/10.1177/002205....
18.
Coladarci, T., & Fink, D. R. (1995, April). Correlations among measures of teacher efficacy: Are they measuring the same thing? [Paper presentation]. The annual meeting of the American Educational Research Association, San Francisco, CA.
19.
Coladarci, T., & Fink, D. R. (1995). Correlations among measures of teacher efficacy: Are they measuring the same thing? In Proceedings of the Annual Meeting of the American Educational Research Association.
20.
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98-104. https://doi.org/10.1037//0021-....
21.
DataUSA. (2024). Elementary & middle school teachers. Retrieved July 16, 2024, from https://datausa.io/profile/soc....
22.
Demir, S. (2020). The role of self-efficacy in job satisfaction, organizational commitment, motivation and job involvement. Eurasian Journal of Educational Research, 20(85), 205-224. https://doi.org/10.14689/ejer.....
23.
Duncan, P. W., Bode, R. K., Lai, S. M., Perera, S., & Glycine Antagonist in Neuroprotection Americas Investigators. (2003). Rasch analysis of a new stroke-specific outcome scale: The stroke impact scale. Archives of Physical Medicine and Rehabilitation, 84(7), 950-963. https://doi.org/10.1016/S0003-....
24.
Embretson, S. E., & Reise, S. P. (2013). Item response theory. Psychology Press. https://doi.org/10.4324/978141....
25.
Enochs, L. G., & Riggs, I. M. (1990). Further development of an elementary science teaching efficacy belief instrument: A preservice elementary scale. School Science and Mathematics, 90(8), 694-706. https://doi.org/10.1111/j.1949....
26.
Enochs, L. G., Smith, P. L., & Huinker, D. (2000). Establishing factorial validity of the mathematics teaching efficacy beliefs instrument. School Science and Mathematics, 100(4), 194-202. https://doi.org/10.1111/j.1949....
27.
Fisher, W. P. (1994). The Rasch debate: Validity and revolution in educational measurement. In M. Wilson (Ed.), Objective measurement (Vol. 2, pp. 36-72). Ablex.
28.
Gibson, S., & Dembo, M. H. (1984). Teacher efficacy: A construct validation. Journal of Educational Psychology, 76(4), 569-582. https://doi.org/10.1037//0022-....
29.
Guskey, T. R. (1981). Measurement of the responsibility teachers assume for academic successes and failures in the classroom. Journal of Teacher Education, 32(3), 44-51. https://doi.org/10.1177/002248....
30.
Guskey, T. R., & Passaro, P. D. (1994). Teacher efficacy: A study of construct dimensions. American Educational Research Journal, 31(3), 627-643. https://doi.org/10.3102/000283....
31.
Hammack, R., & Ivey, T. (2017a). Elementary teachers’ perceptions of engineering and engineering design. Journal of Research in STEM Education, 3(1/2), 48-68. https://doi.org/10.51355/jstem....
32.
Hammack, R., & Ivey, T. (2017b). Examining elementary teachers’ engineering self‐efficacy and engineering teacher efficacy. School Science and Mathematics, 117(1-2), 52-62. https://doi.org/10.1111/ssm.12....
33.
Henson, R. K. (2001). Teacher self-efficacy: Substantive implications and measurement dilemmas [Paper presentation]. The annual meeting of the Educational Research Exchange, College Station, TX.
34.
Hsu, M. C., Purzer, S., & Cardella, M. E. (2011). Elementary teachers’ views about teaching design, engineering, and technology. Journal of Pre-College Engineering Education Research, 1(2), Article 5.
35.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/107055....
36.
Huang, S., Yin, H., & Lv, L. (2019). Job characteristics and teacher well-being: The mediation of teacher self-monitoring and teacher self-efficacy. Educational Psychology, 39(3), 313-331. https://doi.org/10.1080/014434....
37.
Hynes, M. M., Mathis, C., Purzer, S., Rynearson, A., & Siverling, E. (2017). Systematic review of research in P-12 engineering education from 2000-2015. International Journal of Engineering Education, 33(1), 453-462.
38.
Hyrkäs, K., Appelqvist-Schmidlechner, K., & Oksa, L. (2003). Validating an instrument for clinical supervision using an expert panel. International Journal of Nursing Studies, 40(6), 619-625. https://doi.org/10.1016/s0020-....
39.
Kang, E. J., Donovan, C., & McCarthy, M. J. (2018). Exploring elementary teachers’ pedagogical content knowledge and confidence in implementing the NGSS science and engineering practices. Journal of Science Teacher Education, 29(1), 9-29. https://doi.org/10.1080/104656....
40.
Karpudewan, M., Krishnan, P., Roth, W. M., & Ali, M. N. (2023). What research says about the relationships between Malaysian teachers’ knowledge, perceived difficulties and self-efficacy, and practicing STEM teaching in schools. The Asia-Pacific Education Researcher, 32(3), 353-365. https://doi.org/10.1007/s40299....
41.
Kaya, E., Deniz, H., & Yesilyurt, E. (2023). Toward developing a valid and reliable assessment of adults’ nature of engineering views. Journal of Engineering Education, 112(3), 634-673. https://doi.org/10.1002/jee.20....
42.
Kaya, E., Newley, A., Deniz, H., Yesilyurt, E., & Newley, P. (2017). Introducing engineering design to a science teaching methods course through educational robotics and exploring changes in views of pre-service elementary teachers. Journal of College Science Teaching, 47(2), 66-75. https://doi.org/10.2505/4/jcst....
43.
Kaya, E., Newley, A., Yesilyurt, E., & Deniz, H. (2020). Measuring computational thinking teaching efficacy beliefs of preservice elementary teachers. Journal of College Science Teaching, 49(6), 55-64. https://doi.org/10.1080/004723....
44.
Kaya, E., Yesilyurt, E., Newley, A., & Deniz, H. (2019). Examining the impact of a computational thinking intervention on pre-service elementary science teachers’ computational thinking teaching efficacy beliefs, interest and confidence. Journal of Computers in Mathematics and Science Teaching, 38(4), 385-392. Retrieved July 16, 2024 from https://www.learntechlib.org/p....
45.
Klassen, R. M., & Tze, V. M. C. (2014). Teachers’ self-efficacy, personality, and teaching effectiveness: A meta-analysis. Educational Research Review, 12, 59-76. https://doi.org/10.1016/j.edur....
46.
Kuvac, M., & Koc, I. (2022). Enhancing preservice science teachers’ perceptions of engineer and engineering through STEM education: A focus on drawings as evidence. Research in Science & Technological Education, 41(4), 1539-1559. https://doi.org/10.1080/026351....
47.
Landis, J. R., & Koch, G. G. (1977). The Measurement of observer agreement for categorical data. Biometrics, 33(1), Article 159. https://doi.org/10.2307/252931....
48.
Lazarides, R., Buchholz, J., & Rubach, C. (2018). Teacher enthusiasm and self-efficacy, student-perceived mastery goal orientation, and student motivation in mathematics classrooms. Teaching and Teacher Education, 69, 1-10. https://doi.org/10.1016/j.tate....
49.
Linacre, J. M. (2024a). A user’s guide to Winsteps ministeps Rasch-model computer programs. Retrieved July, 16, 2024, from https://www.winsteps.com/winma....
50.
Linacre, J. M. (2024b). Sample size and item calibration (or person measure) stability. Institute for Objective Measurement. Retrieved July 16, 2024, from https://www.rasch.org/rmt/rmt7....
51.
Livers, S. D., Zelkowski, J., Harbour, K. E., McDaniel, S. C., & Gleason, J. (2019). An examination of the relationships of mathematics self-efficacy and teaching practices among elementary, secondary, and special education educators. Investigations in Mathematics Learning, 12(2), 96-109. https://doi.org/10.1080/194775....
52.
Lucero, M., Valcke, M., & Schellens, T. (2013). Teachers’ beliefs and self-reported use of inquiry in science education in public primary schools. International Journal of Science Education, 35(8), 1407-1423. https://doi.org/10.1080/095006....
53.
Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382-386. https://doi.org/10.1097/000061....
54.
Ma, K., Luo, J., Cavanagh, M., Dong, J., & Sun, M. (2023). Measuring teacher self-efficacy: Validating a new comprehensive scale among Chinese pre-service teachers. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.....
55.
Mallinson, T., Stelmack, J., & Velozo, C. (2004). A comparison of the separation ratio and coefficient α in the creation of minimum item sets. Medical Care, 42(1), 1-17. https://doi.org/10.1097/01.mlr....
56.
Midgley, C., Feldlaufer, H., & Eccles, J. S. (1989). Change in teacher efficacy and student self- and task-related beliefs in mathematics during the transition to junior high school. Journal of Educational Psychology, 81(2), 247-258. https://doi.org/10.1037//0022-....
57.
Mojavezi, A., & Tamiz, M. P. (2012). The impact of teacher self-efficacy on the students’ motivation and achievement. Theory and Practice in Language Studies, 2(3), 483-491. https://doi.org/10.4304/tpls.2....
58.
NASEM. (2020). Building capacity for teaching engineering in K-12 education. National Academies Press. https://doi.org/10.17226/25612.
59.
NGSS Lead States. (2013). Next generation science standards: For states, by states. The National Academies Press.
60.
Nie, Y., Tan, G. H., Liau, A. K., Lau, S., & Chua, B. L. (2012). The roles of teacher efficacy in instructional innovation: Its predictive relations to constructivist and didactic instruction. Educational Research for Policy and Practice, 12(1), 67-77. https://doi.org/10.1007/s10671....
61.
Pajares, F. (1996). Self-efficacy beliefs in academic settings. Review of Educational Research, 66(4), 543-578. https://doi.org/10.3102/003465....
62.
Perera, H. N., & John, J. E. (2020). Teachers’ self-efficacy beliefs for teaching math: Relations with teacher and student outcomes. Contemporary Educational Psychology, 61, Article 101842. https://doi.org/10.1016/j.cedp....
63.
Pleasants, J., & Olson, J. K. (2019). What is engineering? Elaborating the nature of engineering for K-12 education. Science Education, 103(1), 145-166. https://doi.org/10.1002/sce.21....
64.
Purzer, Ş., Quintana‐Cifuentes, J., & Menekse, M. (2022). The honeycomb of engineering framework: Philosophy of engineering guiding pre-college engineering education. Journal of Engineering Education, 111(1), 19-39. https://doi.org/10.1002/jee.20....
65.
Rasch, G. (1993). Probabilistic models for some intelligence and attainment tests. MESA Press.
66.
Ritter, J. M., Boone, W. J., & Rubba, P. A. (2001). Development of an instrument to assess prospective elementary teacher self-efficacy beliefs about equitable science teaching and learning (SEBEST). Journal of Science Teacher Education, 12(3), 175-198. https://doi.org/10.1023/a:1016....
67.
Rose, J. S., & Medway, F. J. (1981). Measurement of teachers’ beliefs in their control over student outcome. The Journal of Educational Research, 74(3), 185-190. https://doi.org/10.1080/002206....
68.
Ross, J. A., Cousins, J. B., Gadalla, T., & Hannay, L. (1999). Administrative assignment of teachers in restructuring secondary schools: The effect of out-of-field course responsibility on teacher efficacy. Educational Administration Quarterly, 35(5), 782-805. https://doi.org/10.1177/001316....
69.
Rotter, J. B. (1966). Generalized expectancies for internal versus external control of reinforcement. Psychological Monographs: General and Applied, 80(1), Article 1. https://doi.org/10.1037/h00929....
70.
Rubeck, M. E., & Enochs, E. G. (1991). A path analytical model of variables that influence science and chemistry teaching self-efficacy and outcome expectancy in middle school science teachers [Paper presentation]. The annual meeting of the National Association for Research in Science Teaching, Fontana, WI.
71.
Savran, A., & Çakiroglu, J. (2003). Differences between elementary and secondary preservice science teachers’ perceived efficacy beliefs and their classroom management beliefs. Turkish Online Journal of Educational Technology, 2(4), 15-20.
72.
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of Educational Research, 99(6), 323-338. https://doi.org/10.3200/joer.9....
73.
Sehgal, P., Nambudiri, R., & Mishra, S. K. (2017). Teacher effectiveness through self-efficacy, collaboration and principal leadership. International Journal of Educational Management, 31(4), 505-517. https://doi.org/10.1108/ijem-0....
74.
Shahzad, K., & Naureen, S. (2017). Impact of teacher self-efficacy on secondary school students’ academic achievement. Journal of Education and Educational Development, 4(1), Article 48. https://doi.org/10.22555/joeed....
75.
Sia, A. P. (1992). Preservice elementary teachers’ perceived efficacy in teaching environmental education: A preliminary study [Paper presentation]. The annual meeting of the North American Association for Environmental Education, Toronto.
76.
Soodak, L. C., & Podell, D. M. (1993). Teacher efficacy and student problem as factors in special education referral. The Journal of Special Education, 27(1), 66-81. https://doi.org/10.1177/002246....
77.
Temiz, T., & Topcu, M. S. (2013). Preservice teachers’ teacher efficacy beliefs and constructivist-based teaching practice. European Journal of Psychology of Education, 28(4), 1435-1452. https://doi.org/10.1007/s10212....
78.
Trygstad, P. J., Malzahn, K. A., Banilower, E. R., Plumley, C. L., & Bruce, A. D. (2020). Are all students getting equal access to high-quality science education? Data from the 2018 NSSME+. Horizon Research, Inc. Retrieved July 16, 2024, from https://horizon-research.com/N....
79.
Trygstad, P. J., Smith, P. S., Banilower, E. R., & Nelson, M. M. (2013). The status of elementary science education: Are we ready for the next generation science standards? Horizon Research, Inc.
80.
Tschannen-Moran, M., & Hoy, A. W. (2001). Teacher efficacy: Capturing an elusive construct. Teaching and Teacher Education, 17(7), 783-805. https://doi.org/10.1016/s0742-....
81.
Tschannen-Moran, M., Hoy, A. W., & Hoy, W. K. (1998). Teacher efficacy: Its meaning and measure. Review of Educational Research, 68(2), 202-248. https://doi.org/10.3102/003465....
82.
Unfried, A., Rachmatullah, A., Alexander, A. & Wiebe, E. (2022). An alternative to STEBI-A: Validation of the T-STEM science scale. International Journal of STEM Education, 9, Article 24. https://doi.org/10.1186/s40594....
83.
van Uden, J. M., Ritzen, H., & Pieters, J. M. (2014). Engaging students: The role of teacher beliefs and interpersonal teacher behavior in fostering student engagement in vocational education. Teaching and Teacher Education, 37, 21-32. https://doi.org/10.1016/j.tate....
84.
Wright, B. D. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370.
85.
Wright, B. D., & Linacre, J. M. (1994). The Rasch model as a foundation for the Lexile framework. Retrieved July 16, 2024, from https://metametricsinc.com/res....
87.
Xia, Y., & Yang, Y. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51, 409-428. https://doi.org/10.3758/s13428....
88.
Xie, Z., Gadepalli, C., & Cheetham, B. (2018). A study of chance-corrected agreement coefficients for the measurement of multi-rater consistency. International Journal of Simulation: Systems, Science & Technology, 19(2), 10.1-10.9. https://doi.org/10.5013/ijssst....
89.
Yesilyurt, E., Deniz, H., & Kaya, E. (2021). Exploring sources of engineering teaching self-efficacy for pre-service elementary teachers. International Journal of STEM Education, 8(1), Article 42. https://doi.org/10.1186/s40594....
90.
Yoon Yoon, S., Evans, M. G., & Strobel, J. (2014). Validation of the teaching engineering self‐efficacy scale for K‐12 teachers: A structural equation modeling approach. Journal of Engineering Education, 103(3), 463-485. https://doi.org/10.1002/jee.20....
91.
Zee, M., & Koomen, H. M. Y. (2016). Teacher self-efficacy and its effects on classroom processes, student academic adjustment, and teacher well-being. Review of Educational Research, 86(4), 981-1015. https://doi.org/10.3102/003465....
Share
RELATED ARTICLE
| eISSN: | 1305-8223 |
| ISSN: | 1305-8215 |
We process personal data collected when visiting the website. The function of obtaining information about users and their behavior is carried out by voluntarily entered information in forms and saving cookies in end devices. Data, including cookies, are used to provide services, improve the user experience and to analyze the traffic in accordance with the Privacy policy. Data are also collected and processed by Google Analytics tool (more).
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.
