SciELO - Scientific Electronic Library Online

 
vol.52 número3Intervención comunitaria en el escenario de un brote de la COVID-19Evaluación de la contaminación por aflatoxina B1 en arroz y maíz índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Articulo

Indicadores

  • No hay articulos citadosCitado por SciELO

Links relacionados

  • No hay articulos similaresSimilares en SciELO

Compartir


Revista Cubana de Medicina Militar

versión On-line ISSN 1561-3046

Rev. cuban. med. mil. vol.52 no.3 La Habana jul.-set. 2023  Epub 01-Sep-2023

 

Research article

Changes in the levels of immunological markers after treatment in patients with allergic rhinitis

Cambios en los niveles de marcadores inmunológicos después del tratamiento en pacientes con rinitis alérgica

0000-0003-4468-4902Quan Thanh Nam1  , 0000-0001-8831-7579Nghiem Duc Thuan1  *  , 0009-0004-5221-2432Vu Minh Thuc2  , 0000-0002-1019-0800Do Lan Huong1  , 0009-0009-1472-6682Nguyen Anh Cuong1 

1Vietnam Military Medical University. 103 Military Hospital. Department of Otorhinolaryngology. Hanoi, Vietnam.

2National Otorhinolaryngology Hospital of Vietnam. Department of Allergy and Immunology. Hanoi, Vietnam.

ABSTRACT

Introduction:

Monitoring changes in the levels of immune markers is of great significance in evaluating the effectiveness of treatment in patients with allergic rhinitis.

Objectives:

Determine the change in the concentration of immune markers after treatment in patients with allergic rhinitis caused by cotton dust.

Methods:

A descriptive, single-group, comparative before and after intervention study on 52 patients with allergic rhinitis caused by cotton dust. Comparison of immunological markers results before and after 36 months of treatment.

Results:

Total IgE concentration after treatment decreased, the median decreased from 1227.756 U/mL to 676.805 UI/mL. Serum levels of IgG, IgG4, and IgG1 in patients after treatment increased compared to before (p< 0.001). The cytokines also changed in the direction of no longer responding toward allergy. Median IL-17 decreased from 1.752 mg/dL to 0.417 mg/dL.

Conclusion:

In patients with allergic rhinitis after specific sublingual desensitization treatment, IgE levels and cytokines such as IL-6 and IL-17 are significantly reduced and IgG, IgG4 and IgG1 levels are increased after treatment.

Key words: allergic rhinitis; cotton dust; IgE; IgG; cytokines

RESUMEN

Introducción:

El monitoreo de los cambios en los niveles de marcadores inmunes es de gran importancia para evaluar la efectividad del tratamiento en pacientes con rinitis alérgica.

Objetivos:

Determinar el cambio en la concentración de marcadores inmunes después del tratamiento, en pacientes con rinitis alérgica causada por polvo de algodón.

Métodos:

Estudio descriptivo, monogrupo, comparativo antes y después de la intervención, en 52 pacientes con rinitis alérgica por polvo de algodón. Se compararon resultados de marcadores inmunológicos antes y después de 36 meses de tratamiento.

Resultados:

La concentración de IgE total después del tratamiento disminuyó, la mediana disminuyó de 1227,756 U/mL a 676,805 UI/mL. Los niveles séricos de IgG, IgG4 e IgG1 en pacientes, después del tratamiento, aumentaron (p< 0,001). Las citocinas también cambiaron en dirección a ausencia de respuesta a la alergia. La mediana de IL-17 disminuyó de 1,752 mg/dL a 0,417 mg/dL.

Conclusión:

En pacientes con rinitis alérgica, después del tratamiento específico de desensibilización sublingual, los niveles de IgE y citocinas como IL-6 e IL-17 se reducen significativamente y los niveles de IgG, IgG4 e IgG1 aumentan.

Palabras-clave: rinitis alérgica; polvo de algodón; IgE; IgG; citoquinas

INTRODUCTION

Allergic rhinitis (AR) is a common disease affecting all subjects, from children to the elderly. The disease affects 10% to 40% of adults and 2% to 25% of children worldwide.1 According to one study, AR prevalence in 4 geographic regions: Asia, Europe, America, and Africa, was reported to be 15%-25%. Children, adolescents, and young adults are the groups most affected by AR.2

Diagnosis is based on clinical findings, positive skin prick tests, elevated serum IgE levels, and allergen-specific IgE antibodies.3) The recommended treatment depends on the severity of the disease. In AR treatment methods, specific desensitization treatment (SDT) is a pathogenesis-based treatment with higher efficiency than other treatments. Some advantages of this method are better clinical progress, reduced cost in treatment, and simple, effective, and safe use, especially can be used for adults and children.4 After treatment, there is often a big change in immune markers.5 Therefore, monitoring changes in the levels of immune markers is of great significance in assessing the effectiveness of treatment.

Therefore, this study was carried out to determine the change in the concentration of immune markers after treatment in patients with allergic rhinitis caused by cotton dust.

METHODS

Design: a descriptive, single-group, pre- and post-intervention comparative clinical study to evaluate the change in levels of immune markers after 36 months (3 years) of treatment.

Subjects: workers at garment factories Z176 and X20 under the Ministry of National Defense, Vietnam, from November 2021 to August 2022, satisfying the criteria for participating in the study.

Criteria for selection:

  • Workers diagnosed with AR due to cotton dust allergen:

  • Consent to participate in the study.

  • Eligible for outpatient treatment for a minimum of 3 years.

  • Complete research records.

  • If the patient was suffering from an acute bacterial infection in the nose and sinuses in AR patients who meet the above selection criteria, the research team will finish the treatment of the superinfection and then continue to take it into the study.

  • Patients being treated with drugs: antihistamines, corticosteroids (local or systemic), after stopping treatment for more than 2 weeks, will be selected for the study if they met the other selection criteria.

Sample size: based on the average estimation formula, as follows:

Where:

  • n: minimum study sample size.

  • p1: percentage of patients with AR due to cotton dust allergen having a positive skin prick test before treatment, the investigation results in the descriptive study were 100%.

  • p2: percentage of patients with AR due to cotton dust allergen having positive skin prick test after treatment. According to research by Thuan HQ,6 the percentage of patients with positive skin prick tests after sublingual SDT with house dust mite allergens was 75.56%. Selected p2 value of 0.76.

  • p = (p1-p2)/2 = 0.12

  • α: the probability of type I error. In this study, chose α= 0.05, then Z1- α/2= 1.96.

  • β: the probability of type II error, this study chose β= 0.2, then Z1- β = 0.842.

According to the above formula, n= 27 patients were calculated. Adjusted for dropout, with a predicted dropout rate of 25%, the minimum number of patients to include in the intervention study was 36. In fact, 52 patients met the full study criteria. Specifically: 39 patients at factory Z176 and 13 patients at factory X20.

Variables: Evaluation of changes in immune markers before and after 36 months of treatment, including IgE levels, IgG levels, IgG4 levels, IgG1 levels, serum cytokines including IL-2, IL-8, IFN-γ, IL-12, IL-6, IL-17.

Data analysis: data were coded and entered, and analyzed using SPSS 22.0 software. The quantitative variables tested for normal distribution, described through mean, standard deviation, maximum and minimum values. For variables with non-normal distribution: describe through median values, min-max, compare medians of 2 independent groups by Mann-Whitney test, of 2 paired groups by Wilcoxon test. Any variable with p< 0.05 was considered to be statistically significant.

Bioethical aspects: The patient's identity is confidential, and only used for analysis as a group.

RESULTS

Serum IgE concentration in patients after treatment decreased statistically significantly with p< 0.001 compared to before treatment (table 1).

Table 1 Changes in serum IgE levels before and after treatment (unit: UI/mL) 

Serum IgG levels in patients after treatment increased statistically significantly with p< 0.001 compared to before treatment (table 2).

Table 2 Changes in serum IgG levels before and after treatment (unit: mg/dL) 

Serum levels of IgG1, IgG4 in patients after treatment increased statistically significantly with p< 0.001 compared to before treatment (table 3).

Table 3 Changes in serum IgG4, IgG1 levels before and after treatment (n= 52) 

Serum levels of IL-2, IL-8, and IFN-γ of patients after treatment increased more than before treatment. However, the difference was not statistically significant, with p> 0.05. Serum IL-12 and IL-6 levels in patients increased more after treatment. The difference was statistically significant with p< 0.05. The change in patient serum IL-17 levels before and after 3 years of treatment was statistically significant with p< 0.001 (table 4).

Table 4 Changes in serum cytokine levels (pg/mL) (n= 43) 

DISCUSSION

Change in total IgE concentration

Serum IgE levels in atopic patients (asthma, AR, dermatitis, urticaria, Quincke's edema, drug allergies) are often high, sometimes very high. Accompanied by an increase in the total serum IgE concentration, there is an appropriate amount of allergen-associated IgE. Quantitative results of total and specific IgE antibody levels before and after immunotherapy treatment, are important in evaluating the effectiveness of the treatment method. If the serum IgE level has decreased after the treatment, the applied treatment has been effective.

After 36 months of SDT treatment with cotton dust allergen at the concentration of 300 IR/mL, the serum IgE concentration decreased markedly; the median IgE before treatment was 1227.756 UI/mL, and after treatment was 676.805 UI/mL (table 1). Compared with before treatment, this result had a statistically significant difference (p< 0.001). Some domestic authors also show similar results. Research by Huynh Quang Thuan6) showed that the mean total serum IgE concentration after AR-specific immunotherapy due to house dust mite allergens was 357.21. The lowest value of total serum IgE was 78.1 UI/mL; the highest was 851.3 UI/mL. When analyzing each patient case, was found that before treatment: The lowest value of serum IgE was 575.424 UI/mL, and the highest was 38008.333 UI/mL. While after treatment: The lowest value of serum IgE was 177.855 UI/mL, and the highest was 24762.500 UI/mL.

Although the results of the total IgE concentration after treatment were still high despite the significant reduction in clinical symptoms and a marked decrease in the skin prick test, this is difficult to explain when compared with the total IgE concentration of normal people. When each specific case was studied, was found that IgE levels before and after treatment were higher in patients with combined allergic disease than those with AR alone. The study results identified a gradual decrease of IgE in AR patients with cotton dust allergen being treated with SDT. This result was consistent with the improvement of the clinical picture and a significant reduction in the degree of skin prick test positivity. Thus, after 3 years of SDT treatment, the patient's blood IgE decreased significantly, indicating the effectiveness of the treatment.

Change in IgG group concentration

The increase in serum IgG levels following SDT has been shown in recent decades to be mainly due to increased IgG4 and IgG1. Many studies have quantified chemical mediators in 2 groups of AR patients, with 1 group being treated with the allergen. The results showed that in the allergen-treated group, there was a marked reduction in the levels of histamine and prostaglandin E2 compared to the group without allergen treatment. Experimental studies have also shown that the enclosing antibody (IgG4), which is formed after treatment with SDT, can reduce inflammatory phenomena in AR.7

Other author has also shown that SDT increases serum IgG4 levels (this antibody can compete with IgE at the receptors of mastocytes and basophils) and regulates Th1 and Th2 subgroups, thereby reducing IgE production. The author also confirmed this in the study of Demšar LA et al.8

In current study, after 36 months of SDT treatment with cotton dust allergen at 300 concentrations of IR/mL, the patient's IgG concentration increased significantly compared to before treatment (p< 0.001). At the same time, the levels of IgG1 and IgG4 increased significantly. The concentration of IgG1 after treatment was 1021.885 (106.287 - 1852.531) (mg/dL) higher than 563.025 (190.237 - 1039.985) mg/dL before treatment, with p< 0.001.

The concentration of IgG4 after treatment was 94.792 (28.472 - 604.536) (mg/dL), higher than 45.937 (4.823 - 362.322) (mg/dL) before treatment (p< 0.001). It has been shown that after SDT treatment with cotton dust allergen, AR patients have increased the number of protective antibodies. Jutel M. et al.9) also recorded similar results. In their 18-month study, Queirós M.G. et al.10 conducted SDT with a control group; the results showed that specific IgE levels decreased, IgG1 and IgG4 increased simultaneously, which is a significant remission of clinical symptoms and skin prick test results. That is also the result of the study of Stylianou E. et al.11 when treating SDT patients with AR for 3 years. This showed the effectiveness of current method on patients.

Changes in serum cytokines concentration

Interleukin-17 and Interleukin-6 (IL-17, IL-6)

AR is considered an excellent model for studying allergic inflammation, with findings likely related to lower airway inflammation in allergic asthma. AR is considered a Th2-mediated disease involving IL-4, IL-5, and IL-13 in the pathophysiology. Recently, however, studies have shown that Th17 cells may be involved in the neutrophil infiltration that occurs during the acute phase of an allergic reaction.12 IL-17 is the main cytokine produced by Th17 cells, with proinflammatory and chemotactic biologic activities. Results from study of Hofmann MA. et al.13 show the correlation between serum IL-17 and clinical symptoms in AR patients. They proposed to apply IL-17 in serum as an indicator of allergy severity. In the study of Qiu Q. et al.,14 it was shown that the concentration of IL-17 in the disease group was higher than that in the control group, and the concentration of IL-17 in the group of patients decreased significantly compared to before treatment. All authors consider IL-17 as a marker to evaluate the effectiveness of immunotherapy. Therefore, in current study, we evaluated IL-17 instead of IL-4, IL-5, and IL-13.

According to the results of table 4, after 3 years of SDT treatment, a positive change was also recorded. Before treatment, the median IL-17 concentration was 1.752 (0.209 - 15.910) (pg/mL); after treatment, the median IL-17 concentration was 0.417 (0.209 - 7.970) (pg/mL), with significant remission statistically. Thus, current research results are consistent with other authors.14

IL-6 is a cytokine that, along with TNF-α and IL-1β, has traditionally been considered more of a biomarker of ongoing inflammation than a regulatory cytokine capable of modulating the immune response. However, recent studies suggest that IL-6 is vital in promoting Th2 differentiation of CD4+ T cells while suppressing Th1 differentiation.15 IL-6 may also modulate the intensity of the immune response by inhibiting regulatory T cell (Treg) development.16 More recently, several studies have shown that IL-6 and TGF-β promote the generation of Th17 cells.17 Many authors have evaluated IL-6 changes before and after AR treatment.18,19 Current study evaluating IL-6 changes after 3 years of SDT treatment showed reduced IL-6 levels. Before treatment, the median IL-6 concentration was 35.503 (1.348-738.550) (pg/mL); after treatment, the median IL-6 concentration was 23.233 (1.348-67.533) (pg/mL), a significant reduction statistically. Barberi S. et al.19 also reported a significant reduction in IL-6 after sublingual SDT.19

Interferon gamma and interleukin 12 (IFN-γ, IL-12)

The expression of AR results from an interaction between the environment, the immune system, and genetic susceptibility. Several cells, cytokines, and chemokines coordinate and maintain allergic inflammation. Cytokines play an essential role in mediating allergic inflammation. The importance of Th2-cell cytokines in developing allergic sensitization and the pathophysiology of allergic inflammation is well-defined. While healthy subjects were dominated by Th1-type cells, the nasal mucosa and epithelial tissues of AR subjects were dominated by Th2-type lymphocytes.

For Th1, the well-known cytokine, IFN-γ, is a potent and relatively specific inhibitor of IgE and IgG4 synthesis by IL-4-induced B cells. The previous study by Degirmenci PB. et al.14 also showed that serum IFN-γ levels in AR patients were detected at a lower level than in controls, and an inverse relationship between symptom scores and concentrations of this cytokine.20

Meanwhile, IL-12 is produced by B cells, macrophages, and dendritic cells and mainly regulates Th1 cell differentiation while suppressing the expansion of Th2 cell lines. These cytokines are involved in the pathogenesis of allergic diseases. In this context, the production of IL-12 and IFN-γ in asthma was found to be decreased. Together with IL-18, IL-12 induces anti-CD40-activated B cells to induce IFN-γ, which inhibits IL-4-dependent IgE production.21

In this study, the change in IFN-γ and IL-12 levels after 3 years of treatment was evaluated. The study results showed that the median concentration of IFN-γ and IL-12 before treatment was 0.886 (0.099 - 3.606) and 1.401 (0.225 - 5.313) (pg/mL), respectively. These concentrations after treatment were 1.105 (0.099-5.010) and 2.201 (0.225 - 26.503), respectively (pg/mL). The change of these values before and after treatment is consistent with the review study of other authors.22 The increase in serum IL-12 and IFN-γ and the improvement in the patient's nasal symptoms after treatment suggest that the treatment is effective.

Overall, the increase in IgG, and IgG4 levels, the decrease in total IgE levels, and the positive change in cytokines after treatment demonstrated an altered immune response, expressed by localization of the immune system. Skin prick tests were significantly reduced in positivity. All these changes are consistent with clinical improvement after treatment. These results demonstrate an effective treatment, similar to the conclusions of Liu X. et al.23 when reviewing several efficacy studies of sublingual specific immunity in Asia.

In conclusion, patients with allergic rhinitis after specific sublingual desensitization treatment, the levels of IgE and cytokines such as IL-6 and IL-17 were significantly reduced, and the levels of IgG, IgG4, and IgG1 were increased after treatment.

BIBLIOGRAPHIC REFERENCES

1.  Yuan Z, Luo Z. Increasing prevalence of allergic rhinitis in China. Allergy, asthma & immunology research. 2019; 11(2):156-69. DOI: 10.4168/aair.2019.11.2.156 [ Links ]

2.  Passali D, Cingi C, Staffa P, Passali F, Muluk NB, Bellussi ML. The International Study of the Allergic Rhinitis Survey: outcomes from 4 geographical regions. Asia Pacific Allergy. 2018; 8(1):e7. DOI: 10.5415/apallergy.2018.8.e7 [ Links ]

3.  Muluk NB, Bafaqeeh SA, Cingi C. Anti-IgE treatment in allergic rhinitis. International Journal of Pediatric Otorhinolaryngology. 2019; 127:109674. DOI: 10.1016/j.ijporl.2019.109674 [ Links ]

4.  Alamri RA, Aljabri GH, Tahlawi R, Aljabri HA, Aljabri SGH. Immunotherapy in the Treatment of Allergic Rhinitis in Children. Cureus. 2022; 14(12):e32464. DOI: 10.7759/cureus.32464 [ Links ]

5.  Gabet S, Rancière F, Just J, de Blic J, Lezmi G, Amat F, Momas I. Asthma and allergic rhinitis risk depends on house dust mite specific IgE levels in PARIS birth cohort children. World Allergy Organization Journal. 2019;12(9): 100057. DOI: 10.1016/j.waojou.2019.100057 [ Links ]

6.  Thuan HQ. Research on standardization of allergen Dermatophagoides Pteronyssinus and its application in the diagnosis and specific immunotherapy of allergic rhinitis [Ph.D thesis]. Hanoi: Vietnam Military Medical University; 2012. [access: 27/04/2012]. Available at: Available at: http://luanan.nlv.gov.vn/luanan?a=d&d=TTcFlGvGViZi2012.1.1 6.  [ Links ]

7.  Smoldovskaya O, Feyzkhanova G, Voloshin S, Arefieva A, Chubarova A, Pavlushkina L, et al. Allergen-specific IgE and IgG4 patterns among patients with different allergic diseases. World Allergy Organization Journal. 2018; 11:35. DOI: 10.1186/s40413-018-0220-5 [ Links ]

8.  Demš ar LA, Korošec P, Košnik M, Zidarn M, Rijavec M. Hymenoptera venom immunotherapy: immune mechanisms of induced protection and tolerance. Cells. 2021; 10(7):1575. DOI: 10.3390/cells10071575 [ Links ]

9.   Jutel M, Jaeger L, Suck R, Meyer H, Fiebig H, Cromwell O. Allergen-specific immunotherapy with recombinant grass pollen allergens. Journal of Allergy and Clinical Immunology. 2005; 116(3):608-13. DOI: 10.1016/j.jaci.2005.06.004 [ Links ]

10.  Queirós MG, Silva DA, Siman IL, Ynoue LH, Araújo NS, Pereira FL, et al. Modulation of mucosal/systemic antibody response after sublingual immunotherapy in mite‐allergic children. Pediatric Allergy and Immunology. 2013; 24(8):752-61. DOI: 10.1111/pai.12163 [ Links ]

11.  Stylianou E, Ueland T, Borchsenius F, Michelsen AE, Øvstebø R, Eirik MT, et al. Specific allergen immunotherapy: effect on IgE, IgG4 and chemokines in patients with allergic rhinitis. Scandinavian journal of clinical and laboratory investigation. 2016; 76(2):118-27. DOI: 10.3109/00365513.2015.1110856 [ Links ]

12.  Scadding G. Cytokine profiles in allergic rhinitis. Current allergy and asthma reports. 2014; 14:1-8. DOI: 10.1007/s11882-014-0435-7 [ Links ]

13.  Hofmann MA, Fluhr JW, Ruwwe‐Glösenkamp C, Stevanovic K, Bergmann KC, Zuberbier T. Role of IL‐17 in atopy-A systematic review. Clinical and Translational Allergy. 2021; 11(6): e12047. DOI: 10.1002/clt2.12047 [ Links ]

14.  Qiu Q, Lu H, Lu C, Chen S, Han H. Variations in TGF-beta, IL-10, and IL-17 after specific immunotherapy and correlations with symptoms in patients with allergic rhinitis. Journal of investigational allergology & clinical immunology. 2012[access: 01/10/2014]; 22(4):311-2. Available at: Available at: https://pubmed.ncbi.nlm.nih.gov/22812212/ 14.  [ Links ]

15.  Bachus H, McLaughlin E, Lewis C, Papillion AM, Benveniste EN, Hill DD, León B, et al. IL-6 prevents Th2 cell polarization by promoting SOCS3-dependent suppression of IL-2 signaling. Cellular & Molecular Immunology. 2023; 1-15. DOI: 10.1038/s41423-023-01012-1 [ Links ]

16.  Goswami TK, Singh M, Dhawan M, Mitra S, Emran TB, Rabaan AA, Dhama K, et al. Regulatory T cells (Tregs) and their therapeutic potential against autoimmune disorders-Advances and challenges. Human Vaccines & Immunotherapeutics. 2022; 18(1):2035117. DOI: 10.1080/21645515.2022.2035117 [ Links ]

17.  Wan Z, Zhou Z, Liu Y, Lai Y, Luo Y, Peng X, et al. Regulatory T cells and T helper 17 cells in viral infection. Scandinavian Journal of Immunology. 2020; 91(5):e12873. DOI: 10.1111/sji.12873 [ Links ]

18.  Gao S, Yu L, Zhang J, Li X, Zhou J, Zeng P, et al. Expression and clinical significance of VCAM-1, IL-6, and IL-17A in patients with allergic rhinitis. Annals of Palliative Medicine. 2021; 10:4516-22. DOI: 10.21037/apm-21-546 [ Links ]

19.  Barberi S, Villa MP, Pajno GB, La Penna F, Barreto M, Cardelli P, et al. Immune response to sublingual immunotherapy in children allergic to mites. Journal of biological regulators and homeostatic agents. 2011[access: 01/10/2011]; 25(4):627-34. Available at: Available at: https://europepmc.org/article/med/22217994 19.  [ Links ]

20.  Bayrak DP, Aksun S, Altin Z, Bilgir F, Arslan IB, Colak H, et al. Allergic rhinitis and its relationship with IL-10, IL-17, TGF-β, IFN-γ, IL 22, and IL-35. Disease markers. 2018:1-6. DOI: 10.1155/2018/9131432 [ Links ]

21.  Song L, Luan B, Xu QR, Wang XF. Effect of TLR7 gene expression mediating NF-κB signaling pathway on the pathogenesis of bronchial asthma in mice and the intervention role of IFN-γ. Eur Rev Med Pharmacol Sci. 2021; 25(2):866-79. DOI: 10.26355/eurrev_202101_24655 [ Links ]

22.  Xie S, Fan R, Tang Q, Cai X, Zhang H, Wang F, et al. Identification of robust biomarkers for early predicting efficacy of subcutaneous immunotherapy in children with house dust mite-induced allergic rhinitis by multiple cytokine profiling. Frontiers in Immunology. 2022; 12: 5866. DOI: 10.3389/fimmu.2021.805404 [ Links ]

23.  Liu X, Ng CL, De YW. The efficacy of sublingual immunotherapy for allergic diseases in Asia. Allergology International. 2018; 67(3):309-19. DOI: 10.1016/j.alit.2018.02.007 [ Links ]

Received: June 03, 2023; Accepted: August 17, 2023

*Author for correspondence. Email: thuanbm6@gmail.com

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Conceptualization: Nghiem Duc Thuan, Quan Thanh Nam.

Data curation: Quan Thanh Nam, Nguyen Anh Cuong, Do Lan Huong.

Formal analysis: Nghiem Duc Thuan, Quan Thanh Nam.

Research: Quan Thanh Nam.

Methodology: Quan Thanh Nam, Nghiem Duc Thuan.

Project administration: Nghiem Duc Thuan.

Supervision: Nghiem Duc Thuan, Vu Minh Thuc.

Validation: Quan Thanh Nam, Do Lan Huong, Nguyen Anh Cuong.

Drafting - Revision and editing: Quan Thanh Nam, Do Lan Huong, Nguyen Anh Cuong.

Creative Commons License