Proceedings of International Conference on Applied Innovation in IT
2025/12/22, Volume 13, Issue 5, pp.773-779

Estimating the Link Function in a Partial Linear Single Index Model for Longitudinal Data using LSTM Neural Networks


Hussein Jabbar Bayyoodh and Mohammed Sadeq Aldouri


Abstract: This paper investigates and compares the performance of two estimation approaches - Long Short-Term Memory (LSTM) networks and the semi-parametric Minimum Average Variance Estimation (SMAVE) method - for the Partial Linear Single Index Model (PLSIM) in the context of longitudinal data. The PLSIM combines linear and nonlinear components, offering modeling flexibility for complex data structures often encountered in repeated measurements. We conduct extensive simulations with varying sample sizes (N = 50, 100, 150) to evaluate the prediction accuracy of both methods in estimating the unknown link function. Evaluation metrics such as Mean Squared Error (MSE), bias, and coefficient of determination (R2) are used to assess estimation quality. Results show that LSTM significantly outperforms SMAVE in estimating both the linear parameters and the nonlinear link function. The LSTM method consistently achieves lower MSE and bias values, as well as higher R2 scores for both the model and the nonlinear function, highlighting its superior ability to capture temporal dependencies and complex nonlinear relationships in longitudinal data. In contrast, SMAVE's performance is more sensitive to bandwidth selection and sample size. These findings suggest that deep learning models like LSTM offer a powerful alternative to traditional semi-parametric methods in longitudinal data analysis.

Keywords: Partial Linear Single-Index Model, Longitudinal Data, Long Short-Term Memory, Local Polynomial, Semiparametric, Deep Neural Networks.

DOI: Under indexing

Download: PDF

References:

  1. L. Su and A. Ullah, “Profile likelihood estimation of partially linear panel data models with fixed effects,” Economics Letters, vol. 92, no. 1, pp. 75–81, Jul. 2006, doi: 10.1016/j.econlet.2006.01.019.
  2. R. J. Carroll, J. Fan, I. Gijbels, and M. P. Wand, “Generalized partially linear single-index models,” Journal of the American Statistical Association, vol. 92, no. 438, p. 477, Jun. 1997, doi: 10.2307/2965697.
  3. H. Liang, X. Liu, R. Li, and C. L. Tsai, “Estimation and testing for partially linear single-index models,” The Annals of Statistics, vol. 38, no. 6, pp. 3811–3836, 2010, doi: 10.1214/10-AOS835.
  4. T. Chen and T. Parker, “Semiparametric efficiency for partially linear single-index regression models,” Journal of Multivariate Analysis, vol. 130, pp. 376–386, 2014, doi: 10.1016/j.jmva.2014.06.006.
  5. J. Chen, J. Gao, and D. Li, “Estimation in partially linear single-index panel data models with fixed effects,” Journal of Business and Economic Statistics, vol. 31, no. 3, pp. 315–330, Jul. 2013, doi: 10.1080/07350015.2013.775093.
  6. P. Lai, G. Li, and H. Lian, “Quadratic inference functions for partially linear single-index models with longitudinal data,” Journal of Multivariate Analysis, vol. 118, pp. 115–127, Jul. 2013, doi: 10.1016/j.jmva.2013.03.019.
  7. J. Chen, D. Li, H. Liang, and S. Wang, “Semiparametric GEE analysis in partially linear single-index models for longitudinal data,” The Annals of Statistics, vol. 43, no. 4, pp. 1682–1715, Aug. 2015, doi: 10.1214/15-AOS1320.
  8. S. Ma, H. Liang, and C. L. Tsai, “Partially linear single index models for repeated measurements,” Journal of Multivariate Analysis, vol. 130, pp. 354–375, 2014, doi: 10.1016/j.jmva.2014.06.011.
  9. “Deep learning-based prediction frameworks for longitudinal data analysis,” Florida State University Libraries, 2022.
  10. N. Olawale Adeboye and N. Olawale Alabi, “Deep-learning modelling of dynamic panel data for African economic growth,” Journal of Econometrics and Statistics, vol. 2, no. 1, 2022, doi: https://doi.org/10.46791/jes.2022.v02i01.03.
  11. Y. Xia and W. Härdle, “Semi-parametric estimation of partially linear single-index models,” Journal of Multivariate Analysis, vol. 97, no. 5, pp. 1162–1184, May 2006, doi: 10.1016/j.jmva.2005.11.005.
  12. J. Q. Zhao, Y. Y. Zhao, and Z. X. Miao, “Analysis of panel data partially linear single-index models with serially correlated errors,” Journal of Computational and Applied Mathematics, vol. 368, Apr. 2020, doi: 10.1016/j.cam.2019.112532.


    HOME

       - Conference
       - Journal
       - Paper Submission to Conference
       - Paper Submission to Journal
       - Fee Payment
       - For Authors
       - For Reviewers
       - Important Dates
       - Conference Committee
       - Editorial Board
       - Reviewers
       - Last Proceeding


    PROCEEDINGS

       - Volume 13, Issue 5 (ICAIIT 2025)
       - Volume 13, Issue 4 (ICAIIT 2025)
       - Volume 13, Issue 3 (ICAIIT 2025)
       - Volume 13, Issue 2 (ICAIIT 2025)
       - Volume 13, Issue 1 (ICAIIT 2025)
       - Volume 12, Issue 2 (ICAIIT 2024)
       - Volume 12, Issue 1 (ICAIIT 2024)
       - Volume 11, Issue 2 (ICAIIT 2023)
       - Volume 11, Issue 1 (ICAIIT 2023)
       - Volume 10, Issue 1 (ICAIIT 2022)
       - Volume 9, Issue 1 (ICAIIT 2021)
       - Volume 8, Issue 1 (ICAIIT 2020)
       - Volume 7, Issue 1 (ICAIIT 2019)
       - Volume 7, Issue 2 (ICAIIT 2019)
       - Volume 6, Issue 1 (ICAIIT 2018)
       - Volume 5, Issue 1 (ICAIIT 2017)
       - Volume 4, Issue 1 (ICAIIT 2016)
       - Volume 3, Issue 1 (ICAIIT 2015)
       - Volume 2, Issue 1 (ICAIIT 2014)
       - Volume 1, Issue 1 (ICAIIT 2013)


    LAST CONFERENCE

       ICAIIT 2026
         - Photos
         - Reports

    PAST CONFERENCES

    ETHICS IN PUBLICATIONS

    ACCOMODATION

    CONTACT US

 

        

         Proceedings of the International Conference on Applied Innovations in IT by Anhalt University of Applied Sciences is licensed under CC BY-SA 4.0


                                                   This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License


           ISSN 2199-8876
           Publisher: Edition Hochschule Anhalt
           Location: Anhalt University of Applied Sciences
           Email: leiterin.hsb@hs-anhalt.de
           Phone: +49 (0) 3496 67 5611
           Address: Building 01 - Red Building, Top floor, Room 425, Bernburger Str. 55, D-06366 Köthen, Germany

        site traffic counter

Creative Commons License
Except where otherwise noted, all works and proceedings on this site is licensed under Creative Commons Attribution-ShareAlike 4.0 International License.