“A Theoretical and Practical Study of Linear Regression”
Article Sidebar
Main Article Content
This article provides a self-contained description of linear regression, covering both the necessary linear algebra concepts and their implementation in Python. Linear regression remains one of the most interpretable and widely used tools in the data scientist’s toolbox. By mastering both its theoretical foundations and practical applications, one can build robust and explainable models.
In this paper, we explain the fundamentals of linear regression, outline how it works, and guide the reader through the implementation process step by step. We also discuss essential techniques such as feature scaling and gradient descent, which are crucial for improving model accuracy and efficiency. Whether applied to business trend analysis or broader data science applications, this paper serves as a comprehensive introduction to linear regression for beginners and practitioners alike.
Downloads
References
Draper, N. R., & Smith, H. (1998). Applied Regression Analysis (3rd ed.). Wiley-Interscience.
https://doi.org/10.1002/9781118625590
Freedman, D. A. (2009). Statistical Models: Theory and Practice (Revised ed.). Cambridge University Press.
https://doi.org/10.1017/CBO9780511815867
Hastie, T., Tibshirani, R., & Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2nd ed.). Springer.
https://doi.org/10.1007/978-0-387-84858-7
Seber, G. A. F., & Lee, A. J. (2012). Linear Regression Analysis (2nd ed.). Wiley.
https://doi.org/10.1002/9781118274422
Montgomery, D. C., Peck, E. A., & Vining, G. G. (2021). Introduction to Linear Regression Analysis (6th ed.). Wiley.
https://doi.org/10.1002/9781119722106
Kutner, M. H., Nachtsheim, C. J., Neter, J., & Li, W. (2005). Applied Linear Statistical Models (5th ed.). McGraw-Hill/Irwin.
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2021). An Introduction to Statistical Learning: With Applications in R and Python (2nd ed.). Springer.

This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles published in our journal are licensed under CC-BY 4.0, which permits authors to retain copyright of their work. This license allows for unrestricted use, sharing, and reproduction of the articles, provided that proper credit is given to the original authors and the source.