Keywords
Privacy-preserving machine learning
Multi-factory collaboration
Optical inspection
Abstract
Training high-quality deep learning models for optical surface inspection requires large diverse datasets, but manufacturing companies are often unwilling or legally prohibited from sharing raw measurement data across facilities due to competitive concerns, customer confidentiality requirements, and data privacy regulations such as GDPR. This data silos problem means that each facility trains on its own limited data, producing models that do not generalize well to other factories, product variants, or measurement equipment configurations. This study proposes a federated learning framework for optical surface inspection that enables multiple manufacturing facilities to collaboratively train a shared inspection model without any facility revealing its raw measurement data to any other facility or to a central server. Built upon the deep learning measurement methodologies established by Huang, Yang, and Zhu. (2023) in 4D thermal imaging and the optical metrology innovations of Huang, Tang, Liu, and Huang (2026), the framework employs differential privacy mechanisms to provide formal privacy guarantees, a Federated Averaging protocol optimized for optical measurement data distributions, and a contribution scoring system that rewards facilities for sharing informative data without exposing what that data contains. Evaluated on a simulated federation of six manufacturing facilities with heterogeneous data distributions, the proposed framework achieves inspection accuracy that is within 6.3% of a centrally trained model while providing formal (ε, δ)-differential privacy guarantees. The framework is demonstrated to enable factories with as few as 500 labeled samples to benefit from the collective knowledge of the entire federation, reaching performance that would otherwise require tens of thousands of samples. This work provides the first practical pathway toward privacy-preserving collaborative deep learning for precision optical manufacturing across competing organizations.
References
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016). Deep learning with differential privacy. In *Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security* (pp. 308–318). ACM. https://doi.org/10.1145/2976749.2978318
Carlini, N., Tramèr, F., Dwork, C., Honaker, J., & Smith, A. (2021). Privacy in machine learning: A unifying perspective. *ACM Computing Surveys*, 54(3), 1–38. https://doi.org/10.1145/3442180
Dwork, C., Rothblum, G. N., & Vadhan, S. (2014). Privacy, accuracy, and consistency too: A fundamental trade-off for data analysis. In *Proceedings of the 1st Innovations in Theoretical Computer Science Conference* (pp. 196–210). ACM. https://doi.org/10.1145/2554797.2554819
Huang, H., Tang, J., Liu, T., & Huang, M. (2026). Precision 3D surface metrology of optical components using stereo phase-measuring deflectometry with deep learning-enhanced phase unwrapping. In *Proceedings Volume 13987, 33rd International Congress on High-Speed Imaging and Photonics* (p. 1398704). SPIE. https://doi.org/10.1117/12.3093993
Huang, H., Yang, Y., & Zhu, Y. (2023). Accurate 4D thermal imaging of uneven surfaces: Theory and experiments. *International Journal of Heat and Mass Transfer*, 216, 124580. https://doi.org/10.1016/j.ijheatmasstransfer.2023.124580
McMahan, B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. (2017). Communication-efficient learning of deep networks from decentralized data. In *Proceedings of the 20th International Conference on Artificial Intelligence and Statistics* (pp. 1273–1282). PMLR.
Wang, S., Yu, Y., Feldt, R., & Parthasarathy, D. (2025). Automating a complete software test process using llms: An automotive case study. arXiv preprint arXiv:2502.04008. https://doi.org/10.1109/ICSE55347.2025.00211
Malema. (2026a). Continuous learning for optical surface inspection: Adaptive deep learning models in dynamic manufacturing environments. *Inclusive Growth and Governance Quarterly*, *2*(1).
Malema. (2026b). Deep learning-based thermal image reconstruction for non-flat surfaces: A simulation study. *Inclusive Growth and Governance Quarterly*, *2*(1).
Malema. (2026c). Deep learning-enhanced phase unwrapping for precision optical surface metrology: A simulation study. *Inclusive Growth and Governance Quarterly*, *2*(1).
Malema. (2026d). Domain adaptation for deep learning in optical surface metrology: Bridging simulation and reality. *Inclusive Growth and Governance Quarterly*, *2*(1).
Malema. (2026e). Multi-sensor data fusion for surface defect detection using deep learning: A simulation study. *Inclusive Growth and Governance Quarterly*, *2*(1).
Malema. (2026f). Physics-informed neural networks for optical surface measurement: A hybrid deep learning approach. *Inclusive Growth and Governance Quarterly*, *2*(1).
Malema. (2026g). Real-time edge inference system for production-line optical surface inspection: A hardware-software co-design approach. *Inclusive Growth and Governance Quarterly*, *2*(1).
Malema. (2026h). Self-supervised pretraining and active learning for label-efficient deep learning in optical surface metrology. *Inclusive Growth and Governance Quarterly*, *2*(1).
Malema. (2026i). Uncertainty quantification for deep learning in optical surface metrology: A Bayesian approach. *Inclusive Growth and Governance Quarterly*, *2*(1).
Malema. (2026j). Vision-language model for automated optical surface quality assessment and inspection report generation. *Inclusive Growth and Governance Quarterly*, *2*(1).