Text documents screen watermarking by changing background brightness in the interline spacing
Aleksey Yur'evich YAKUSHEV,
Yury Vital'evich MARKIN,
Stanislav Alexandrovich FOMIN,
Dmitry Olegovich OBYDENKOV,
Boris Vladimirovich KONDRAT’EV https://doi.org/10.15514/ISPRAS-2021-33(4)-11
Abstract
One of the most common ways documents leak is taking a picture of document displayed on the screen. For investigation of such cases data leakage prevention technologies including screen watermarking are used. The article gives short review on the problem of screen shooting watermarking and the existing research results. A novel approach for watermarking text images displayed on the screen is proposed. The watermark is embedded as slight changes in luminance into the interline spacing of marked text. The watermark is designed to be invisible for human eye but still able to be detected by digital camera. An algorithm for extraction of watermark from the screen photo is presented. The extraction algorithm doesn’t need the original image of document for successful extraction. The experimental results show that the approach is robust against screen-cam attacks, that means that the watermark stays persistent after the process of taking a photo of document displayed on the screen. A criterion for watermark message extraction accuracy without knowledge about the original message is proposed. The criterion represents the probability that the watermark was extracted correctly.
About the Authors
Aleksey Yur'evich YAKUSHEV
Ivannikov Institute for System Programming of the RAS
Russian Federation
Russian Federation
Student
Yury Vital'evich MARKIN
Ivannikov Institute for System Programming of the RAS
Russian Federation
Russian Federation
Researcher, PhD in Technical Sciences
Stanislav Alexandrovich FOMIN
Ivannikov Institute for System Programming of the RAS
Russian Federation
Russian Federation
Leading programmer
Dmitry Olegovich OBYDENKOV
Ivannikov Institute for System Programming of the RAS
Russian Federation
Russian Federation
Graduate student
Boris Vladimirovich KONDRAT’EV
Ministry of Defence of the Russian Federation
Russian Federation
Russian Federation
Employee of the Ministry of Defence
References
1. Утечки информации ограниченного доступа: отчет за 9 месяцев 2020 г. Экспертно-аналитический центр InfoWatch, 2020 г. / Restricted information leaks: report for 9 months of 2020, InfoWatch Analytical Center, 2020 (in Russian).
2. Pramila A. Reading watermarks with a camera phone from printed images. PhD Thesis. University of Oulu, Oulu, 2018, 86 p.
3. Chen W., Ren N. et al. Screen-Cam Robust Image Watermarking with Feature-Based Synchronization. Applied Sciences, vol. 10, no. 21, 2020, article no. 7494.
4. Fang H., Zhang W. et al. Screen-Shooting Resilient Watermarking. IEEE Transactions on Information Forensics and Security, vol. 14, no. 6, 2019, pp. 1403–1418.
5. Song J., Lu X., Wang W., Chen C. ISIFT: Improving the Performance of SIFT for Mirror Images. In Proc. of the 2nd IEEE International Conference on Computer and Communications (ICCC), 2016, pp. 742-745.
6. Mikolajczyk K., Schmid C. An Affine Invariant Interest Point Detector. Lecture Notes in Computer Science, vol. 2350, 2002, pp. 128–142.
7. Chen W., Ren N. et al. Joint Image Encryption and Screen-Cam Robust Two Watermarking Scheme. Sensors, vol. 21, no. 3, 2021, article no. 701.
8. Gugelmann D., Sommer D. et al. Screen Watermarking for Data Theft Investigation and Attribution. In Proc. of the 10th International Conference on Cyber Conflict (CyCon), 2018, pp. 391-408.
9. Piec M., Rauber A. Real-Time Screen Watermarking Using Overlaying Layer. In Proc. of the Ninth International Conference on Availability, Reliability and Security, 2014, pp. 561-570.
10. Ronneberger O., Fischer P., Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. Lecture Notes in Computer Science, vol. 9351, 2015, pp. 234–241.
11. Hough P.V.C. Method and Means for Recognizing Complex Patterns. U.S. Patent 30696541962, 1992.
12. Mathur G., Rikhari M.S. Text Detection in Document Images: Highlight on Using FAST Algorithm. International Journal of Advanced Engineering Research and Science, vol. 4, no. 3, 2017, pp. 275–284.
13. Low S., Brassil J.T., Maxemchuk N.F., O’Gorman L. Document Marking and Identification Using Both Line and Word Shifting. In Proc. of the INFOCOM'95, 1995, pp. 853-860.
Review
For citations:
YAKUSHEV A.Yu., MARKIN Yu.V., FOMIN S.A., OBYDENKOV D.O., KONDRAT’EV B.V. Text documents screen watermarking by changing background brightness in the interline spacing. Proceedings of the Institute for System Programming of the RAS (Proceedings of ISP RAS). 2021;33(4):147-162. (In Russ.) https://doi.org/10.15514/ISPRAS-2021-33(4)-11
Email this article 