Issue #31: New log sync script leaves droppings on log01 - mirrors-countme

mirrors-countme

#31 New log sync script leaves droppings on log01

Closed 3 years ago by nphilipp. Opened 3 years ago by nphilipp.

The sync-http-logs.py leaves temporary files in /var/log/hosts/*...*/http*. They are used to atomically hard-link between dated and undated names for the same log files (because atomical hard-link-over-existing-file isn't a thing: hard link to temporary file name, rename atomically over existing file), e.g.:

[root@log01 http][PROD-IAD2]# pwd
/var/log/hosts/datagrepper01.iad2.fedoraproject.org/2021/08/08/http
[root@log01 http][PROD-IAD2]# ls -l
total 3264
-rw-r--r--. 4 root root 827624 Aug  8 04:02 access_log.xz
-rw-r--r--. 4 root root 827628 Aug  8 04:02 datagrepper_access_log.xz
-rw-r--r--. 4 root root   3932 Aug  8 03:55 datagrepper_error_log.xz
-rw-r--r--. 4 root root     32 Aug  7 04:02 error_log.xz
-rw-r--r--. 4 root root 827624 Aug  8 04:02 tmp5o9wy_ne
-rw-r--r--. 4 root root   3932 Aug  8 03:55 tmpeluzrhwc
-rw-r--r--. 4 root root     32 Aug  7 04:02 tmpqzzz8uuz
-rw-r--r--. 4 root root 827628 Aug  8 04:02 tmpzxwc37wn
[root@log01 http][PROD-IAD2]#

For some reason, the temporary files still exist after the script has finished.