I was wondering if there was a proper way to clear logs in general?
I'm new to Ubuntu and I'm trying to set up Postfix. The log in question is /var/log/mail.log
. I was wondering if there was a correct way to clear it, rather than me going in it and deleting all the lines and saving it. I find that sometimes errors don't get written to it immediately after I clear the log and save it.
Side note: I'm having trouble setting up Postfix and am trying to make it easier for me to read the logs hoping it can help me out, instead of having to scroll all the way down.
You can use:
That will truncate the log without you having to edit the file. It's also a reliable way of getting the space back.
In general it's a bad thing to use
rm
on the log then recreating the filename, if another process has the file open then you don't get the space back until that process closes it's handle on it and you can damage it's permissions in ways that are not immediately obvious but cause more problems later on.Yasar has a nice answer using
truncate
Also if you are watching the contents of the log you might like to use the
tail
command:Ctrl-C will break off the tailing.
You can use this too..
Here all log files in the /opt/package/logs will become empty..
Yes, there's a proper way: You don't clear logs at all. You rotate them. Rotation involves switching log output to a new file, under the same name, with the previous N log files kept under a set of N related filenames.
How one rotates logs depends from how one is writing them in the first place. This is an oft-overlooked point. Some of the answers here touch upon it at least, mentioning that some logging programs keep an open file descriptor for the log file, so just deleting the file won't free up the space, or indeed even switch output to a fresh log file.
If the program writing the log file is
multilog
from thedaemontools
package, for example, then you don't do anything to rotate the logs at all — no manual scripts, nocron
jobs. Simply tellmultilog
that log output is to a directory, and it will itself maintain an automatically rotated and size-capped set of N log files in that directory.If the program writing the log files is
svlogd
from therunit
package, for another example, then much the same applies. You don't do anything at all apart from point the tool at a directory. It will itself maintain an automatically rotated and size-capped set of N log files in that directory.If you are using
rsyslog
to write log files, then the logging program can be told to stop after the log file reaches a certain size and run a script. You have to write the meat of the script, to actually rename the log file and delete old log files based upon total size constraints, but at least the logging program has closed the file and paused log writing whilst this is happening.The old
syslogd
way of rotating logs, still expected by logging programs such as syslog-ng and as exemplified by tools such aslogrotate
mentioned bydjangofan
in another answer here, is somewhat more haphazard. One runs acron
job that periodically renames the log files, and restarts the logging daemon (using whatever daemon supervisor it is running under). The problem with this, of course is that it doesn't enforce an overall size cap. On slow weeks one can get N very small daily log files, whereas on busy days one can get 1 very big log file that's well over the size limit.This is why later and better tools like
multilog
andsvlogd
have file size configuration options and actually check the log file sizes themselves, of course. The world has learned that polling the logs on a schedule withcron
jobs, or even alogrotate
daemon, leaves windows for the size to be wrong, and that the proper place to have these checks, and so rigourously enforce administrator-defined size caps so that one's log files don't ever swallow the partition that they are on, is in the program that is actually writing the files out in the first place.Yes, there is a tool for linux called LogRotate .
If the reason you clear the log is to free space, you can cat /dev/null to them, without interrupting programs writing into it. Never delete them ! some software might complain by stop working or ignoring the log completely until next restart
Short and compatible content overwriting:
: > /dest/file
But there's also truncate(2) system call, and corresponding userspace tool
truncate
on many *NIX'es.If you want to keep the file before cleaning it up, you can do:
If you want to do search for an specific text or email in the log you can use grep. If you want to keep some graphics about mail usage you can use AWStats.
Here's how I do it, and this is just for NGINX, you can remove that to make it work on all log files.
Works for me