Yura Shinkarev's questions

I have log file. I want extract email list from specific lines. Sample log file:

05:06:48,311  INFO http-nio-8080-exec-81 controller.IndexController:221 - Attempt to login: [[email protected]]. Headers: ["content-length": "52", ...]
15:06:48,311  INFO http-nio-8080-exec-81 controller.IndexController:221 - Attempt to login: [[email protected]]. Headers: ["content-length": "52", ...]
09:40:21,187  INFO http-nio-8080-exec-31 security.AuthAuthenticationProvider:81 - User: [16167]. Wrong code. Telegram: [0]. Google: [0]

My script:

cat file.log | sed -r 's/.*Attempt to login: \[(.*)\]\..*/\1/' | sort | uniq > file.log.filtered.txt

I get file.log.filtered.txt:

09:40:21,187  INFO http-nio-8080-exec-31 security.AuthAuthenticationProvider:81 - User: [16167]. Wrong code. Telegram: [0]. Google: [0]
[email protected]

Why I have line with "AuthAuthenticationProvider" in filtered file?

I want more space as shown here:

Default mc with active panels has only one line where the user can type commands, I want to see more console output without pressing ctrl + o pressing.

How can I get it?

I have some config-file. Config-file contains string: LocalPath /media/$USER

I read config-file in bash-script:

while read var value
do
    export "$var"="$value"
done < my-conf-file.conf

So, I can use $LocalPath in bash-script. It equals: /media/$USER, but I want to have: /media/user1 (user1 is my user).

How I can implement it?

I have this simple text file and want to sort all lines by the response_time column:

1 console-2017_09_17.log:2017-09-17 00:04:02,507:INFO :pool-8982-thread-30:r.a.u.j.PerfRequestInterceptor - method=GET, uri==43975&items, response_time=1030, response_code=300 
2 console-2017_09_17.log:2017-09-17 00:04:02,628:INFO :pool-8982-thread-77:r.a.u.j.PerfRequestInterceptor - method=GET, uri==PBD4766&items, response_time=1142, response_code=200 
3 console-2017_09_17.log:2017-09-17 00:04:02,651:INFO :pool-8982-thread-67:r.a.u.j.PerfRequestInterceptor - method=GET, uri==MDC1810C&items, response_time=1166, response_code=200 
4 console-2017_09_17.log:2017-09-17 00:04:02,655:INFO :pool-8984-thread-47:r.a.u.j.PerfRequestInterceptor - method=GET, uri==1031086&items, response_time=1005, response_code=200 
5 console-2017_09_17.log:2017-09-17 00:04:02,668:INFO :pool-8984-thread-50:r.a.u.j.PerfRequestInterceptor - method=GET, uri==F1018P&items, response_time=1018, response_code=200 
6 console-2017_09_17.log:2017-09-17 00:04:02,677:INFO :pool-8983-thread-86:r.a.u.j.PerfRequestInterceptor - method=GET, uri==V2581261&items, response_time=1060, response_code=200 
7 console-2017_09_17.log:2017-09-17 00:04:02,681:INFO :pool-8982-thread-68:r.a.u.j.PerfRequestInterceptor - method=GET, uri==202581&items, response_time=1196, response_code=200 
8 console-2017_09_17.log:2017-09-17 00:04:02,686:INFO :pool-8984-thread-46:r.a.u.j.PerfRequestInterceptor - method=GET, uri==1563200600&, response_time=1036, response_code=200 
9 console-2017_09_17.log:2017-09-17 00:04:02,693:INFO :pool-8983-thread-29:r.a.u.j.PerfRequestInterceptor - method=GET, uri==8DB355025371, response_time=1207, response_code=200

I tried it this way:

sort -n -t " " -k 8 myfile.txt

But I still got an unsorted file. Why?

UPD: Time can be less than 1000 and more than 9999:

1 console-2017_09_17.log:2017-09-17 00:04:02,507:INFO :pool-8982-thread-30:r.a.u.j.PerfRequestInterceptor - method=GET, uri==43975&items, response_time=11030, response_code=300 
2 console-2017_09_17.log:2017-09-17 00:04:02,628:INFO :pool-8982-thread-77:r.a.u.j.PerfRequestInterceptor - method=GET, uri==PBD4766&items, response_time=1142, response_code=200 
3 console-2017_09_17.log:2017-09-17 00:04:02,651:INFO :pool-8982-thread-67:r.a.u.j.PerfRequestInterceptor - method=GET, uri==MDC1810C&items, response_time=1166, response_code=200 
4 console-2017_09_17.log:2017-09-17 00:04:02,655:INFO :pool-8984-thread-47:r.a.u.j.PerfRequestInterceptor - method=GET, uri==1031086&items, response_time=1005, response_code=200 
5 console-2017_09_17.log:2017-09-17 00:04:02,668:INFO :pool-8984-thread-50:r.a.u.j.PerfRequestInterceptor - method=GET, uri==F1018P&items, response_time=1018, response_code=200 
6 console-2017_09_17.log:2017-09-17 00:04:02,677:INFO :pool-8983-thread-86:r.a.u.j.PerfRequestInterceptor - method=GET, uri==V2581261&items, response_time=1060, response_code=200 
7 console-2017_09_17.log:2017-09-17 00:04:02,681:INFO :pool-8982-thread-68:r.a.u.j.PerfRequestInterceptor - method=GET, uri==202581&items, response_time=1196, response_code=200 
8 console-2017_09_17.log:2017-09-17 00:04:02,686:INFO :pool-8984-thread-46:r.a.u.j.PerfRequestInterceptor - method=GET, uri==1563200600&, response_time=1036, response_code=200 
9 console-2017_09_17.log:2017-09-17 00:04:02,693:INFO :pool-8983-thread-29:r.a.u.j.PerfRequestInterceptor - method=GET, uri==8DB355025371, response_time=7, response_code=200

UPD2: I'm reduce parameter uri. It can contain different numbers of "=".

I'm using in my script:

tar cfh - "$SRC_DIR" --exclude-from <(find $SRC_DIR -size +$EXCLUDE_MB_FILES) | pigz -9 --quiet --keep --recursive --rsyncable > $BACKUP_TARGER_DIR/$ARC_NAME | tee $LOG_FILE

But LOG_FILE is empty. Why?

Kubuntu 16.04 amd64.

Theme: Breeze

Choose png-file with resolution 1600x900 (it's my notebook resolution), apply. But on lock screen still see default blue background.

Why?

Kubuntu 16.04 amd64. Plasma 5.5 My desktop here:

How to reduce launcher icon "K" size?

ubuntu 16.04 x64. I install nginx, do not change default configuration.

I have /var/www/html with one index file. I see content of index file, if open my site in browser.

Now I copy new file to /var/www/html (place near index). Ofcouse I know file name and can append to site url this name and open file in browser.

Can anybody detect this file and open it in browser too?

I have simple script. Script can be run with specific arguments. For example:

./my-script.sh --last-name=Smith --first-name=John

There is called curl and sended POST-request in script:

curl --data-urlencode last_name=$lastName --data-urlencode first_name=$firstName https://example.com

Where firstName and lastName are variables, that parsed from arguments.

Issue, that firstName or lastName (but not both) can be missed. If argument is missed, appropriate parameter do not sended to server.

But I do not know, how I can implement this logic in scripts.

Ofcouse, I can add if to check argument on null, but I can have much arguments in command line and in this case I will have tons of if...

I have vps for personal goals. Vps running on ubuntu 16.04 x64.

I'm config ssh to login only by my one user (schumi) by public key (login by password and login by root are disabled). If I needed change any config or install package, I'm did: su - and login by root with password.

But sometimes I want to see logs (/var/log) and ofcouse can not did it:

drwxrwxr-x  6 root                syslog              .
drwxr-xr-x 12 root                root                ..
-rw-r--r--  1 root                root                alternatives.log
drwxr-xr-x  2 root                root                apt
-rw-r-----  1 syslog              adm                 auth.log
-rw-------  1 root                utmp                btmp
-rw-r-----  1 root                adm                 dmesg
-rw-r--r--  1 root                root                dpkg.log
-rw-r--r--  1 root                root                faillog
-rw-r--r--  1 root                root                fontconfig.log
drwxr-xr-x  2 root                root                fsck
-rw-rw-r--  1 root                utmp                lastlog
-rw-r-----  1 syslog              adm                 mail.err
-rw-r-----  1 syslog              adm                 mail.log
drwxr-xr-x  2 root                root                proftpd
-rw-r-----  1 syslog              adm                 syslog
-rw-r-----  1 syslog              adm                 syslog.1
drwxrwxr-x  2 debian-transmission debian-transmission transmission
-rw-rw-r--  1 root                utmp                wtmp

What's I do now? I login by ssh (schumi), then su - and see logs. But may be better add my user (schumi) to some groups? Or it's not secure?

Also, I have thoughts to view logs without login by ssh. For example, run telegram-bot on vps, enable conversation bot only with me and implements commands to send log files to me by specific commands. Or run, for example, nginx, config authentication and direct open log at web page...

I have installed Xubuntu 16.04 and mysql 5.7 server.

I create simple script with name mysql-wrapper:

#!/bin/bash
mysql -u myuser -pmypwd mydatabase --table $*

Now I run command and it execute successfully:

mysql-wrapper -e "STATUS"

Then I try run next command (with space):

mysql-wrapper -e "SHOW TABLES"

I get problem: mysql print me help for commands, like I run mysql with illegal command.

How I can solve my issue? Or may be better use alias?