Home / user-40756

Homunculus Reticulli's questions

Martin Hope
Homunculus Reticulli
Asked: 2020-08-24 23:12:17 +0800 CST
  • 0

I am running on Ubuntu 18.04.4 LTS.

I gzipped a folder with roughly 60+K files into a .tar.gz file. The compressed file had a size of 3.3Gb.

I opened the compressed file to extract some files, and realised to my shock, dismay and error, that only a few files (total file size of 6.2K) were stored in the zip!

What could possibly have gone wrong? How can the .tar.gz file have such a huge file size - yet contain files with a total filesize of around 0.5% ?

For what it's worth, none of the files I compressed are hidden files, and this is the file I used to compress the folder files:

nohup ssh me@yourbox "tar -cf - /path/to/folder" | gzip > foldername.remote.`(date +%Y%m%d)`.tar.gz &

This is the output when I run tar zvf compressed.file.tar.gz :

morpheous@ZEUS:~$ tar tzvf foobar.remote.20200717.tar.gz 
drwxr-xr-x morpheous/morpheous 0 2019-04-19 13:51 foobar/
drwxr-xr-x morpheous/morpheous 0 2020-04-16 10:46 foobar/maps/
-rw-rw-r-- morpheous/morpheous 5615 2017-11-28 08:34 foobar/maps/us_sector_XLV.csv
drwxr-xr-x morpheous/morpheous    0 2018-02-26 13:00 foobar/maps/HIX/
-rw-rw-r-- morpheous/morpheous    8 2016-07-29 08:59 foobar/maps/HIX/3350.csv
-rw-rw-r-- morpheous/morpheous   18 2018-01-28 00:37 foobar/maps/HIX/5330.csv
-rw-rw-r-- morpheous/morpheous   89 2018-01-28 00:39 foobar/maps/HIX/5370.csv
-rw-rw-r-- morpheous/morpheous   84 2018-01-28 00:38 foobar/maps/HIX/7570.csv
-rw-rw-r-- morpheous/morpheous   88 2018-01-28 00:38 foobar/maps/HIX/3720.csv
-rw-rw-r-- morpheous/morpheous   32 2018-01-28 00:39 foobar/maps/HIX/2770.csv
-rw-rw-r-- morpheous/morpheous   10 2016-07-29 08:59 foobar/maps/HIX/9570.csv
-rw-rw-r-- morpheous/morpheous   18 2016-07-29 08:59 foobar/maps/HIX/3760.csv
-rw-rw-r-- morpheous/morpheous  240 2018-01-28 00:38 foobar/maps/HIX/8980.csv
tar: Skipping to next header
tar: Exiting with failure status due to previous errors

How do I recover my files from the compressed file?

command-line backup gzip tar
Martin Hope
Homunculus Reticulli
Asked: 2019-09-23 04:07:47 +0800 CST
  • 0

System Info : 

morpheous@ZEUS:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 18.04.3 LTS
Release:    18.04
Codename:   bionic

Clearing System THEN updating:

morpheous@ZEUS:~$ sudo rm -rf /var/lib/apt/lists/*
morpheous@ZEUS:~$ sudo apt clean
morpheous@ZEUS:~$ sudo apt update
Get:3 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic InRelease [15.9 kB]                                              
Ign:5 http://dl.google.com/linux/chrome/deb stable InRelease                                                                 
Get:6 http://ppa.launchpad.net/freecad-maintainers/freecad-stable/ubuntu bionic InRelease [15.4 kB]                          
Ign:7 https://deb.nodesource.com/node_10.x bionic InRelease                                                                  
Get:1 http://gb.archive.ubuntu.com/ubuntu bionic InRelease                                                                   
Err:8 https://deb.nodesource.com/node_10.x bionic Release                                                                    
  Could not handshake: Error in the pull function. [IP: 13.224.132.5 443]
Err:1 http://gb.archive.ubuntu.com/ubuntu bionic InRelease                                                                   
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
Get:2 http://gb.archive.ubuntu.com/ubuntu bionic-updates InRelease                                                           
Err:2 http://gb.archive.ubuntu.com/ubuntu bionic-updates InRelease                                                           
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
Get:9 http://linux.teamviewer.com/deb stable InRelease [9,388 B]                                                             
Get:4 http://gb.archive.ubuntu.com/ubuntu bionic-backports InRelease                                                         
Err:4 http://gb.archive.ubuntu.com/ubuntu bionic-backports InRelease                                                         
  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
Get:10 http://dl.google.com/linux/chrome/deb stable Release [943 B]                                                          
Get:11 http://packages.microsoft.com/repos/vscode stable InRelease [3,182 B]                                                 
Get:12 http://dl.google.com/linux/chrome/deb stable Release.gpg [819 B]                                                      
Get:13 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic/main i386 Packages [26.8 kB]                                    
Get:14 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]                                                 
Get:15 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic/main amd64 Packages [26.8 kB]                                   
Get:16 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic/main Translation-en [6,552 B]                                   
Get:17 http://ppa.launchpad.net/freecad-maintainers/freecad-stable/ubuntu bionic/main i386 Packages [17.0 kB]                
Get:18 http://ppa.launchpad.net/freecad-maintainers/freecad-stable/ubuntu bionic/main amd64 Packages [17.0 kB]               
Get:19 http://linux.teamviewer.com/deb stable/main i386 Packages [3,264 B]                                                   
Get:20 http://linux.teamviewer.com/deb stable/main amd64 Packages [3,548 B]                                                  
Get:21 http://ppa.launchpad.net/freecad-maintainers/freecad-stable/ubuntu bionic/main Translation-en [6,756 B]               
Get:22 https://download.sublimetext.com apt/stable/ InRelease [2,562 B]                                                      
Get:23 http://packages.microsoft.com/repos/vscode stable/main amd64 Packages [142 kB]                                      
Get:24 http://dl.google.com/linux/chrome/deb stable/main amd64 Packages [1,104 B]                
Get:25 https://download.sublimetext.com apt/stable/ Packages [1,014 B]                   
Get:26 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [373 kB]     
Get:27 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [516 kB]
Get:28 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [173 kB]
Get:29 http://security.ubuntu.com/ubuntu bionic-security/main amd64 DEP-11 Metadata [26.3 kB]
Get:30 http://security.ubuntu.com/ubuntu bionic-security/main DEP-11 48x48 Icons [14.6 kB]
Get:31 http://security.ubuntu.com/ubuntu bionic-security/main DEP-11 64x64 Icons [37.8 kB]
Get:32 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [7,648 B]
Get:33 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [4,280 B]
Get:34 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [3,064 B]
Get:35 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [591 kB]
Get:36 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [607 kB]
Get:37 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [202 kB]
Get:38 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 DEP-11 Metadata [42.1 kB]
Get:39 http://security.ubuntu.com/ubuntu bionic-security/universe DEP-11 48x48 Icons [16.4 kB]
Get:40 http://security.ubuntu.com/ubuntu bionic-security/universe DEP-11 64x64 Icons [111 kB]
Get:41 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,152 B]                                  
Get:42 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [4,904 B]                                 
Get:43 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [2,396 B]                                 
Get:44 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 DEP-11 Metadata [2,464 B]                          
Get:45 http://security.ubuntu.com/ubuntu bionic-security/multiverse DEP-11 48x48 Icons [29 B]                                
Get:46 http://security.ubuntu.com/ubuntu bionic-security/multiverse DEP-11 64x64 Icons [2,638 B]                             
Reading package lists... Done                                                                                                
N: See apt-secure(8) manpage for repository creation and user configuration details.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
E: The repository 'https://deb.nodesource.com/node_10.x bionic Release' does not have a Release file.
N: See apt-secure(8) manpage for repository creation and user configuration details.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
E: The repository 'http://gb.archive.ubuntu.com/ubuntu bionic InRelease' is not signed.
E: Failed to fetch http://gb.archive.ubuntu.com/ubuntu/dists/bionic/InRelease  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
E: Failed to fetch http://gb.archive.ubuntu.com/ubuntu/dists/bionic-updates/InRelease  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
E: The repository 'http://gb.archive.ubuntu.com/ubuntu bionic-updates InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
E: Failed to fetch http://gb.archive.ubuntu.com/ubuntu/dists/bionic-backports/InRelease  Clearsigned file isn't valid, got 'NOSPLIT' (does the network require authentication?)
E: The repository 'http://gb.archive.ubuntu.com/ubuntu bionic-backports InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.

How do I fix these errors, so I can update my system without errors?

package-management updates apt aptitude 18.04
Martin Hope
Homunculus Reticulli
Asked: 2017-04-27 01:26:16 +0800 CST
  • 0

I am running Ubuntu Xenial (16.0.4 LTS) both on my laptop and my server. I have strengthened security on the server using the techniques described here and here.

I am able to SSH from my laptop to the server, using the default SSH port (22), but when I try any other number, the connection times out:

$ ssh -vvv phreakster@magicbox -p XXXX
OpenSSH_7.2p2 Ubuntu-4ubuntu2.1, OpenSSL 1.0.2g  1 Mar 2016
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 19: Applying options for *
debug2: resolving "magicbox" port XXXX
debug2: ssh_connect_direct: needpriv 0
debug1: Connecting to magicbox [192.168.1.100] port XXXX.
debug1: connect to address 192.168.1.100 port XXXX: Connection timed out
ssh: connect to host magicbox port XXXX: Connection timed out
phreakster@CEBERUS:~$

I have modified and updated my /etc/ssh/sshd_config and successfully restarted the SSH daemon.

Why can't I SSH into the server using another port number?

[[Edit]]

From some of the feedback I received, I thought this may be a firewall related problem, so I logged into the server (from the machine itself), and typed the following:

sudo ufw allow 4[XXX]/tcp

WARN: Duplicate profile 'Apache', using last found WARN: Duplicate profile 'Apache Secure', using last found WARN: Duplicate profile 'Apache Full', using last found Rule added Rule added (v6)

phreakster@CEBERUS:~$ sudo ufw numbered

WARN: Duplicate profile 'Apache', using last found WARN: Duplicate profile 'Apache Secure', using last found WARN: Duplicate profile 'Apache Full', using last found Status: active

To Action From --- ------ ---- 22 ALLOW Anywhere 4XXX ALLOW Anywhere 22 (v6) ALLOW Anywhere 4XXX (v6) ALLOW Anywhere

I then restart the SSH service:

sudo service ssh restart

Here is the SSH session console debug output when I attempt to login from my laptop:

phreakster@CEBERUS:~$ ssh -vvv phreakster@magicbox -p 4XXX
OpenSSH_7.2p2 Ubuntu-4ubuntu2.1, OpenSSL 1.0.2g  1 Mar 2016
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 19: Applying options for *
debug2: resolving "magicbox" port 4XXX
debug2: ssh_connect_direct: needpriv 0
debug1: Connecting to magicbox [192.168.1.100] port 4XXX.
debug1: Connection established.
debug1: identity file /home/phreakster/.ssh/id_rsa type 1
debug1: key_load_public: No such file or directory
debug1: identity file /home/phreakster/.ssh/id_rsa-cert type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/phreakster/.ssh/id_dsa type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/phreakster/.ssh/id_dsa-cert type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/phreakster/.ssh/id_ecdsa type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/phreakster/.ssh/id_ecdsa-cert type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/phreakster/.ssh/id_ed25519 type -1
debug1: key_load_public: No such file or directory
debug1: identity file /home/phreakster/.ssh/id_ed25519-cert type -1
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.1
debug1: Remote protocol version 2.0, remote software version OpenSSH_7.2p2 Ubuntu-4ubuntu2.1
debug1: match: OpenSSH_7.2p2 Ubuntu-4ubuntu2.1 pat OpenSSH* compat 0x04000000
debug2: fd 3 setting O_NONBLOCK
debug1: Authenticating to magicbox:4XXX as 'phreakster'
debug3: put_host_port: [magicbox]:4XXX
debug3: hostkeys_foreach: reading file "/home/phreakster/.ssh/known_hosts"
debug3: send packet: type 20
debug1: SSH2_MSG_KEXINIT sent
debug3: receive packet: type 20
debug1: SSH2_MSG_KEXINIT received
debug2: local client KEXINIT proposal
debug2: KEX algorithms: [email protected],ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group-exchange-sha256,diffie-hellman-group-exchange-sha1,diffie-hellman-group14-sha1,ext-info-c
debug2: host key algorithms: [email protected],[email protected],[email protected],[email protected],[email protected],ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,ssh-ed25519,rsa-sha2-512,rsa-sha2-256,ssh-rsa
debug2: ciphers ctos: [email protected],aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected],aes128-cbc,aes192-cbc,aes256-cbc,3des-cbc
debug2: ciphers stoc: [email protected],aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected],aes128-cbc,aes192-cbc,aes256-cbc,3des-cbc
debug2: MACs ctos: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
debug2: MACs stoc: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
debug2: compression ctos: none,[email protected],zlib
debug2: compression stoc: none,[email protected],zlib
debug2: languages ctos: 
debug2: languages stoc: 
debug2: first_kex_follows 0 
debug2: reserved 0 
debug2: peer server KEXINIT proposal
debug2: KEX algorithms: [email protected],ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group-exchange-sha256,diffie-hellman-group14-sha1
debug2: host key algorithms: ssh-rsa,rsa-sha2-512,rsa-sha2-256
debug2: ciphers ctos: [email protected],aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected]
debug2: ciphers stoc: [email protected],aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected]
debug2: MACs ctos: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
debug2: MACs stoc: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
debug2: compression ctos: none,[email protected],zlib
debug2: compression stoc: none,[email protected],zlib
debug2: languages ctos: 
debug2: languages stoc: 
debug2: first_kex_follows 0 
debug2: reserved 0 
debug1: kex: algorithm: [email protected]
debug1: kex: host key algorithm: rsa-sha2-512
debug1: kex: server->client cipher: [email protected] MAC: <implicit> compression: none
debug1: kex: client->server cipher: [email protected] MAC: <implicit> compression: none
debug3: send packet: type 30
debug1: expecting SSH2_MSG_KEX_ECDH_REPLY
debug3: receive packet: type 31
debug1: Server host key: ssh-rsa SHA256:6hMkyfTTLjmxw1l7t1N6QdyQ39/asNr3ysnf6YiZF90
debug3: put_host_port: [192.168.1.100]:4XXX
debug3: put_host_port: [magicbox]:4XXX
debug3: hostkeys_foreach: reading file "/home/phreakster/.ssh/known_hosts"
debug3: hostkeys_foreach: reading file "/home/phreakster/.ssh/known_hosts"
debug1: checking without port identifier
debug3: hostkeys_foreach: reading file "/home/phreakster/.ssh/known_hosts"
debug3: record_hostkey: found key type RSA in file /home/phreakster/.ssh/known_hosts:1
debug3: load_hostkeys: loaded 1 keys from magicbox
debug3: hostkeys_foreach: reading file "/home/phreakster/.ssh/known_hosts"
debug3: record_hostkey: found key type RSA in file /home/phreakster/.ssh/known_hosts:2
debug3: load_hostkeys: loaded 1 keys from 192.168.1.100
debug1: Host 'magicbox' is known and matches the RSA host key.
debug1: Found key in /home/phreakster/.ssh/known_hosts:1
debug1: found matching key w/out port
debug3: send packet: type 21
debug2: set_newkeys: mode 1
debug1: rekey after 134217728 blocks
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug3: receive packet: type 21
debug2: set_newkeys: mode 0
debug1: rekey after 134217728 blocks
debug1: SSH2_MSG_NEWKEYS received
debug2: key: /home/phreakster/.ssh/id_rsa (0x5632e238dcc0), agent
debug2: key: /home/phreakster/.ssh/id_dsa ((nil))
debug2: key: /home/phreakster/.ssh/id_ecdsa ((nil))
debug2: key: /home/phreakster/.ssh/id_ed25519 ((nil))
debug3: send packet: type 5
debug3: receive packet: type 7
debug1: SSH2_MSG_EXT_INFO received
debug1: kex_input_ext_info: server-sig-algs=<rsa-sha2-256,rsa-sha2-512>
debug3: receive packet: type 6
debug2: service_accept: ssh-userauth
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug3: send packet: type 50
debug3: receive packet: type 51
debug1: Authentications that can continue: publickey
debug3: start over, passed a different list publickey
debug3: preferred gssapi-keyex,gssapi-with-mic,publickey,keyboard-interactive,password
debug3: authmethod_lookup publickey
debug3: remaining preferred: keyboard-interactive,password
debug3: authmethod_is_enabled publickey
debug1: Next authentication method: publickey
debug1: Offering RSA public key: /home/phreakster/.ssh/id_rsa
debug3: send_pubkey_test
debug3: send packet: type 50
debug2: we sent a publickey packet, wait for reply
debug3: receive packet: type 60
debug1: Server accepts key: pkalg rsa-sha2-512 blen 535
debug2: input_userauth_pk_ok: fp SHA256:bmRy0HPjGc4St7qkhRk8od6P+2+EruyEAutwGTtpGL8
debug3: sign_and_send_pubkey: RSA SHA256:bmRy0HPjGc4St7qkhRk8od6P+2+EruyEAutwGTtpGL8
sign_and_send_pubkey: signing failed: agent refused operation
debug1: Trying private key: /home/phreakster/.ssh/id_dsa
debug3: no such identity: /home/phreakster/.ssh/id_dsa: No such file or directory
debug1: Trying private key: /home/phreakster/.ssh/id_ecdsa
debug3: no such identity: /home/phreakster/.ssh/id_ecdsa: No such file or directory
debug1: Trying private key: /home/phreakster/.ssh/id_ed25519
debug3: no such identity: /home/phreakster/.ssh/id_ed25519: No such file or directory
debug2: we did not send a packet, disable method
debug1: No more authentication methods to try.
Permission denied (publickey).

[[Edit 2]]

I also, did the following:

  • removed the ufw rule allowing access to server on port 22
  • added ufw rule allowing access on port 4XXX
  • modified /etc/ufw/applications.d/openssh-server and changed port from 22 to 4XXX

I restarted SSHD, adn I still get the error debug messages shown earlier in this question.

So, what do I have to do, to connect using SSH, to a remote server using a non standard port?

[[UPDATE]]

After all the experimentation above, trying to resolve the issue by myself, now I can't even log into the server using port 22 - FML!

16.04
Martin Hope
Homunculus Reticulli
Asked: 2017-04-14 11:05:11 +0800 CST
  • 3

I removed mono, monodev and all dependencies from my machine (using apt-get remove ---purge etc), but I was a bit overzealous and also removed ubuntu-mono that seems to have a whole ton of dependencies, and I watched in horror as seemingly unrelated applications like firefox(??!) were uninstalled from the machine.

To add insult to injury, my Window Manager (Unity - I guess), was uninstalled too, and I was dumped unceremoniously, back to the command prompt.

Upon restarting the machine, I realised I couldn't even login.

Half a day later, I reinstall xorg, lighdm and ubuntu-desktop, I was then able to log into the machine - but was greeted with a ghastly window manager (terminal is green characters on white background - seriously??!!). And I no longer have the ability to change the window manager during login - the options are no longer presented during login.

I want top revert back to the Window Manager and settings that comes with Ubuntu 16.0.4 - it would seem no one has experienced this particular set of events - because I can't seem to find any documentation on how to resolve it.

This is the content of /usr/share/lightdm/lightdm.conf.d/50-ubuntu.conf:

[Seat:*]
user-session=ubuntu

Here is some other miscellaneous useful information:

me@YOURBOX:~$ echo $XDG_CURRENT_DESKTOP
Unity
me@YOURBOX:~$ echo $GDMSESSION
ubuntu

me@YOURBOX:~$ ls -l /usr/share/xsessions/
total 4
-rw-r--r-- 1 root root 204 Nov 12  2015 ubuntu.desktop

How do I revert back to the Window Manager and defaults provided out of the box with Ubuntu 16.0.4 LTS?

16.04
Martin Hope
Homunculus Reticulli
Asked: 2017-04-05 06:14:22 +0800 CST
  • 72

I am having problems running VirtualBox on my Ubuntu laptop. My laptop is dual boot, and running (Windows 10 - I think, haven't used it in years), as well as Ubuntu 16.0.4 LTS.

I have secure boot enabled on the BIOS settings of my laptop.

I am aware that there are similar questions posted on here, specifically these two:

I have followed all of the instructions given in the answers sections for those two questions - yet, the problem remains unresolved.

Here is the console output, when I attempt to run virtualbox:

me@YOURBOX:~$ virtualbox
WARNING: The vboxdrv kernel module is not loaded. Either there is no module
         available for the current kernel (4.4.0-47-generic) or it failed to
         load. Please recompile the kernel module and install it by

           sudo /sbin/vboxconfig

         You will not be able to start VMs until this problem is fixed.

here is the console output when I run/sbin/vboxconfig as suggested:

me@YOURBOX:~$ sudo /sbin/vboxconfig  
vboxdrv.sh: Stopping VirtualBox services.
vboxdrv.sh: Building VirtualBox kernel modules.
vboxdrv.sh: Starting VirtualBox services.
vboxdrv.sh: Building VirtualBox kernel modules.
vboxdrv.sh: failed: modprobe vboxdrv failed. Please use 'dmesg' to find out why.

There were problems setting up VirtualBox.  To re-start the set-up process, run
  /sbin/vboxconfig
as root.

Here is the tail end of the output of dmesg:

[   44.319682] audit: type=1400 audit(1491313982.374:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/evince-previewer" pid=705 comm="apparmor_parser"
[   45.041433] cgroup: new mount options do not match the existing superblock, will be ignored
[   59.682936] IPv6: ADDRCONF(NETDEV_UP): wlp3s0: link is not ready
[   59.697820] IPv6: ADDRCONF(NETDEV_UP): wlp3s0: link is not ready
[   59.702008] IPv6: ADDRCONF(NETDEV_UP): enp2s0f0: link is not ready
[   60.267000] IPv6: ADDRCONF(NETDEV_UP): enp2s0f0: link is not ready
[   62.473044] IPv6: ADDRCONF(NETDEV_UP): wlp3s0: link is not ready
[   70.681706] audit_printk_skb: 60 callbacks suppressed
[   70.681709] audit: type=1400 audit(1491314008.734:32): apparmor="STATUS" operation="profile_load" profile="unconfined" name="docker-default" pid=2009 comm="apparmor_parser"
[   70.850936] aufs 4.x-rcN-20160111
[   75.407218] bridge: automatic filtering via arp/ip/ip6tables has been deprecated. Update your scripts to load br_netfilter if you need this.
[   75.408555] Bridge firewalling registered
[   75.427172] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[   75.848416] ip_tables: (C) 2000-2006 Netfilter Core Team
[   76.703232] Initializing XFRM netlink socket
[   77.060003] IPv6: ADDRCONF(NETDEV_UP): docker0: link is not ready
[   80.101042] aufs au_opts_verify:1597:dockerd[1402]: dirperm1 breaks the protection by the permission bits on the lower branch
[  113.895236] wlp3s0: authenticate with 84:16:f9:77:e1:54
[  113.910483] wlp3s0: send auth to 84:16:f9:77:e1:54 (try 1/3)
[  113.912712] wlp3s0: authenticated
[  113.915101] wlp3s0: associate with 84:16:f9:77:e1:54 (try 1/3)
[  113.919397] wlp3s0: RX AssocResp from 84:16:f9:77:e1:54 (capab=0x1411 status=0 aid=1)
[  113.919516] wlp3s0: associated
[  113.919559] IPv6: ADDRCONF(NETDEV_CHANGE): wlp3s0: link becomes ready

Now, I'm not going to lie - I have absolutely no idea what dmesg just spewed out - and as far as I can tell, there are no error messages in the log output - which makes the situation even more infuriating.

Has anyone ever installed VirtualBox 5.x on a laptop running Ubuntu 16.0.4 LTS - but with secure boot enabled on BIOS ? - if yes, what is the solution. ???!

Lots of people have this problem - even going a few years back. it is very strange that no one seems to have a solution for it - ???

virtualbox
Martin Hope
Homunculus Reticulli
Asked: 2016-10-30 03:59:34 +0800 CST
  • 5

I have installed fail2ban on my server (OS: Ubuntu 16.0.4 LTS). When I try to start it, I get the following error message:

Job for fail2ban.service failed because the control process exited with error code.

Here are the outputs for various diagnostic commands:

morpheous@ZEUS:~$ sudo systemctl status fail2ban.service
● fail2ban.service - Fail2Ban Service
   Loaded: loaded (/lib/systemd/system/fail2ban.service; enabled; vendor preset: enabled)
   Active: inactive (dead) (Result: exit-code) since Sat 2016-10-29 11:46:36 UTC; 18s ago
     Docs: man:fail2ban(1)
  Process: 23122 ExecStart=/usr/bin/fail2ban-client -x start (code=exited, status=255)

Oct 29 11:46:36 ZEUS systemd[1]: fail2ban.service: Unit entered failed state.
Oct 29 11:46:36 ZEUS systemd[1]: fail2ban.service: Failed with result 'exit-code'.
Oct 29 11:46:36 ZEUS systemd[1]: fail2ban.service: Service hold-off time over, scheduling restart.
Oct 29 11:46:36 ZEUS systemd[1]: Stopped Fail2Ban Service.
Oct 29 11:46:36 ZEUS systemd[1]: fail2ban.service: Start request repeated too quickly.
Oct 29 11:46:36 ZEUS systemd[1]: Failed to start Fail2Ban Service.



morpheous@ZEUS:~$ sudo journalctl -xe
Oct 29 11:46:36 ZEUS systemd[1]: fail2ban.service: Service hold-off time over, scheduling restart.
Oct 29 11:46:36 ZEUS systemd[1]: Stopped Fail2Ban Service.
-- Subject: Unit fail2ban.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit fail2ban.service has finished shutting down.
Oct 29 11:46:36 ZEUS systemd[1]: fail2ban.service: Start request repeated too quickly.
Oct 29 11:46:36 ZEUS systemd[1]: Failed to start Fail2Ban Service.
-- Subject: Unit fail2ban.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit fail2ban.service has failed.
-- 
-- The result is failed.
Oct 29 11:46:55 ZEUS sudo[23124]: morpheous : TTY=pts/0 ; PWD=/home/morpheous ; USER=root ; COMMAND=/bin/systemctl status fail2ban.service
Oct 29 11:46:55 ZEUS sudo[23124]: pam_unix(sudo:session): session opened for user root by morpheous(uid=0)
Oct 29 11:46:55 ZEUS sudo[23124]: pam_unix(sudo:session): session closed for user root
Oct 29 11:47:01 ZEUS kernel: iptables_INPUT_denied: IN=eth0 OUT= MAC=[mac_address] SRC=[lan_ip_address] DST=[server_ip_address]
Oct 29 11:47:09 ZEUS sudo[23128]: morpheous : TTY=pts/0 ; PWD=/home/morpheous ; USER=root ; COMMAND=/bin/journalctl -xe
Oct 29 11:47:09 ZEUS sudo[23128]: pam_unix(sudo:session): session opened for user root by morpheous(uid=0)
lines 1353-1374/1374 (END)

Does anyone know what's going on here, and more importantly - how to resolve this issue?

16.04
Martin Hope
Homunculus Reticulli
Asked: 2016-03-30 01:30:11 +0800 CST
  • 3

I have recently set up a local machine and a laptop, using noip.com, so that I can access the local (host) machine, via my laptop whilst I'm away on a trip - see my previous question here

Everything worked fine - until I thought I would give the machine (and router) a cold reboot - before going away for a couple of months. After following all of the previous steps given to me in my previous questions, I find I can't login back to the server machine from my laptop.

Here are the salient facts:

  1. Host machine (to be logged into) has SSH service running
  2. Host machine has static IP address configured (same IP as I was using before)
  3. No-IP update client is running on the host machine
  4. I can SSH into host machine from my laptop, when I'm on the same LAN, by using the local IP address 192.168.x.x
  5. The registered NO-IP address has not expired (I only registered it a few days ago - and I double checked by logging into my account - it has any correct public facing IP address)
  6. Port forwarding has been set up on the router, with SSH running on the default port of 22.

[[UPDATE]]

$sudo ufw status
To     Action     From
22     Allow      Anywhere
22(v6) Allow      Anywhere (v6)

Fail2ban has been installed on the host machine and was working well with my previous setup. I have currently stopped the service, whilst I try to figure out what is going on.

SSH has been set up on the host machine with the following config:

  • Port 22
  • PermitRootLogin no
  • PubkeyAuthentication yes
  • PasswordAuthentication no

When I attempt to SSH remotely, using my registered hostname from no-ip, I get the following error (this used to work fine until yesterday):

ssh -v [email protected]
OpenSSH_6.9p1 Ubuntu-2ubuntu0.1, OpenSSL 1.0.2d 9 Jul 2015
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 19: Applying options for *
debug1: Connecting to myhostname.ddns.net [80.189.109.195] port 22.
debug1: connect to address xxx.yyy.zzz.123 port 22: Connection refused
ssh: connect to host myhostname.ddns.net port 22: Connection refused

Can anyone see what may be going wrong?. I have a flight in a few hours time, and I desperately need to get this sorted out, so I can remotely access my local machine from my laptop.

networking
Martin Hope
Homunculus Reticulli
Asked: 2016-03-21 05:05:05 +0800 CST
  • 9

I will be travelling shortly, and I have a machine that run runs a bunch of cron jobs etc. I need to log in remotely to check the results of the jobs run and to do some work on the machine.

Here are the salient facts:

  1. The machine to be connected (mothership) is running Ubuntu 14.0.4 LTS
  2. The mothership is connected to the internet via a LAN at home, so has a public facing IP address.
  3. The IP address is dynamically assigned.
  4. I will be connecting to the mothership using a Laptop running Ubuntu 15.10

I prefer to use ssh rather than VNC, because of bandwidth problems - plus, all I need is the command line anyway.

What is the best way to securely connect remotely to my machine?

server
Martin Hope
Homunculus Reticulli
Asked: 2015-09-18 03:14:28 +0800 CST
  • 3

I have a server machine running Ubuntu 14.0.4 LTS. I have installed exactly the same OS version on a VirtualBox guest running on Windows 8 guest machine.

Both machines have internet connectivity.

By running ifconfig on both machines, I obtained the I.P addresses of the server and VBox guests as:

192.168.1.9
10.0.2.15

Now, I can ping the server machine from the VBox guest, but can't ping the VBox guest from the server machine.

I want to be able to log onto the server machine (as myself - both machines have the same logon name and password), from the VBox machine.

What do I nedd to do in order to be abe to connect onto the server machine from the VBox guest - as myself (i.e. a remote login)?

networking
Martin Hope
Homunculus Reticulli
Asked: 2012-11-19 12:47:00 +0800 CST
  • 0

I have been struggling all weekend, to upgrade an existing postgresql database from version 8.4 to 9.1. I have (had) both versions of databases after I updated my OS from 10.0.4 to 12.04.

I finally became exasperated and in a moment of lapsed judgement, I forcibly removing all 8.4 related files from my machine, using:

find / -type d -name 8.4 2>/dev/null | xargs rm -rf {}

I decided the better way to have removed it would have been `apt-get remove postgresql-8.4'

Well when I tried that, apt-get reported:

Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following packages will be REMOVED:
  postgresql-8.4
0 upgraded, 0 newly installed, 1 to remove and 0 not upgraded.
1 not fully installed or removed.
After this operation, 15.5 MB disk space will be freed.
Do you want to continue [Y/n]? y
(Reading database ... 304184 files and directories currently installed.)
Removing postgresql-8.4 ...
find: `/usr/share/postgresql/8.4/tsearch_data': No such file or directory
dpkg: error processing postgresql-8.4 (--remove):
 subprocess installed pre-removal script returned error exit status 1
Errors were encountered while processing:
 postgresql-8.4
E: Sub-process /usr/bin/dpkg returned an error code (1)

How do I purge postgresql 8.4 from my machine?

[[Edit]]

After I tried apt-get install --reinstall postgresql-8.4, I get the following error:

Reading package lists... Done
Building dependency tree       
Reading state information... Done
Suggested packages:
  oidentd ident-server
The following NEW packages will be installed:
  postgresql-8.4
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
1 not fully installed or removed.
Need to get 0 B/5,599 kB of archives.
After this operation, 15.5 MB of additional disk space will be used.
Selecting previously unselected package postgresql-8.4.
(Reading database ... 304010 files and directories currently installed.)
Unpacking postgresql-8.4 (from .../postgresql-8.4_8.4.14-0ubuntu12.04.2_amd64.deb) ...
Setting up postgresql-client-8.4 (8.4.14-0ubuntu12.04.2) ...
update-alternatives: error: alternative path /usr/share/postgresql/8.4/man/man1/psql.1.gz doesn't exist.
dpkg: error processing postgresql-client-8.4 (--configure):
 subprocess installed post-installation script returned error exit status 2
dpkg: dependency problems prevent configuration of postgresql-8.4:
 postgresql-8.4 depends on postgresql-client-8.4; however:
  Package postgresql-client-8.4 is not configured yet.
dpkg: error processing postgresql-8.4 (--configure):
 dependency problems - leaving unconfigured
No apport report written because the error message indicates its a followup error from a previous failure.
                                                                                                          Errors were encountered while processing:
 postgresql-client-8.4
 postgresql-8.4
E: Sub-process /usr/bin/dpkg returned an error code (1)
apt
Martin Hope
Homunculus Reticulli
Asked: 2012-07-04 23:54:48 +0800 CST
  • 0

I am writing data munging scripts (python and bash), to munge data and import large quantities of text files into a database.

I am currently in the test phase, so I am generating several K's of files and deleting them (the files consume about 20G of space). After a test run, I delete the files (sometimes without having imported into the database).

I notice that there is a steady decrease in the amount of free space on my disk (as reported by df -h). I don't understand this, as I use rm * (in the data directory), and in the cases where I use Nautilus, I empty the Trash bin as well.

Similarly, I notice that when I import the data into the (postgresql) database, and then delete the data from the tables using DELETE FROM tablename;, the size consumed in the postgresql data directory does not go down either.

Currently, I have lost approximately 200G from hard drive, and I need to reclaim that - but don't know what to do to reclaim it - any ideas?.

I am running Ubuntu 10.0.4 LTS + postgresql 8.4

[[Update]]

du -c / | 2>/dev/null | grep total produces this output:

4   /usr/src/linux-headers-2.6.32-38-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-41-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-36-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-30-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-35-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-31-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-27-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-28-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-40-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-34-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-37-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-33-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-39-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-29-generic/include/config/mtdram/total
4   /usr/src/linux-headers-2.6.32-32-generic/include/config/mtdram/total
187426036   total

df -hi produces this output:

Filesystem            Inodes   IUsed   IFree IUse% Mounted on
/dev/sda1                29M    1.8M     27M    7% /
none                    491K     776    490K    1% /dev
none                    492K       6    492K    1% /dev/shm
none                    492K      76    492K    1% /var/run
none                    492K       2    492K    1% /var/lock
none                    492K       1    492K    1% /lib/init/rw
/dev/sdb1                30M    3.0K     30M    1% /mydata
/dev/sdc1                  0       0       0    -  /media/Cruzer
disk-usage
Martin Hope
Homunculus Reticulli
Asked: 2012-06-22 10:08:59 +0800 CST
  • 1

I am running PostgreSQL (v 8.4) on Ubuntu 10.0.4.

The PG service currently starts on reboot (after I installed PG on my machine), however, I want the service to use a new data directory.

Currently, after a reboot, I have to:

  1. Stop the currently running PG service
  2. manually type: /usr/local/pgsql/bin/pg_ctl start -D /my/preffered/data/directory -l /usr/local/pgsql/data/logfile

Which file do I need to edit to ensure that I always have the service using the correct data folder?

10.04
Martin Hope
Homunculus Reticulli
Asked: 2012-06-22 06:59:47 +0800 CST
  • 121

I have recently installed a new hard drive to my Ubuntu 10.0.4 box. I used System -> Administration -> Disk Utils to format the disk (ext4 file type) - but did not create a partition (is this advisable?).

I have manually mounted the drive as /mydata.

I want to have the machine automatically mount the device on startup/reboot. How may I do this?

[[Update]]

This is the output from running sudo fdisk -l on my system:

Disk /dev/sda: 500.1 GB, 500107862016 bytes
255 heads, 63 sectors/track, 60801 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000858bf

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1       59334   476595200   83  Linux
/dev/sda2           59334       60802    11789313    5  Extended
/dev/sda5           59334       60802    11789312   82  Linux swap / Solaris

Disk /dev/sdb: 500.1 GB, 500107862016 bytes
255 heads, 63 sectors/track, 60801 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

Disk /dev/sdb doesn't contain a valid partition table

Disk /dev/sdc: 16.0 GB, 16026435072 bytes
254 heads, 63 sectors/track, 1956 cylinders
Units = cylinders of 16002 * 512 = 8193024 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1               1        1955    15641929    c  W95 FAT32 (LBA)
fstab
Martin Hope
Homunculus Reticulli
Asked: 2012-06-21 11:57:59 +0800 CST
  • 0

I recently purchased a new hard drive, for the sole purpose of storing a database. I am running Ubuntu 10.0.4.

Since I had not done this sort of thing before, I decided to use the GUI (Disk Utility) to format and mount the disk (to avoid any snarfus caused by typos etc at the command line).

I correctly identified the new drive and proceeded as follows:

  1. Elected to format the drive
  2. Selected type: 'Ext4'
  3. Selected the 'Take ownership of filesystem' checkbox
  4. Unchecked the 'encrypt underlying device' checkbox
  5. Provided a name for the new volume (mydata)

Once the device had been formatted, I then mounted the device as follows:

sudo mount /dev/sdb /mydata

I created the directory /mydata/pgdbdata

and changed ownership as follows

sudo chown -R postgres:postgres /mydata/pgdbdata

I check:

username@localhost:~$ ls -l /mydata/
total 20
drwx------ 2 root     root     16384 2012-06-19 23:05 lost+found
drwxr-xr-x 2 postgres postgres  4096 2012-06-20 19:04 pgdbdata

However when I change to postgres user:

username@localhost:~$ sudo su - postgres
postgres@localhost:~$ ls -l /mydata/
ls: cannot open directory /mydata/: Permission denied

Because of this permissions issue, I can start the postgresql service and I can't create the postgresql db cluster. I am stuck.

What am I doing wrong?

10.04