Is there a simple, one-liner yum-like command to install Python 3.9 on Amazon Linux?
[root@ip-10-0-0-182 ~]# yum install python39 Loaded plugins: extras_suggestions, langpacks, priorities, update-motd No package python39 available. Error: Nothing to do
The top hit on Google is currently this article which tells you to download sources and build it yourself. I don't want that.
I manage an actually not very big website, but Lambda is used extensively, invoked many times per site visit, resulting in hundreds of thousands of calls per month.
I noticed a spike in CloudTrail costs. Digging further I found that the biggest offender is calls to CreateLogStream made by the Lambda infrastructure, i.e. it is AWS's code doing this, not mine. My CloudTrail costs due to CreateLogStream are 100x the Lambda costs (Lambda's Free Tier distorts this ratio somewhat).
Short of completely deactivating CloudTrail, is there any way to stop incurring these charges?
I have read through the AWS Documentation and also this summarizing blog article here.
The TL;DR is that CloudFormation "import" requires you to meticulously define, down to the last detail, using CloudFormation template syntax, the resource that you are going to import. It is not possible for example, to use the Console to experiment with different solutions, then import the final workproduct into a CloudFormation template when you are done.
I feel like I must be missing something here. Surely there must be a way to dump the existing resources into JSON or YAML to be put into the template to finalize the import. Where is this step documented?
I have poured through the CLI and the boto3 documentation and found nothing.
When booting up an application from an AMI we noticed increased response times and increased rate of request time-out errors, slowly tapering off and going back to normal. I figured this is due to EBS lazy initialization (a well-documented performance characteristic of EBS). The application has a 24 GB EBS data volume.
I tried increasing instance sizes and noticed no difference. So, taking a step back to try to isolate the performance bottleneck, I ran some benchmarks with different instance sizes to try to find the one with the best pure EBS initialization performance, under the assumption that this will serve as a good proxy for "performance with lazy initialization during normal use of the application".
And I ran into a major surprise:
A t3.medium instance performs the same as a c5.18xlarge!
How can this be?
I'm using the fio command recommended by AWS here:
sudo fio --filename=/dev/nvme0n1 --rw=read --bs=128k --iodepth=32 --ioengine=libaio --direct=1 --name=volume-initialize
(modified for device /dev/nvme0n1)
the larger instance has nominally 5x the network performance of the smaller one (25 Gbps vs "Up to 5 Mbps").
Both plod along at about 35 MiB/s.
Bonus question: What instance type will give me the fastest EBS and S3 peformance, including, EBS initialization from snapshot?
UPDATES
I have system partition on /dev/xvda1 (slow disk) and just added SSD attached as /dev/xvdb.
How to fully transfer Linux system to /dev/xvdb and retire /dev/xvda1 without using the console?
tar or cpio?/etc/default/grub, but this doesn't set the root device anywhere. What gives?Anything else needed?
I was looking at the instructions here http://www.ivarch.com/blogs/oss/2007/01/resize-a-live-root-fs-a-howto.shtml
I wonder if these can be modified to remount an EBS volume as the root fs in an EC2 Spot Instance?
After installing the GitLab AMI image, is there a quick hack for the back-end database to replace "@example.com" references to my own?
There is no way to fix this through the normal UI since it needs email confirmation.
Instructions are scarce.
A MAJOR provider of cloud-based MySQL does not grant the SUPER privilege to the master user. The provider is Amazon RDS, but my question isn't about Amazon RDS specifically, it's for the general case of the database owner/administrator not having SUPER privilege.
Lacking SUPER privilege means you cannot use the DEFINER clause when creating Stored Procedures.
That in turn, means, you cannot lock-down your tables to be inaccessible to a given user while at the same time granting that same user indirect access via a Stored Procedure.
Is there an alternative way of accomplishing the same "no direct table access" security strategy without SUPER?
Talking about this feature http://httpd.apache.org/docs/current/howto/public_html.html
Is there a way (HOW?) to have Apache take on (setuid) the ID of each "~user", instead of doing everything under the www-data userid?
There is a related question here: Apache per user permissions
In that question, one answer actually advises against doing what I'm asking:
If you were to run one apache instance for each user, and have that apache owned by the user, you'd thereby grant apache permissions to write to all of the user's directories. That's generally not considered a good idea at all.
The fact that the answerer stated that you SHOULD NOT do this, seems to imply that you CAN do it. So now I'm just asking HOW TO do it, because I have a very specific use-case that requires it, but running a separate instance for each userid is too resource-intensive. So, is there an easier way?
I have no idea how this happened, but /etc/rc.*/ is simply missing.
As a result, aptitude and apt-get don't work right anymore.
Is there a quick-fix for this? I really don't want to reinstall the OS if I don't have to.
I'm trying to upgrade Ubuntu packages and see some strange names flying across the screen.
This package naming convention is throwing me off just a bit :-)
What is 5.1.30really5.0.75?
I have a MySQL database which dumps to a 3.5 GB backup (mysqldump) in about 10 minutes.
But reloading this backup on a standby / test server takes nearly 2 hours [originally 12 before some tuning].
What are some settings that would maximize reloading performance?
The most promising appear to be innodb_buffer_pool_size, innodb_additional_mem_pool_size, and innodb_log_buffer_size... but I'm reaching the limits of my trial-and-error approach. Which of these settings "should" be the most important?
Through trial-and-error I was not able to get more than 70% CPU utilization and 63% memory utilization. I'd like both at 100% during a reload.
All tables are InnoDB.
UPDATE
I was able to reduce the load time from 12 hours to 1h55min with these settings:
innodb_buffer_pool_size=192M innodb_additional_mem_pool_size=96M innodb_flush_log_at_trx_commit=0 innodb_log_buffer_size=64M innodb_file_per_table key_buffer = 32M max_allowed_packet = 32M
The test server is a 512MB Rackspace Cloud Server.
The production server is a 2GB Athlon 64 X2 4200.
mysql Ver 14.12 Distrib 5.0.67, for debian-linux-gnu (i486) using readline 5.2
I'm not sure how much more this can be tuned now... but it still bugs me that only 63% of available RAM is utilized my mysqld during the load.
I don't think this is a disk I/O bound problem. The same server can copy 20MB/s from a zip file. So, using some rough math, only 6 minutes of the 1h55m can be attributed to disk latency. So this really should be CPU-bound or memory-bound, but neither of those are going to 100%.
Rackspace publishes only a hard-to-use HTTP and JSON/XML based "API" (they call it an API but it's really a non-standard Web Service without a WSDL).
There are dozens of open-source language bindings to choose from. I have tried three of them so far and they're all horrible (incomplete, buggy, and/or undocumented).
Can anybody recommend a language binding which is reasonably complete, well documented, and bug-free? I can use Perl, Python, PHP, or Java. My ultimate objective is to create a script/program that will provision a server, launch a process inside it, wait for the process to finish, copy the results to the local server, and destroy the remote server. What's the best choice for that?
Thanks
The manual isn't very clear, and the online articles & tutorials don't bother to explain it.
What's the significance of -m tcp and -p tcp used together? It seems so redundant, it bothers me...
Thanks
I'm interested in finding open-source tools for auditing some PHP code I didn't write, before putting it into production. I'll need black-box HTTP-probing scanners as well as static code parsers/analyzers.
Where can I find a good comprehensive list of all such tools, and a smaller list of which ones are actually worth trying?
Here's a start. I haven't tried any of them:
It started happening today... all of a sudden, no apparent reason!
Here's the output from df:
assp:~# df -k Filesystem 1K-blocks Used Available Use% Mounted on /dev/simfs 6291456 1378384 4913072 22% / tmpfs 8202680 0 8202680 0% /lib/init/rw tmpfs 8202680 0 8202680 0% /dev/shm assp:~# df -i Filesystem Inodes IUsed IFree IUse% Mounted on /dev/simfs 55781934 83005 55698929 1% / tmpfs 2050670 2 2050668 1% /lib/init/rw tmpfs 2050670 1 2050669 1% /dev/shm assp:~# df -h Filesystem Size Used Avail Use% Mounted on /dev/simfs 6.0G 1.4G 4.7G 22% / tmpfs 7.9G 0 7.9G 0% /lib/init/rw tmpfs 7.9G 0 7.9G 0% /dev/shm
Here's an actual entry from /var/log/mail.warn:
Dec 11 17:55:37 assp postfix/smtpd[30614]: warning: not enough free space in mail queue: 0 bytes < 1.5*message size limit Dec 11 17:55:37 assp postfix/cleanup[30617]: warning: 4361D850D54: write queue file: No space left on device
.
By robust and low-hassle I mean NOT involving complex iptables setups, NOT involving apache, NOT requiring an additional client program, NOT requiring fragile shell scripts running from cron, etc.
Does anybody have sshd & ssh (client) patches to enable some form of port-knocking built-in to the sshd service & client itself?
For instance, rejecting connections on Port 22 until a properly encrypted and verified UDP packet is received, would be nice.
I'm disappointed that all port-knocking solutions out there are shameless hacks, rather than a nicely integrated and tested patch to the programs in question.
I am not able to FTP (retrieve) a large file from the Internet to my Linux VM. It times out after a while.
The actual error is "Could not read reply from control connection -- timed out." This error occurs after a few minutes, after a good chunk of the file has already been transferred.
The setup is:
FTP Client: ncftpget running in Linux on VMWare Player 3.0 FTP Server: somebody else's machine out on the Internet, configuration unknown Guest OS: Ubuntu 8.10 Linux 32-bit, with vmxnet and vmware tools installed. Host OS: Vista 64-bit Network: Linux VM connects to the Internet via Bridged NIC (also tried NAT) FTP Mode: PASVI did find some forum postings mentioning a 2-minute timeout somewhere. But exactly where and how to fix it was not clear. Some troubleshooting steps already tried:
UPDATE Netstat on the Linux VM and the equivalent admin page on the DIR-655 router both show the connection is alive and well (tcp 'ESTABLISHED' status). Vista doesn't see the connection at all, which I guess is normal if connection state is managed only within the VM.
Here's the output from netsh interface tcp show global on Vista, in case it's useful:
C:\Users\alex>netsh interface tcp show global Querying active state... TCP Global Parameters ---------------------------------------------- Receive-Side Scaling State : enabled Chimney Offload State : disabled Receive Window Auto-Tuning Level : highlyrestricted Add-On Congestion Control Provider : none ECN Capability : disabled RFC 1323 Timestamps : disabled ** The above autotuninglevel setting is the result of Windows Scaling heuristics overriding any local/policy configuration.
I just added the following to my Apache config file:
AddOutputFilterByType DEFLATE text/html text/plain text/xml
How do I check if it is actually working? Nothing on the browser tells me if the page contains gzipped content.
Host OS is Vista, Guest OS is Linux.
The host has 2 NICs: one LAN, one WAN.
Currently the guest only sees the LAN.
How can I get the guest OS to directly see and access both the LAN and WAN NICs?
Thanks